-- Logs begin at Thu 2022-06-02 12:54:46 UTC, end at Thu 2022-06-02 14:23:33 UTC. -- Jun 02 13:34:09.592539 dv-cinder-826510-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 13:34:09 2022] *** Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: nodename: dv-cinder-826510-6-smb Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: machine: x86_64 Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: clock source: unix Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: pcre jit disabled Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: detected number of CPU cores: 4 Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: current working directory: / Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: detected binary path: /usr/bin/uwsgi-core Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: your processes number limit is 47680 Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: your memory page size is 4096 bytes Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: detected max file descriptor number: 2048 Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: lock engine: pthread robust mutexes Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: thunder lock: enabled Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 02 13:34:09.605220 dv-cinder-826510-6-smb devstack@keystone.service[92257]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 13:34:09.648299 dv-cinder-826510-6-smb devstack@keystone.service[92257]: Python main interpreter initialized at 0x559e6ab039c0 Jun 02 13:34:09.648299 dv-cinder-826510-6-smb devstack@keystone.service[92257]: python threads support enabled Jun 02 13:34:09.648299 dv-cinder-826510-6-smb devstack@keystone.service[92257]: your server socket listen backlog is limited to 100 connections Jun 02 13:34:09.648299 dv-cinder-826510-6-smb devstack@keystone.service[92257]: your mercy for graceful operations on workers is 90 seconds Jun 02 13:34:09.650343 dv-cinder-826510-6-smb devstack@keystone.service[92257]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 13:34:09.650343 dv-cinder-826510-6-smb devstack@keystone.service[92257]: *** Operational MODE: preforking *** Jun 02 13:34:09.650343 dv-cinder-826510-6-smb devstack@keystone.service[92257]: *** uWSGI is running in multiple interpreter mode *** Jun 02 13:34:09.650343 dv-cinder-826510-6-smb devstack@keystone.service[92257]: spawned uWSGI master process (pid: 92257) Jun 02 13:34:09.650343 dv-cinder-826510-6-smb devstack@keystone.service[92257]: spawned uWSGI worker 1 (pid: 92271, cores: 1) Jun 02 13:34:09.650343 dv-cinder-826510-6-smb devstack@keystone.service[92257]: spawned uWSGI worker 2 (pid: 92272, cores: 1) Jun 02 13:34:09.649199 dv-cinder-826510-6-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 02 13:34:09.651597 dv-cinder-826510-6-smb devstack@keystone.service[92257]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 13:34:15.361976 dv-cinder-826510-6-smb devstack@keystone.service[92272]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:34:15.361976 dv-cinder-826510-6-smb devstack@keystone.service[92272]: from cryptography.utils import int_from_bytes Jun 02 13:34:15.362764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:34:15.362764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: from cryptography.utils import int_from_bytes Jun 02 13:34:15.363939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:34:15.363939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: from cryptography.utils import int_from_bytes Jun 02 13:34:15.364398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:34:15.364398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: from cryptography.utils import int_from_bytes Jun 02 13:34:15.413158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:34:15.413350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:34:15.413522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] command line args: [] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:34:15.413794 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:34:15.413974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ================================================================================ {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:34:15.414231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] admin_token = **** {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.414482 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] config_dir = [] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.414671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.414856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] config_source = [] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.415064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] debug = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.415274 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.415638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.415846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.416065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.416316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.416548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] list_limit = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.416729 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] log_config_append = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.416906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.417088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] log_dir = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.417266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] log_file = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.417504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.417752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.418000 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.418247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.418428 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.418608 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.418854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.419017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:34:15.419103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.419219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:34:15.419325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.419410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] command line args: [] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:34:15.419585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.419700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:34:15.419849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.419942 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ================================================================================ {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:34:15.420084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.420168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] admin_token = **** {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.420332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.420410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] config_dir = [] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.420578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.420671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.420765 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] config_source = [] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.420848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.420946 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] debug = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.421155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.421343 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.421471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.421555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] publish_errors = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.421631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.421761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.421841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.421966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.422053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.422126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.422250 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] list_limit = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.422382 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.422471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] log_config_append = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.422595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.422671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.422747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] log_dir = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.422825 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] standard_threads = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.422904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] log_file = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.423059 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.423143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.423303 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.423388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.423506 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.423642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.423728 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] use_journal = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.423851 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] use_json = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.423938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.424019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] use_stderr = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.424100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.424179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] use_syslog = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.424256 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.424406 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.424485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.424666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.424756 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.424906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.425094 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.425172 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.425245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.425370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.425463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.425604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.425693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.425852 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.425941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.426100 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.426178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.426337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.426414 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.426586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.426836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.426920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.426999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] publish_errors = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.427095 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.427235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.427335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.427487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.427629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.427714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.427833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.427930 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.428083 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.428168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.428331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.428401 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] standard_threads = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.428566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.428641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.428811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.428885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.428989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.429058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.429168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] use_journal = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.429297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.429372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] use_json = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.429507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] use_stderr = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.429579 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.429682 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] use_syslog = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.429778 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.429929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:34:15.430043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.430158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.430297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.430398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.430547 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.430661 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.430778 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.430901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.431009 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.431152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.431225 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.431391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.431486 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.431670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.431771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.431907 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.431996 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.432159 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.432234 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.432393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.432510 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.432644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.432778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.432875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.432952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.433116 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.433201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.433337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.433425 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.433572 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.433657 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.433810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.433889 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.434253 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.434346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.434346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.434479 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.434550 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.434620 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.434690 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.434768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.434927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.435006 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.435166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.435277 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.435967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.436089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.436220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.436335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.436436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.436539 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.436638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.436742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.436940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.437144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.437278 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.437368 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.437490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.437576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.437651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.437883 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.438149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.438238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.438319 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.438454 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.438580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.438669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.438750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.438823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.438941 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.439017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.439142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.439225 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.439303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.439381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.439487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.439645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.439735 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.439881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.439967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.440141 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.440227 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.440375 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.440462 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.440607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.440685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.440839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.440921 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.441090 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.441232 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.441323 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.441444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.441552 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.441638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.441787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.441875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.442026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.442114 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.442264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.442383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.442496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.442662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.442758 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.442821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.442972 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.443055 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.443205 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.443294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.443443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.443611 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.443705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.443921 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.443921 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.444309 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.444447 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.444578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.444709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.444839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.444968 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.445145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.445289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.445374 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.445535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.445684 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.445823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.445968 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.446111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.446237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.446363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.446499 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.446629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.446756 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.446884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.447021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.447150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.447280 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.447409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.447527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.447603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.447692 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.447769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.447841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.447913 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.447984 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.448044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.448123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.448207 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.448287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.448361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.448361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.448497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.448577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.448651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.448760 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.448841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.449054 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.449194 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.449278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.449354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.449519 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.449601 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.449754 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] auth.external = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.449841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.449987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.450067 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.450226 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.450304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.450465 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.450552 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.450704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.450783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] auth.password = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.450947 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] auth.token = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.451069 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.451780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.451875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.452009 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.452136 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.452265 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.452348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.452520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.452657 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.452787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.452915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.453044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.453166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.453296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.453431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.453568 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] credential.caching = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.453702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.453836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.453964 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.454128 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.454269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.454399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.454546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.454670 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.454799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.454927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.455055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.455185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.455325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.455325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.455601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.455723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.455849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.455989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.456129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.456221 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.456337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.456467 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.456596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.456732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] auth.external = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.456939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.457071 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.457196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.457322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.457458 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.457588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.457735 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.457866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] auth.password = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.457995 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] federation.caching = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.458077 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] auth.token = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.458205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.458336 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.458473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.458604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.458733 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.458868 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.458997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.459126 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.459265 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.459397 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.459551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.459678 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.459806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.459935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.460077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.460215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] credential.caching = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.460344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.460480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.460609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.460739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.460876 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.460959 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.461029 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity.caching = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.461091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.461150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.461207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.461274 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.461335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.461395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.461453 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.461611 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.461611 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.461911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.462037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.462037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.462037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.462354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.462428 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.462633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.462763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.462892 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.463022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.463170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.463260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.463336 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.463415 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.463521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.463605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.463681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.463762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.463837 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] federation.caching = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.463909 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.463981 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.464053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.464173 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.464262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.464422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.464503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.464654 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.464735 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.464902 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.464991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.465142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.465222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.465374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.465459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.465614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.465703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.465858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.465938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.466096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.466175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.466344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.466431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.466578 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.466657 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity.caching = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.466850 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.466930 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.467100 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.467187 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.467338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.467426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.467613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.467697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.467860 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.467954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.468092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.468174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.468331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.468410 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.468560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.468647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.468798 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.468878 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.469036 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.469117 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.469267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.469358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.469500 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.469580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.469736 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.469814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.469981 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.470068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.470228 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.470306 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.470462 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.470547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.470694 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.470782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.470945 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.471025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.471202 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.471294 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.471499 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.471605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.471683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.471763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.471913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.471994 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.472142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.472229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.472379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.472459 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.472622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.472775 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.472863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.473014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.473093 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.473266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.473346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.473519 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.473610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.473772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.473853 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.474012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.474092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.474246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.474334 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.474485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.474572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.474715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.474794 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.474951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.475038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.475180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.475259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.475419 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.475533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.475683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.475773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.475928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.476008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.476165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.476245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.476404 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.476492 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.476634 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.476721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.476882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.476962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.477112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.477200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.477345 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.477431 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.477585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.477664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.477822 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.477910 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.478059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.478138 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.478298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.478380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.478533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.478619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.478762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.478841 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.479003 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.479081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.479247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.479406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.479549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.479626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.479733 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.479882 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.479962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.480134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.480216 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.480384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.480463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.480623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.480703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.480855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.480936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.481094 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.481174 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] resource.caching = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.481332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.481419 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.481571 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.481652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.481804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.481883 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.482052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.482130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.482324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.482405 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.482562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.482646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.482810 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.482888 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.483044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.483124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.483275 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.483361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.483532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] role.caching = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.483614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.483770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.483852 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] role.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.484004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.484082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.484238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.484317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.484474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.484556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.484719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.484800 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.484965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.485044 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.485201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.485281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.485447 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.485526 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.485680 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.485759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.485925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.486007 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.486156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.486234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.486391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.486478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.486629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.486709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.486872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.486950 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.487111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.487197 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.487343 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.487563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.487646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.487805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.487886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] resource.caching = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.488056 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.488137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.488307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.488387 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.488542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.488620 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.488792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.488873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.489026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.489105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.489268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.489350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.489515 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.489596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.489753 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.489833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.489985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.490064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.490220 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] role.caching = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.490300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.490451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.490529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] role.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.490689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.490767 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.490940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.491021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.491185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.491264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.491424 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.491567 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.491685 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.491768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.491917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.492000 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.492154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] token.caching = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.492233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.492391 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.492471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.492637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.492716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.492872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.492951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.493120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.493201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.493365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.493443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.493602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.493681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.493847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.493927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.494088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.494503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.494590 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.494750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.494831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.495002 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.495082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.495255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.495334 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.495530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.495643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.495780 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.495872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.496007 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.496087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.496272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.496392 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.496533 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.496671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.496803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.496934 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.connection = **** {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.497088 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.497228 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.497366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.497496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.497625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.497754 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.498366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.498494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.498631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.498763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.498892 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.499020 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.499149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.499289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.499426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.499571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.499701 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.499831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.499960 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] token.caching = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.500089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.500228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.500357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.500485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.500614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.500742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.500880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.501007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.501146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.501275 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.501404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.501533 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.501734 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.501863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.501993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.502121 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.502249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.502249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:34:15.502503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.502503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.502503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.502503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.502503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.503042 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.503042 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.503296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.503512 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.503773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.connection = **** {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.504019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.504269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.504541 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.504750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.504989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.505226 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.505468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.505706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.505949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.506185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.506426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.506705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.506910 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.507145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.507389 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.507643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.507886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.508122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:34:15.508291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:34:15.531433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.531675 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.531902 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.533986 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.534213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.534438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.540481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.543237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.569327 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.569549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.571081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.571337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.630562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.631663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.681135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.681360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.682661 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.682891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.749881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.750103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.750328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.750500 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.750588 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.750755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.750840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.750971 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.751055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.751189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.751392 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.751636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.774233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.774407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.774630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.774716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.774849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.774932 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.775066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.775221 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.775304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.775463 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.775549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.775698 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.775918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.776132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.786765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.787622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.799819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.800054 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.800281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.800504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.800604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.800723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.800805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.800937 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.801021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.801161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.801244 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.801374 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.801591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.801805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:34:15.818766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.818972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:34:15.819261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.819344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.819488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:34:15.819573 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:34:15.819780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.819864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.820039 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.820286 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:34:15.820369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.820539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.820623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.820804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.821188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.821454 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.831605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.831878 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.832139 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.832421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.833031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.833304 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.833568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.833845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.840513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.841973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.843850 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.844127 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.844445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.844680 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.844957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.845292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.845375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.845566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.845651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.845840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.845924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.846108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.846231 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.846380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.846511 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.846645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.846769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.847038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.847309 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.847604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.847874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.848137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.873782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.875306 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.875498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.875773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.876938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.877217 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.881038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.881311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.881586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.882465 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.882741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.883018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.889410 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.889685 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.890837 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.891117 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.894182 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.894578 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.894857 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.895132 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.895400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.895693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.895790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.895959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.896043 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.896223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.896306 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.896563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.896837 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.897098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.897361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.897624 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.915403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.915702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.916919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.917193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.920452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.922122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.924205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.924497 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.925779 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.926077 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.929518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.931076 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.933143 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.934676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.938324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.938621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.938907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.939231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.939497 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.939775 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.939870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.940161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.940443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.940722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.941001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.941271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.959237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.959535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.959802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.960070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.960736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.961106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.961383 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.961702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.968601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.970130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.970328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.970601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.971896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.972150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.973668 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.973942 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.974231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.974506 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.974791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.975187 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.975478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.975836 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.976030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.976318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.988266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.988542 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.988818 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.989092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.989368 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.989636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.989752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:15.989909 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.990027 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.990302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.990579 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.990855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.991124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:15.991411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.008237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:16.009854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:16.011505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:16.013230 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:16.015339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.016967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.017073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.018600 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.018700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:16.018873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.019150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.020270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:16.020545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.020820 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.026657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.028258 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:16.028567 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.030728 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:16.032031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.032319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.032601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.032873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.033980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.034264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.034542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.034814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.042044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:16.042322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.042700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.045098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:16.045381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.045656 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.050655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:16.050931 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.051201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.051501 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.051751 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.052046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.052314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.052584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.052848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.053110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.053373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.053538 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:34:16.053643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.053814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.053899 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.054092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.054175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.054364 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.054631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.054914 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.055186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.055478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.055782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.056065 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.056332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.056616 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.056887 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.057149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:34:16.092892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559e6ab039c0 pid: 92272 (default app) Jun 02 13:34:16.095963 dv-cinder-826510-6-smb devstack@keystone.service[92271]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559e6ab039c0 pid: 92271 (default app) Jun 02 13:34:16.096160 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61037498-8f16-426b-8f74-39a3704910c2 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:16.096454 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61037498-8f16-426b-8f74-39a3704910c2 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:16.096732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61037498-8f16-426b-8f74-39a3704910c2 None None] PATH_INFO: `/v3` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:16.100985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Thu Jun 2 13:34:16 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:25.133333 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad75c9b-e685-411d-9d35-8c0db8172c84 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:25.133839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad75c9b-e685-411d-9d35-8c0db8172c84 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:25.133919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad75c9b-e685-411d-9d35-8c0db8172c84 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:25.138216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:34:25.144125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f2898-2fd6-48eb-8561-ba6dedb267f8 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:25.144506 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f2898-2fd6-48eb-8561-ba6dedb267f8 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:25.144685 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f2898-2fd6-48eb-8561-ba6dedb267f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:25.212771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: INFO dbcounter [None req-130f2898-2fd6-48eb-8561-ba6dedb267f8 None None] Registered counter for database keystone Jun 02 13:34:25.233849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG oslo_db.sqlalchemy.engines [None req-130f2898-2fd6-48eb-8561-ba6dedb267f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:34:25.240070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writer thread running {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:34:25.522929 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG passlib.handlers.bcrypt [None req-130f2898-2fd6-48eb-8561-ba6dedb267f8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92272) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 13:34:25.527513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG passlib.handlers.bcrypt [None req-130f2898-2fd6-48eb-8561-ba6dedb267f8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92272) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 13:34:25.579221 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-130f2898-2fd6-48eb-8561-ba6dedb267f8 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:25.580874 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-130f2898-2fd6-48eb-8561-ba6dedb267f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:25.705036 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 562 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 13:34:25.895089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad75c9b-e685-411d-9d35-8c0db8172c84 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:25.963731 dv-cinder-826510-6-smb devstack@keystone.service[92271]: INFO dbcounter [None req-9ad75c9b-e685-411d-9d35-8c0db8172c84 None None] Registered counter for database keystone Jun 02 13:34:25.983785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG oslo_db.sqlalchemy.engines [None req-9ad75c9b-e685-411d-9d35-8c0db8172c84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:34:25.989910 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writer thread running {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:34:26.211531 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad75c9b-e685-411d-9d35-8c0db8172c84 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:26.215823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ebcc6-9e1f-4671-a1de-140a735a9c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:26.216475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ebcc6-9e1f-4671-a1de-140a735a9c54 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:26.217289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ebcc6-9e1f-4671-a1de-140a735a9c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:26.217563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ebcc6-9e1f-4671-a1de-140a735a9c54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:26.225891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ebcc6-9e1f-4671-a1de-140a735a9c54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:26.278519 dv-cinder-826510-6-smb devstack@keystone.service[92271]: WARNING keystone.common.rbac_enforcer.enforcer [None req-318ebcc6-9e1f-4671-a1de-140a735a9c54 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 13:34:26.278860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ebcc6-9e1f-4671-a1de-140a735a9c54 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:26.289418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Thu Jun 2 13:34:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:34:26.295481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f2898-2fd6-48eb-8561-ba6dedb267f8 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:26.309801 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f2898-2fd6-48eb-8561-ba6dedb267f8 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:26.314338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e037d-ee9b-47f2-90bf-d707f106fefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:26.315470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e037d-ee9b-47f2-90bf-d707f106fefa admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:26.315769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e037d-ee9b-47f2-90bf-d707f106fefa admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:26.316052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e037d-ee9b-47f2-90bf-d707f106fefa admin admin] PATH_INFO: `/v3/projects/dbf6a4ee0a34470ea6e2b9b95f130787` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:26.317566 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e037d-ee9b-47f2-90bf-d707f106fefa admin admin] RBAC: Authorizing `identity:get_project(project_id=dbf6a4ee0a34470ea6e2b9b95f130787)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:26.369903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: WARNING keystone.common.rbac_enforcer.enforcer [None req-da6e037d-ee9b-47f2-90bf-d707f106fefa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 13:34:26.370243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e037d-ee9b-47f2-90bf-d707f106fefa admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:26.375039 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Thu Jun 2 13:34:26 2022] GET /identity/v3/projects/dbf6a4ee0a34470ea6e2b9b95f130787 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:28.616857 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76ea7c-7d57-4a8d-9caf-699c026e7f2d None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:28.617348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76ea7c-7d57-4a8d-9caf-699c026e7f2d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:28.617348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76ea7c-7d57-4a8d-9caf-699c026e7f2d None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:28.621775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:28.627925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008c8f-9cf3-47e2-b943-4e3663d544ec None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:28.628336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008c8f-9cf3-47e2-b943-4e3663d544ec None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:28.628486 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008c8f-9cf3-47e2-b943-4e3663d544ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:28.647204 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ca008c8f-9cf3-47e2-b943-4e3663d544ec None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:28.648739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ca008c8f-9cf3-47e2-b943-4e3663d544ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:28.656483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 13:34:28.679305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76ea7c-7d57-4a8d-9caf-699c026e7f2d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:28.692189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76ea7c-7d57-4a8d-9caf-699c026e7f2d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:28.696380 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae90a2-ff98-4fa6-8b46-4954f7d14670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:28.697037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae90a2-ff98-4fa6-8b46-4954f7d14670 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:28.697327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae90a2-ff98-4fa6-8b46-4954f7d14670 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:28.697634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae90a2-ff98-4fa6-8b46-4954f7d14670 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:28.705343 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae90a2-ff98-4fa6-8b46-4954f7d14670 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:28.707121 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae90a2-ff98-4fa6-8b46-4954f7d14670 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:28.715841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Thu Jun 2 13:34:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:34:28.721250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca008c8f-9cf3-47e2-b943-4e3663d544ec None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:28.730237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca008c8f-9cf3-47e2-b943-4e3663d544ec None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:28.735097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9853ef-d5bf-4052-87ce-f60b0386ba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:28.735987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9853ef-d5bf-4052-87ce-f60b0386ba85 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:28.736270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9853ef-d5bf-4052-87ce-f60b0386ba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:28.736544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9853ef-d5bf-4052-87ce-f60b0386ba85 admin admin] PATH_INFO: `/v3/users/c62a7303ac7c4c3a91bb0f96d54dfd52` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:28.737947 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9853ef-d5bf-4052-87ce-f60b0386ba85 admin admin] RBAC: Authorizing `identity:get_user(user_id=c62a7303ac7c4c3a91bb0f96d54dfd52)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:28.739799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9853ef-d5bf-4052-87ce-f60b0386ba85 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:28.741358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Thu Jun 2 13:34:28 2022] GET /identity/v3/users/c62a7303ac7c4c3a91bb0f96d54dfd52 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:31.059241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571f531-f87a-4361-ba2f-9d85c249dc0a None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:31.059796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571f531-f87a-4361-ba2f-9d85c249dc0a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:31.059878 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571f531-f87a-4361-ba2f-9d85c249dc0a None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:31.061740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:31.066924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5528a-46fc-425b-a807-408647b18449 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:31.067348 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5528a-46fc-425b-a807-408647b18449 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:31.067504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5528a-46fc-425b-a807-408647b18449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:31.071651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d9822-abcf-4307-96f4-3c9cce4714a8 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:31.071948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d9822-abcf-4307-96f4-3c9cce4714a8 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:31.072232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d9822-abcf-4307-96f4-3c9cce4714a8 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:31.074327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:34:31.079375 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1527f05-3b78-446f-8191-79c21171a57d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:31.079700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1527f05-3b78-446f-8191-79c21171a57d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:31.079977 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1527f05-3b78-446f-8191-79c21171a57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:31.084974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-0be5528a-46fc-425b-a807-408647b18449 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:31.086143 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-0be5528a-46fc-425b-a807-408647b18449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:31.120818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG passlib.handlers.bcrypt [None req-e1527f05-3b78-446f-8191-79c21171a57d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92271) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 13:34:31.121234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG passlib.handlers.bcrypt [None req-e1527f05-3b78-446f-8191-79c21171a57d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92271) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 13:34:31.168368 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:31.168572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-e1527f05-3b78-446f-8191-79c21171a57d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:31.170103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e1527f05-3b78-446f-8191-79c21171a57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:31.192056 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5528a-46fc-425b-a807-408647b18449 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:31.223903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:31.274085 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:34:31.296063 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1527f05-3b78-446f-8191-79c21171a57d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:31.305822 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5528a-46fc-425b-a807-408647b18449 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:31.342754 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d04888-8dad-4aa9-ad22-02548626cf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:31.344253 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d04888-8dad-4aa9-ad22-02548626cf31 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:31.344772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d04888-8dad-4aa9-ad22-02548626cf31 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:31.345289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d04888-8dad-4aa9-ad22-02548626cf31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:31.360350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d04888-8dad-4aa9-ad22-02548626cf31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-37d04888-8dad-4aa9-ad22-02548626cf31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:31.372011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:31.373580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:31.374879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:31.374879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:31.374879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:31.374879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:31.374879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:31.374879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:31.374879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:31.374879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:31.374879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:31.374879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:31.374879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:31.374879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:34:31.374879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:34:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:34:31.379638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d04888-8dad-4aa9-ad22-02548626cf31 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:31.399751 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1527f05-3b78-446f-8191-79c21171a57d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:31.402286 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:31.439131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626cd2d-cbb5-4681-aeb6-6e09642c7266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:31.440074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626cd2d-cbb5-4681-aeb6-6e09642c7266 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:31.440354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626cd2d-cbb5-4681-aeb6-6e09642c7266 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:31.440625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626cd2d-cbb5-4681-aeb6-6e09642c7266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:31.469326 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:31.488856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d04888-8dad-4aa9-ad22-02548626cf31 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:31.511664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626cd2d-cbb5-4681-aeb6-6e09642c7266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:31.513205 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626cd2d-cbb5-4681-aeb6-6e09642c7266 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:31.524017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1981b5-ada8-4a4b-a3e4-5cfc58663b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:31.524697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1981b5-ada8-4a4b-a3e4-5cfc58663b06 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:31.524979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1981b5-ada8-4a4b-a3e4-5cfc58663b06 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:31.525258 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1981b5-ada8-4a4b-a3e4-5cfc58663b06 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:31.526057 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1981b5-ada8-4a4b-a3e4-5cfc58663b06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:31.526367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1981b5-ada8-4a4b-a3e4-5cfc58663b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:31.527874 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1981b5-ada8-4a4b-a3e4-5cfc58663b06 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:31.541212 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:31.547475 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1981b5-ada8-4a4b-a3e4-5cfc58663b06 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:31.617610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:34:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:34:31.623973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626cd2d-cbb5-4681-aeb6-6e09642c7266 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:31.627686 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:31.651660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1981b5-ada8-4a4b-a3e4-5cfc58663b06 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:31.686691 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cf65a-3b9d-4485-825c-f4b77da9b6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:31.687604 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cf65a-3b9d-4485-825c-f4b77da9b6f4 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:31.687899 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cf65a-3b9d-4485-825c-f4b77da9b6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:31.688176 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cf65a-3b9d-4485-825c-f4b77da9b6f4 None admin] PATH_INFO: `/v3/users/c62a7303ac7c4c3a91bb0f96d54dfd52` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:31.689435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cf65a-3b9d-4485-825c-f4b77da9b6f4 None admin] RBAC: Authorizing `identity:get_user(user_id=c62a7303ac7c4c3a91bb0f96d54dfd52)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:31.690946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cf65a-3b9d-4485-825c-f4b77da9b6f4 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:31.692632 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:31 2022] GET /identity/v3/users/c62a7303ac7c4c3a91bb0f96d54dfd52 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:31.698127 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cf65a-3b9d-4485-825c-f4b77da9b6f4 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:31.715215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:31.740423 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626cd2d-cbb5-4681-aeb6-6e09642c7266 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:31.777068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422d9a3-ce9b-4ac8-a8cf-3bd6381e8211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:31.777925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422d9a3-ce9b-4ac8-a8cf-3bd6381e8211 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:31.778211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422d9a3-ce9b-4ac8-a8cf-3bd6381e8211 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:31.778526 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422d9a3-ce9b-4ac8-a8cf-3bd6381e8211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:31.799139 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422d9a3-ce9b-4ac8-a8cf-3bd6381e8211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:31.800683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422d9a3-ce9b-4ac8-a8cf-3bd6381e8211 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-6422d9a3-ce9b-4ac8-a8cf-3bd6381e8211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:34:31.822706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:31.823630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:31.824589 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:34:31.824589 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:34:31.824589 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:34:31.824589 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:34:31.824802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cf65a-3b9d-4485-825c-f4b77da9b6f4 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:31.824870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:34:31.830056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422d9a3-ce9b-4ac8-a8cf-3bd6381e8211 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:31.862964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6117c-1980-4957-bff9-1729583611d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:31.863809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6117c-1980-4957-bff9-1729583611d4 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:31.864096 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6117c-1980-4957-bff9-1729583611d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:31.864374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6117c-1980-4957-bff9-1729583611d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:31.865587 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6117c-1980-4957-bff9-1729583611d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:31.867055 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6117c-1980-4957-bff9-1729583611d4 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:31.868754 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:34:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:31.874696 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6117c-1980-4957-bff9-1729583611d4 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:31.892769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:31.938148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422d9a3-ce9b-4ac8-a8cf-3bd6381e8211 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:31.960332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:31.974998 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded9b00-d927-4bba-b77f-9a10dd86ac73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:31.975698 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9b00-d927-4bba-b77f-9a10dd86ac73 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:31.975983 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9b00-d927-4bba-b77f-9a10dd86ac73 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:31.976264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9b00-d927-4bba-b77f-9a10dd86ac73 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:31.977180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded9b00-d927-4bba-b77f-9a10dd86ac73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:31.977329 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded9b00-d927-4bba-b77f-9a10dd86ac73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:31.978731 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded9b00-d927-4bba-b77f-9a10dd86ac73 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:31.979529 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6117c-1980-4957-bff9-1729583611d4 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:31.996828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:32.016007 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f9550-20ad-45e4-8a5b-d9e0fce740a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:32.016690 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9550-20ad-45e4-8a5b-d9e0fce740a3 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:32.016972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9550-20ad-45e4-8a5b-d9e0fce740a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:32.017246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9550-20ad-45e4-8a5b-d9e0fce740a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:32.018114 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f9550-20ad-45e4-8a5b-d9e0fce740a3 None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.domain.id=default, user.id=c62a7303ac7c4c3a91bb0f96d54dfd52) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:32.018421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f9550-20ad-45e4-8a5b-d9e0fce740a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:32.019975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f9550-20ad-45e4-8a5b-d9e0fce740a3 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:32.027973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 11/21] 10.222.0.39 () {56 vars in 1322 bytes} [Thu Jun 2 13:34:31 2022] GET /identity/v3/role_assignments?user.id=c62a7303ac7c4c3a91bb0f96d54dfd52&scope.domain.id=default&role.id=c5632345c9274d348669482f1f7414c8 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:35.026452 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffd5f1-70b2-42e1-af6f-1d4183d694cf None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:35.027315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffd5f1-70b2-42e1-af6f-1d4183d694cf None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:35.027793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffd5f1-70b2-42e1-af6f-1d4183d694cf None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:35.029909 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:35.046885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c03f56-8b08-4bc1-aa6a-68c415e55c20 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:35.047608 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c03f56-8b08-4bc1-aa6a-68c415e55c20 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:35.048090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c03f56-8b08-4bc1-aa6a-68c415e55c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:35.083380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-91c03f56-8b08-4bc1-aa6a-68c415e55c20 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:35.085992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-91c03f56-8b08-4bc1-aa6a-68c415e55c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:35.260530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 12/23] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:35.296049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffd5f1-70b2-42e1-af6f-1d4183d694cf None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:35.492213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffd5f1-70b2-42e1-af6f-1d4183d694cf None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:35.537779 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:35.573407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bc89c-c487-4042-9821-03e77b49b7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:35.574687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bc89c-c487-4042-9821-03e77b49b7ef None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:35.575196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bc89c-c487-4042-9821-03e77b49b7ef None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:35.575718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bc89c-c487-4042-9821-03e77b49b7ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:35.608856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bc89c-c487-4042-9821-03e77b49b7ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-645bc89c-c487-4042-9821-03e77b49b7ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:35.631362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:35.632270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:35.633019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:35.633019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:35.633019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:35.633019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:35.633019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:35.633019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:35.633019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:35.633019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:35.633019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:35.633019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:35.633019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:35.633019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:34:35.634095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 12/24] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:34:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:35.641200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c03f56-8b08-4bc1-aa6a-68c415e55c20 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:35.729562 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fa3f7-d65a-4b58-91ce-214a6e7379ca None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:35.730509 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fa3f7-d65a-4b58-91ce-214a6e7379ca None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:35.731246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fa3f7-d65a-4b58-91ce-214a6e7379ca None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:35.733954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 13/25] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:35.742403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b249ef-ac8f-4313-aaa4-6a4283b2513a None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:35.742887 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b249ef-ac8f-4313-aaa4-6a4283b2513a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:35.743378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b249ef-ac8f-4313-aaa4-6a4283b2513a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:35.797055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-35b249ef-ac8f-4313-aaa4-6a4283b2513a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:35.799111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-35b249ef-ac8f-4313-aaa4-6a4283b2513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:35.849555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:35.895300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c03f56-8b08-4bc1-aa6a-68c415e55c20 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:35.926205 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 14/26] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:35.927641 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac8658-00f4-4b6b-904b-f8ba1634f228 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:35.927957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac8658-00f4-4b6b-904b-f8ba1634f228 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:35.928218 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac8658-00f4-4b6b-904b-f8ba1634f228 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:35.929787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 15/27] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:35.931123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82149155-f440-4d09-93c4-4f875f84ced8 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:35.931621 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82149155-f440-4d09-93c4-4f875f84ced8 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:35.932078 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82149155-f440-4d09-93c4-4f875f84ced8 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:35.934064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 16/28] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:35.935498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda82640-34b8-4b47-af5e-9aeac85c00d5 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:35.935864 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d10a3-c35c-484b-98ed-0aaf0fc7c8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:35.936051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda82640-34b8-4b47-af5e-9aeac85c00d5 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:35.936504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda82640-34b8-4b47-af5e-9aeac85c00d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:35.936851 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d10a3-c35c-484b-98ed-0aaf0fc7c8f8 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:35.937202 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d10a3-c35c-484b-98ed-0aaf0fc7c8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:35.937563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d10a3-c35c-484b-98ed-0aaf0fc7c8f8 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:35.938683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d10a3-c35c-484b-98ed-0aaf0fc7c8f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:35.939058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d10a3-c35c-484b-98ed-0aaf0fc7c8f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:35.940574 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d10a3-c35c-484b-98ed-0aaf0fc7c8f8 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:35.949848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 13/29] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:35.951304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabe6a3-d53a-495e-8ec8-33a477a4a327 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:35.951825 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabe6a3-d53a-495e-8ec8-33a477a4a327 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:35.952294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabe6a3-d53a-495e-8ec8-33a477a4a327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:35.955490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-bda82640-34b8-4b47-af5e-9aeac85c00d5 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:35.957004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-bda82640-34b8-4b47-af5e-9aeac85c00d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:35.970915 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-acabe6a3-d53a-495e-8ec8-33a477a4a327 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:35.972428 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-acabe6a3-d53a-495e-8ec8-33a477a4a327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:36.032504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 17/30] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:36.034364 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda82640-34b8-4b47-af5e-9aeac85c00d5 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:36.048335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 14/31] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:36.049928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabe6a3-d53a-495e-8ec8-33a477a4a327 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:36.072042 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:36.124725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:36.146191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda82640-34b8-4b47-af5e-9aeac85c00d5 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:36.164106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabe6a3-d53a-495e-8ec8-33a477a4a327 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:36.184088 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f5ea0-9749-44a2-8926-48dd51b89e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:36.184928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f5ea0-9749-44a2-8926-48dd51b89e33 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.185216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f5ea0-9749-44a2-8926-48dd51b89e33 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.185527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f5ea0-9749-44a2-8926-48dd51b89e33 None admin] PATH_INFO: `/v3/users/c62a7303ac7c4c3a91bb0f96d54dfd52` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.187248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f5ea0-9749-44a2-8926-48dd51b89e33 None admin] RBAC: Authorizing `identity:get_user(user_id=c62a7303ac7c4c3a91bb0f96d54dfd52)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:36.188792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f5ea0-9749-44a2-8926-48dd51b89e33 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:36.190592 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 18/32] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:36 2022] GET /identity/v3/users/c62a7303ac7c4c3a91bb0f96d54dfd52 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:36.191422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f5ea0-9749-44a2-8926-48dd51b89e33 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:36.206686 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c945d1-b25c-45f1-8c27-48a9ad54399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:36.207941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c945d1-b25c-45f1-8c27-48a9ad54399f None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.208497 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c945d1-b25c-45f1-8c27-48a9ad54399f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.208963 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c945d1-b25c-45f1-8c27-48a9ad54399f None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.210005 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c945d1-b25c-45f1-8c27-48a9ad54399f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:36.211794 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c945d1-b25c-45f1-8c27-48a9ad54399f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:36.326938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f5ea0-9749-44a2-8926-48dd51b89e33 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:36.332563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:36.398166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686e420-2c1b-4b22-8f8d-b078d4b88484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:36.399940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686e420-2c1b-4b22-8f8d-b078d4b88484 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.400683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686e420-2c1b-4b22-8f8d-b078d4b88484 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.401457 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686e420-2c1b-4b22-8f8d-b078d4b88484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.421148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686e420-2c1b-4b22-8f8d-b078d4b88484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:36.424292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686e420-2c1b-4b22-8f8d-b078d4b88484 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-2686e420-2c1b-4b22-8f8d-b078d4b88484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:34:36.460313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:36.461985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:36.463679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:34:36.463679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:34:36.463679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:34:36.463679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:34:36.467316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 19/33] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:36.469258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686e420-2c1b-4b22-8f8d-b078d4b88484 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:36.507159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 15/34] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 2 13:34:36 2022] POST /identity/v3/roles => generated 225 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:34:36.509431 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c945d1-b25c-45f1-8c27-48a9ad54399f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:36.661169 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686e420-2c1b-4b22-8f8d-b078d4b88484 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:36.726520 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96824e28-d057-40fb-a081-156e12ed9823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:36.727208 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96824e28-d057-40fb-a081-156e12ed9823 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.727516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96824e28-d057-40fb-a081-156e12ed9823 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.727799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96824e28-d057-40fb-a081-156e12ed9823 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.728381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c945d1-b25c-45f1-8c27-48a9ad54399f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:36.728706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96824e28-d057-40fb-a081-156e12ed9823 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:36.730126 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96824e28-d057-40fb-a081-156e12ed9823 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:36.763503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:36.772564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd41831-3d0b-4fb6-8ca5-d2dad952640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:36.773369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd41831-3d0b-4fb6-8ca5-d2dad952640a None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.773654 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd41831-3d0b-4fb6-8ca5-d2dad952640a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.773976 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd41831-3d0b-4fb6-8ca5-d2dad952640a None admin] PATH_INFO: `/v3/domains/default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.775337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd41831-3d0b-4fb6-8ca5-d2dad952640a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:36.776901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd41831-3d0b-4fb6-8ca5-d2dad952640a None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:36.781488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 16/35] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:34:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:36.781488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd41831-3d0b-4fb6-8ca5-d2dad952640a None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:36.881424 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd41831-3d0b-4fb6-8ca5-d2dad952640a None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:36.915439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a94920-50b3-4c7a-91b6-ea88a071c728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:36.916115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a94920-50b3-4c7a-91b6-ea88a071c728 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.916398 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a94920-50b3-4c7a-91b6-ea88a071c728 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.916670 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a94920-50b3-4c7a-91b6-ea88a071c728 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.917403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a94920-50b3-4c7a-91b6-ea88a071c728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:36.917705 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a94920-50b3-4c7a-91b6-ea88a071c728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:36.919165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a94920-50b3-4c7a-91b6-ea88a071c728 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:36.938814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 17/36] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:36.940263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbc4c2-20d4-405c-9d93-c2af7b1e0fca None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.940603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbc4c2-20d4-405c-9d93-c2af7b1e0fca None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.940880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbc4c2-20d4-405c-9d93-c2af7b1e0fca None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.946536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 18/37] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:36.946536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbc4c2-20d4-405c-9d93-c2af7b1e0fca None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:36.951366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 20/38] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 2 13:34:36 2022] POST /identity/v3/roles => generated 219 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:34:36.953082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab836b-7334-4992-970b-e438f48ed1a8 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.953382 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab836b-7334-4992-970b-e438f48ed1a8 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.953720 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab836b-7334-4992-970b-e438f48ed1a8 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.955406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 21/39] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:36.955988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab836b-7334-4992-970b-e438f48ed1a8 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:36.978331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:37.021560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:37.076647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab836b-7334-4992-970b-e438f48ed1a8 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:37.077180 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbc4c2-20d4-405c-9d93-c2af7b1e0fca None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:37.116555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869aa9e-ac49-490c-85a0-bb8dd36fb1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:37.117018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a641d-2ea1-4c9e-a206-aebc8c707eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:37.117232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869aa9e-ac49-490c-85a0-bb8dd36fb1e1 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:37.117519 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869aa9e-ac49-490c-85a0-bb8dd36fb1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:37.117796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869aa9e-ac49-490c-85a0-bb8dd36fb1e1 None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:37.118525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869aa9e-ac49-490c-85a0-bb8dd36fb1e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:37.119018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a641d-2ea1-4c9e-a206-aebc8c707eed None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:37.119823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a641d-2ea1-4c9e-a206-aebc8c707eed None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:37.120329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a641d-2ea1-4c9e-a206-aebc8c707eed None admin] PATH_INFO: `/v3/domains/default/users/c62a7303ac7c4c3a91bb0f96d54dfd52/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:37.120501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869aa9e-ac49-490c-85a0-bb8dd36fb1e1 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:37.123352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a641d-2ea1-4c9e-a206-aebc8c707eed None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c62a7303ac7c4c3a91bb0f96d54dfd52, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:37.125095 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a641d-2ea1-4c9e-a206-aebc8c707eed None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:37.241932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 19/40] 10.222.0.39 () {58 vars in 1361 bytes} [Thu Jun 2 13:34:36 2022] PUT /identity/v3/domains/default/users/c62a7303ac7c4c3a91bb0f96d54dfd52/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:34:37.243237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1e388-4967-4230-a742-88e76ea72653 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:37.243555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1e388-4967-4230-a742-88e76ea72653 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:37.243840 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1e388-4967-4230-a742-88e76ea72653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:37.263934 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-48a1e388-4967-4230-a742-88e76ea72653 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:37.265607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-48a1e388-4967-4230-a742-88e76ea72653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:37.274805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 22/41] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 2 13:34:36 2022] POST /identity/v3/projects => generated 301 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:34:37.277234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f56f50-e422-45b9-a5f8-086bd4f56b98 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:37.277808 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f56f50-e422-45b9-a5f8-086bd4f56b98 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:37.278850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f56f50-e422-45b9-a5f8-086bd4f56b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:37.319188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-c2f56f50-e422-45b9-a5f8-086bd4f56b98 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:37.322826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c2f56f50-e422-45b9-a5f8-086bd4f56b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:37.371492 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 20/42] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:37.408614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1e388-4967-4230-a742-88e76ea72653 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:37.438733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:37.447899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 23/43] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:37.472733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f56f50-e422-45b9-a5f8-086bd4f56b98 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:37.492849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:37.581286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1e388-4967-4230-a742-88e76ea72653 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:37.611999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f56f50-e422-45b9-a5f8-086bd4f56b98 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:37.623013 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd855e-a96d-4b4c-80a2-565fd9222883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:37.623732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd855e-a96d-4b4c-80a2-565fd9222883 None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:37.624018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd855e-a96d-4b4c-80a2-565fd9222883 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:37.624300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd855e-a96d-4b4c-80a2-565fd9222883 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:37.625074 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd855e-a96d-4b4c-80a2-565fd9222883 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:37.626589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd855e-a96d-4b4c-80a2-565fd9222883 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:37.648797 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950c8c0-6ab8-46bc-932e-62eea7fa910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:37.649605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950c8c0-6ab8-46bc-932e-62eea7fa910d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:37.650264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950c8c0-6ab8-46bc-932e-62eea7fa910d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:37.650550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950c8c0-6ab8-46bc-932e-62eea7fa910d None admin] PATH_INFO: `/v3/domains/default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:37.651863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950c8c0-6ab8-46bc-932e-62eea7fa910d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:37.653425 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950c8c0-6ab8-46bc-932e-62eea7fa910d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:37.655607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 24/44] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:34:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:37.662261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950c8c0-6ab8-46bc-932e-62eea7fa910d None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:37.716045 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 21/45] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 2 13:34:37 2022] POST /identity/v3/roles => generated 223 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:34:37.744133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:37.788219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950c8c0-6ab8-46bc-932e-62eea7fa910d None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:37.830613 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcc900-1ba3-4d11-b9e0-a54e3a834729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:37.831310 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcc900-1ba3-4d11-b9e0-a54e3a834729 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:37.831652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcc900-1ba3-4d11-b9e0-a54e3a834729 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:37.831939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcc900-1ba3-4d11-b9e0-a54e3a834729 None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:37.832676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcc900-1ba3-4d11-b9e0-a54e3a834729 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:37.834225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcc900-1ba3-4d11-b9e0-a54e3a834729 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:37.917504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 25/46] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 2 13:34:37 2022] POST /identity/v3/projects => generated 312 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:34:39.599281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2f415-fd2d-4e19-8c85-19a84612ec4c None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:39.599796 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2f415-fd2d-4e19-8c85-19a84612ec4c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:39.599796 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2f415-fd2d-4e19-8c85-19a84612ec4c None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:39.601196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 22/47] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:39.606817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb471cfe-5be6-42b6-9b2f-b07fcbaf5ec5 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:39.607294 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb471cfe-5be6-42b6-9b2f-b07fcbaf5ec5 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:39.607441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb471cfe-5be6-42b6-9b2f-b07fcbaf5ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:39.625383 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-bb471cfe-5be6-42b6-9b2f-b07fcbaf5ec5 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:39.626589 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-bb471cfe-5be6-42b6-9b2f-b07fcbaf5ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:39.699289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 26/48] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:39.723331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2f415-fd2d-4e19-8c85-19a84612ec4c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:39.838427 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2f415-fd2d-4e19-8c85-19a84612ec4c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:39.840907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:39.875241 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de3357-ab23-4b1d-b163-3fdc97c5f7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:39.876041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de3357-ab23-4b1d-b163-3fdc97c5f7aa None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:39.876314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de3357-ab23-4b1d-b163-3fdc97c5f7aa None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:39.876595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de3357-ab23-4b1d-b163-3fdc97c5f7aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:39.889696 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de3357-ab23-4b1d-b163-3fdc97c5f7aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-28de3357-ab23-4b1d-b163-3fdc97c5f7aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:39.897885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:39.898838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:39.899808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:39.899808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:39.899808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:39.899808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:39.899808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:39.899808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:39.899808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:39.899808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:39.899808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:39.899808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:39.899808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:39.899808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:34:39.899808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 23/49] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:34:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:39.905971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb471cfe-5be6-42b6-9b2f-b07fcbaf5ec5 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:39.956362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:40.009698 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb471cfe-5be6-42b6-9b2f-b07fcbaf5ec5 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:40.045625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6b768-c627-4b51-99b9-1ca520159142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:40.046301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6b768-c627-4b51-99b9-1ca520159142 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:40.046588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6b768-c627-4b51-99b9-1ca520159142 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:40.046871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6b768-c627-4b51-99b9-1ca520159142 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:40.047675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6b768-c627-4b51-99b9-1ca520159142 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:40.047983 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6b768-c627-4b51-99b9-1ca520159142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:40.049384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6b768-c627-4b51-99b9-1ca520159142 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:40.061596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 27/50] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:40.067163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de3357-ab23-4b1d-b163-3fdc97c5f7aa None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:40.171417 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de3357-ab23-4b1d-b163-3fdc97c5f7aa None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:40.206817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f079c6-5ac4-4b40-93f0-6b1d537eb51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:40.207721 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f079c6-5ac4-4b40-93f0-6b1d537eb51b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:40.208004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f079c6-5ac4-4b40-93f0-6b1d537eb51b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:40.208276 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f079c6-5ac4-4b40-93f0-6b1d537eb51b None admin] PATH_INFO: `/v3/users/c62a7303ac7c4c3a91bb0f96d54dfd52` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:40.209513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f079c6-5ac4-4b40-93f0-6b1d537eb51b None admin] RBAC: Authorizing `identity:get_user(user_id=c62a7303ac7c4c3a91bb0f96d54dfd52)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:40.210996 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f079c6-5ac4-4b40-93f0-6b1d537eb51b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:40.212898 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 24/51] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:40 2022] GET /identity/v3/users/c62a7303ac7c4c3a91bb0f96d54dfd52 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:40.218852 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6b768-c627-4b51-99b9-1ca520159142 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:40.220093 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbd970-6ef4-41ae-87f0-2769f0008317 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:40.220391 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbd970-6ef4-41ae-87f0-2769f0008317 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:40.220681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbd970-6ef4-41ae-87f0-2769f0008317 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:40.222035 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 25/52] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:34:40.227305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bf237-dfe7-42e2-adb5-478c99e4fb31 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:40.227647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bf237-dfe7-42e2-adb5-478c99e4fb31 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:40.227935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bf237-dfe7-42e2-adb5-478c99e4fb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:40.246104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-289bf237-dfe7-42e2-adb5-478c99e4fb31 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:40.247320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-289bf237-dfe7-42e2-adb5-478c99e4fb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:40.276212 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:40.320087 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 26/53] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:34:40.329766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6b768-c627-4b51-99b9-1ca520159142 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:40.340150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:40.343830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bf237-dfe7-42e2-adb5-478c99e4fb31 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:40.363301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6744906-0451-4cc6-b705-c6752b5146fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:40.364135 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6744906-0451-4cc6-b705-c6752b5146fd None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:40.364428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6744906-0451-4cc6-b705-c6752b5146fd None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:40.364712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6744906-0451-4cc6-b705-c6752b5146fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:40.365893 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6744906-0451-4cc6-b705-c6752b5146fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:40.367362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6744906-0451-4cc6-b705-c6752b5146fd None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:40.369045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 28/54] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:34:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:40.375636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6744906-0451-4cc6-b705-c6752b5146fd None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:40.444533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bf237-dfe7-42e2-adb5-478c99e4fb31 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:40.477599 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6744906-0451-4cc6-b705-c6752b5146fd None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:40.479015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c9367-df90-4151-9164-037c43186309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:40.479846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c9367-df90-4151-9164-037c43186309 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:40.480240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c9367-df90-4151-9164-037c43186309 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:40.480609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c9367-df90-4151-9164-037c43186309 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:40.481609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c9367-df90-4151-9164-037c43186309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:40.483633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c9367-df90-4151-9164-037c43186309 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:40.485262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:34:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:40.490873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c9367-df90-4151-9164-037c43186309 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:40.513304 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494044e9-e9e7-4280-912a-c91424cc9632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:40.513964 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494044e9-e9e7-4280-912a-c91424cc9632 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:40.514250 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494044e9-e9e7-4280-912a-c91424cc9632 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:40.514528 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494044e9-e9e7-4280-912a-c91424cc9632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:40.515350 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494044e9-e9e7-4280-912a-c91424cc9632 None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.domain.id=default, user.id=c62a7303ac7c4c3a91bb0f96d54dfd52) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:40.515700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494044e9-e9e7-4280-912a-c91424cc9632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:40.517154 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494044e9-e9e7-4280-912a-c91424cc9632 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:40.520688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:40.527014 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 29/56] 10.222.0.39 () {56 vars in 1322 bytes} [Thu Jun 2 13:34:40 2022] GET /identity/v3/role_assignments?user.id=c62a7303ac7c4c3a91bb0f96d54dfd52&scope.domain.id=default&role.id=c5632345c9274d348669482f1f7414c8 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:40.600016 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c9367-df90-4151-9164-037c43186309 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:40.637804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5d81e-ac0e-4c53-a5ae-66a42b4b3f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:40.638483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5d81e-ac0e-4c53-a5ae-66a42b4b3f6a None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:40.638775 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5d81e-ac0e-4c53-a5ae-66a42b4b3f6a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:40.639058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5d81e-ac0e-4c53-a5ae-66a42b4b3f6a None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:40.639816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5d81e-ac0e-4c53-a5ae-66a42b4b3f6a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:40.641319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5d81e-ac0e-4c53-a5ae-66a42b4b3f6a None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:40.751369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 28/57] 10.222.0.39 () {60 vars in 1140 bytes} [Thu Jun 2 13:34:40 2022] POST /identity/v3/projects => generated 298 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:34:42.997106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951f0f-90c9-4d66-b5d9-c7e977e0b7d0 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:42.997630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951f0f-90c9-4d66-b5d9-c7e977e0b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:42.997739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951f0f-90c9-4d66-b5d9-c7e977e0b7d0 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:42.999629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 30/58] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:43.004810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8583b15-0fa9-4085-a4fd-874b9da1f165 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:43.005179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8583b15-0fa9-4085-a4fd-874b9da1f165 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:43.005376 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8583b15-0fa9-4085-a4fd-874b9da1f165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:43.022047 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-f8583b15-0fa9-4085-a4fd-874b9da1f165 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:43.023244 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f8583b15-0fa9-4085-a4fd-874b9da1f165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:43.088169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 29/59] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:43.113170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3951f0f-90c9-4d66-b5d9-c7e977e0b7d0 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:43.156784 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:43.210715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3951f0f-90c9-4d66-b5d9-c7e977e0b7d0 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:43.243125 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dbab2-4fc8-4021-8952-b9176dccc241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:43.243918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dbab2-4fc8-4021-8952-b9176dccc241 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:43.244197 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dbab2-4fc8-4021-8952-b9176dccc241 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:43.244715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dbab2-4fc8-4021-8952-b9176dccc241 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:43.245894 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dbab2-4fc8-4021-8952-b9176dccc241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:43.247397 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dbab2-4fc8-4021-8952-b9176dccc241 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:43.249513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 31/60] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:34:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:43.255049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8583b15-0fa9-4085-a4fd-874b9da1f165 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:43.269727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:43.361642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8583b15-0fa9-4085-a4fd-874b9da1f165 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:43.394882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa346a-6483-4a08-9487-927e7f12c56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:43.395561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa346a-6483-4a08-9487-927e7f12c56e None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:43.395906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa346a-6483-4a08-9487-927e7f12c56e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:43.396151 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa346a-6483-4a08-9487-927e7f12c56e None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:43.396835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa346a-6483-4a08-9487-927e7f12c56e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:43.398280 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa346a-6483-4a08-9487-927e7f12c56e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:43.499583 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 30/61] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:34:43 2022] POST /identity/v3/users => generated 275 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:34:47.026774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aef728-7d49-4d54-8d76-013db7bbe794 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.027748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aef728-7d49-4d54-8d76-013db7bbe794 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.028251 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aef728-7d49-4d54-8d76-013db7bbe794 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.029995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 32/62] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:47.036373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e89fb6-f555-4ceb-9878-afd9e5cb39f8 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.036987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e89fb6-f555-4ceb-9878-afd9e5cb39f8 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.036987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e89fb6-f555-4ceb-9878-afd9e5cb39f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.058551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-40e89fb6-f555-4ceb-9878-afd9e5cb39f8 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:47.059807 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-40e89fb6-f555-4ceb-9878-afd9e5cb39f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:47.155715 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:47.162843 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 31/63] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:34:47.198122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22bfa6-cccf-4768-ba31-a19883409f00 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.201928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22bfa6-cccf-4768-ba31-a19883409f00 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.201928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22bfa6-cccf-4768-ba31-a19883409f00 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.202237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e89fb6-f555-4ceb-9878-afd9e5cb39f8 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:47.202316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 33/64] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:47.208906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bfc52-60f9-45de-9753-08d3df276c90 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.209194 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bfc52-60f9-45de-9753-08d3df276c90 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.210131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bfc52-60f9-45de-9753-08d3df276c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.244191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-be3bfc52-60f9-45de-9753-08d3df276c90 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:47.248584 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-be3bfc52-60f9-45de-9753-08d3df276c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:47.365980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e89fb6-f555-4ceb-9878-afd9e5cb39f8 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:47.438883 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ba0b6-6b1e-4bb0-8777-96d07988727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:47.440106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ba0b6-6b1e-4bb0-8777-96d07988727a None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.440611 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ba0b6-6b1e-4bb0-8777-96d07988727a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.441107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ba0b6-6b1e-4bb0-8777-96d07988727a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.451784 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 34/65] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:34:47.453685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637244-79ce-4129-a318-19ac52bfa71f None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.454124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637244-79ce-4129-a318-19ac52bfa71f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.454341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ba0b6-6b1e-4bb0-8777-96d07988727a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:47.454722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637244-79ce-4129-a318-19ac52bfa71f None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.456336 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 35/66] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:47.462022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95e2d0-8863-4ba5-a076-5535c3b45d4f None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.462583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95e2d0-8863-4ba5-a076-5535c3b45d4f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.463076 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95e2d0-8863-4ba5-a076-5535c3b45d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-9d8ba0b6-6b1e-4bb0-8777-96d07988727a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:47.469679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:47.471884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:47.473058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:47.473058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:47.473058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:47.473058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:47.473058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:47.473058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:47.473058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:47.473058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:47.473058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:47.473058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:47.473058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:34:47.473058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:34:47.473058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 32/67] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:34:47.477663 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ba0b6-6b1e-4bb0-8777-96d07988727a None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:47.490905 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-4b95e2d0-8863-4ba5-a076-5535c3b45d4f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:47.492638 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4b95e2d0-8863-4ba5-a076-5535c3b45d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:47.536335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:47.545626 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:47.592339 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 36/68] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:34:47.593668 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95e2d0-8863-4ba5-a076-5535c3b45d4f None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:47.610498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ba0b6-6b1e-4bb0-8777-96d07988727a None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:47.646584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72474cf4-c2b1-4977-a52e-e37193b6ca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:47.647175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72474cf4-c2b1-4977-a52e-e37193b6ca1a None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.647488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72474cf4-c2b1-4977-a52e-e37193b6ca1a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.647779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72474cf4-c2b1-4977-a52e-e37193b6ca1a None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.648555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72474cf4-c2b1-4977-a52e-e37193b6ca1a None admin] RBAC: Adding query filter params (name=member) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:47.648862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72474cf4-c2b1-4977-a52e-e37193b6ca1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:47.650288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72474cf4-c2b1-4977-a52e-e37193b6ca1a None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:47.658878 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 33/69] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:34:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:47.660207 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9741ba-7f5d-41f6-a2d6-8294d25c5618 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.660498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9741ba-7f5d-41f6-a2d6-8294d25c5618 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.660777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9741ba-7f5d-41f6-a2d6-8294d25c5618 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.662012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 34/70] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:47.663076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c315a-a507-4c96-bf4d-9a13a74d4059 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.663352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c315a-a507-4c96-bf4d-9a13a74d4059 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.663654 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c315a-a507-4c96-bf4d-9a13a74d4059 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.664906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 35/71] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:47.665606 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c315a-a507-4c96-bf4d-9a13a74d4059 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:47.708246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95e2d0-8863-4ba5-a076-5535c3b45d4f None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:47.741821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605df12-05c9-429f-98ee-f357c3f03431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:47.742704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605df12-05c9-429f-98ee-f357c3f03431 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.742994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605df12-05c9-429f-98ee-f357c3f03431 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.743272 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605df12-05c9-429f-98ee-f357c3f03431 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.756370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605df12-05c9-429f-98ee-f357c3f03431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-2605df12-05c9-429f-98ee-f357c3f03431 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:47.765859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:47.766897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:47.767888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:47.767888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:47.767888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:47.767888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:47.767888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:47.767888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:47.767888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:47.767888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:47.767888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:47.767888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:47.767888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:47.767888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:34:47.767888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 37/72] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:34:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:47.768665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605df12-05c9-429f-98ee-f357c3f03431 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:47.775203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c315a-a507-4c96-bf4d-9a13a74d4059 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:47.795222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:47.799851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:47.809315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b5140-b3da-4f33-b739-31bfeb3fb80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:47.811024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b5140-b3da-4f33-b739-31bfeb3fb80d None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.811024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b5140-b3da-4f33-b739-31bfeb3fb80d None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.811390 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b5140-b3da-4f33-b739-31bfeb3fb80d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.822905 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b5140-b3da-4f33-b739-31bfeb3fb80d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-328b5140-b3da-4f33-b739-31bfeb3fb80d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:47.831783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:47.832660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:47.833399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:47.833399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:47.833399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:47.833399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:47.833399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:47.833399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:47.833399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:47.833399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:47.833399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:47.833399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:47.833399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:34:47.833399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:34:47.833399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 36/73] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:34:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:47.834321 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24ef62-8a97-428a-b55f-465c1a491ee4 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.834916 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24ef62-8a97-428a-b55f-465c1a491ee4 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.835519 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24ef62-8a97-428a-b55f-465c1a491ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.853161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-7b24ef62-8a97-428a-b55f-465c1a491ee4 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:47.854416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-7b24ef62-8a97-428a-b55f-465c1a491ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:47.872715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605df12-05c9-429f-98ee-f357c3f03431 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:47.907376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3dca9-6a6b-41f5-b8b6-ea0fab7e66bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:47.908190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3dca9-6a6b-41f5-b8b6-ea0fab7e66bf None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.908480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3dca9-6a6b-41f5-b8b6-ea0fab7e66bf None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.908762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3dca9-6a6b-41f5-b8b6-ea0fab7e66bf None admin] PATH_INFO: `/v3/users/eca02941be074229a99a5024c4561e96` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.922926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 37/74] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:47.923941 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3dca9-6a6b-41f5-b8b6-ea0fab7e66bf None admin] RBAC: Authorizing `identity:get_user(user_id=eca02941be074229a99a5024c4561e96)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:47.924897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7572-b403-4b81-9814-c6e6203a0965 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:47.925277 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7572-b403-4b81-9814-c6e6203a0965 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:47.925483 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3dca9-6a6b-41f5-b8b6-ea0fab7e66bf None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:47.925569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7572-b403-4b81-9814-c6e6203a0965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:47.929612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 38/75] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:47 2022] GET /identity/v3/users/eca02941be074229a99a5024c4561e96 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:47.929612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3dca9-6a6b-41f5-b8b6-ea0fab7e66bf None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:47.946162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-13ed7572-b403-4b81-9814-c6e6203a0965 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:47.947368 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-13ed7572-b403-4b81-9814-c6e6203a0965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:48.017219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 38/76] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:48.018298 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed7572-b403-4b81-9814-c6e6203a0965 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:48.025578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:48.042440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3dca9-6a6b-41f5-b8b6-ea0fab7e66bf None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:48.061492 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:48.079524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c52a4a-7fca-43e5-bada-5a5974ff9ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:48.080195 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c52a4a-7fca-43e5-bada-5a5974ff9ac7 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:48.085636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c52a4a-7fca-43e5-bada-5a5974ff9ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:48.085636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c52a4a-7fca-43e5-bada-5a5974ff9ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:48.085636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c52a4a-7fca-43e5-bada-5a5974ff9ac7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:48.085636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c52a4a-7fca-43e5-bada-5a5974ff9ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:48.085636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c52a4a-7fca-43e5-bada-5a5974ff9ac7 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:48.091115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 39/77] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:48.091978 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c52a4a-7fca-43e5-bada-5a5974ff9ac7 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:48.118483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed7572-b403-4b81-9814-c6e6203a0965 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:48.154257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81b15a-0b8f-43bb-a8aa-99c3ae45c75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:48.154929 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81b15a-0b8f-43bb-a8aa-99c3ae45c75b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:48.155213 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81b15a-0b8f-43bb-a8aa-99c3ae45c75b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:48.155513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81b15a-0b8f-43bb-a8aa-99c3ae45c75b None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:48.156260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81b15a-0b8f-43bb-a8aa-99c3ae45c75b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:48.156568 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81b15a-0b8f-43bb-a8aa-99c3ae45c75b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:48.158013 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81b15a-0b8f-43bb-a8aa-99c3ae45c75b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:48.165834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 39/78] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:34:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:48.166618 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81b15a-0b8f-43bb-a8aa-99c3ae45c75b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:48.192478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c52a4a-7fca-43e5-bada-5a5974ff9ac7 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:48.228896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835256a9-e66a-493e-bcf6-35e4c7f7357f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:48.229550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835256a9-e66a-493e-bcf6-35e4c7f7357f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:48.229836 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835256a9-e66a-493e-bcf6-35e4c7f7357f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:48.230117 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835256a9-e66a-493e-bcf6-35e4c7f7357f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:48.248802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:48.272843 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81b15a-0b8f-43bb-a8aa-99c3ae45c75b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:48.274470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:48.299326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835256a9-e66a-493e-bcf6-35e4c7f7357f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:48.302521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835256a9-e66a-493e-bcf6-35e4c7f7357f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:48.307357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e267d1e-ce45-4796-8836-a7474e65514c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:48.308189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e267d1e-ce45-4796-8836-a7474e65514c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:48.308478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e267d1e-ce45-4796-8836-a7474e65514c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:48.308820 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e267d1e-ce45-4796-8836-a7474e65514c None admin] PATH_INFO: `/v3/roles/member` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:48.319704 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e267d1e-ce45-4796-8836-a7474e65514c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-9e267d1e-ce45-4796-8836-a7474e65514c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:48.328145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:48.329031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:48.329771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:48.329771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:48.329771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:48.329771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:48.329771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:48.329771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:48.329771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:48.329771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:48.329771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:48.329771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:48.329771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:34:48.329771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:34:48.329771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 40/79] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:48.332554 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e267d1e-ce45-4796-8836-a7474e65514c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:48.407640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 40/80] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:48.408625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835256a9-e66a-493e-bcf6-35e4c7f7357f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:48.446673 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e267d1e-ce45-4796-8836-a7474e65514c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:48.460560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:48.483405 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e81d40-b565-4362-ba92-fb9c1eaeb665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:48.484396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e81d40-b565-4362-ba92-fb9c1eaeb665 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:48.484829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e81d40-b565-4362-ba92-fb9c1eaeb665 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:48.485112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e81d40-b565-4362-ba92-fb9c1eaeb665 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:48.486357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e81d40-b565-4362-ba92-fb9c1eaeb665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:48.487887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e81d40-b565-4362-ba92-fb9c1eaeb665 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:48.489590 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 41/81] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:34:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:48.491674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e81d40-b565-4362-ba92-fb9c1eaeb665 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:48.520928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835256a9-e66a-493e-bcf6-35e4c7f7357f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:48.523015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:48.554595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cea8d-5429-48b9-b5eb-249655f4071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:48.555483 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cea8d-5429-48b9-b5eb-249655f4071c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:48.555777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cea8d-5429-48b9-b5eb-249655f4071c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:48.556050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cea8d-5429-48b9-b5eb-249655f4071c None admin] PATH_INFO: `/v3/users/c62a7303ac7c4c3a91bb0f96d54dfd52` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:48.557233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12cea8d-5429-48b9-b5eb-249655f4071c None admin] RBAC: Authorizing `identity:get_user(user_id=c62a7303ac7c4c3a91bb0f96d54dfd52)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:48.558723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12cea8d-5429-48b9-b5eb-249655f4071c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:48.560872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 41/82] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:48 2022] GET /identity/v3/users/c62a7303ac7c4c3a91bb0f96d54dfd52 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:48.564255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cea8d-5429-48b9-b5eb-249655f4071c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:48.595392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e81d40-b565-4362-ba92-fb9c1eaeb665 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:48.629167 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b656fb3-1dca-4ebc-b677-b874884b6871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:48.630040 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b656fb3-1dca-4ebc-b677-b874884b6871 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:48.630333 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b656fb3-1dca-4ebc-b677-b874884b6871 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:48.630604 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b656fb3-1dca-4ebc-b677-b874884b6871 None admin] PATH_INFO: `/v3/users/eca02941be074229a99a5024c4561e96` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:48.631847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b656fb3-1dca-4ebc-b677-b874884b6871 None admin] RBAC: Authorizing `identity:get_user(user_id=eca02941be074229a99a5024c4561e96)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:48.633321 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b656fb3-1dca-4ebc-b677-b874884b6871 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:48.634952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 42/83] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:48 2022] GET /identity/v3/users/eca02941be074229a99a5024c4561e96 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:48.636296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b656fb3-1dca-4ebc-b677-b874884b6871 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:48.664244 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cea8d-5429-48b9-b5eb-249655f4071c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:48.680718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:48.697414 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513de5c5-1420-4c54-b351-9a0c259be7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:48.698079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513de5c5-1420-4c54-b351-9a0c259be7cf None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:48.698523 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513de5c5-1420-4c54-b351-9a0c259be7cf None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:48.698636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513de5c5-1420-4c54-b351-9a0c259be7cf None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:48.699367 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513de5c5-1420-4c54-b351-9a0c259be7cf None admin] RBAC: Adding query filter params (name=member) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:48.699707 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513de5c5-1420-4c54-b351-9a0c259be7cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:48.701689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513de5c5-1420-4c54-b351-9a0c259be7cf None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:48.710113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 42/84] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:34:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:48.712695 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513de5c5-1420-4c54-b351-9a0c259be7cf None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:48.732227 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:48.736538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b656fb3-1dca-4ebc-b677-b874884b6871 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:48.770604 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77ca0-1182-4de8-9430-a46206b816bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:48.771485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77ca0-1182-4de8-9430-a46206b816bc None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:48.771769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77ca0-1182-4de8-9430-a46206b816bc None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:48.772050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77ca0-1182-4de8-9430-a46206b816bc None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:48.773229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a77ca0-1182-4de8-9430-a46206b816bc None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:48.774684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a77ca0-1182-4de8-9430-a46206b816bc None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:48.776410 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 43/85] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:48 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:48.777149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77ca0-1182-4de8-9430-a46206b816bc None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:48.813582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513de5c5-1420-4c54-b351-9a0c259be7cf None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:48.848456 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbbc92-ed8f-4e14-9feb-79011a50606b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:48.849327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbbc92-ed8f-4e14-9feb-79011a50606b None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:48.849606 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbbc92-ed8f-4e14-9feb-79011a50606b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:48.850082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbbc92-ed8f-4e14-9feb-79011a50606b None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:48.850609 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbbc92-ed8f-4e14-9feb-79011a50606b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:48.852092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbbc92-ed8f-4e14-9feb-79011a50606b None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:48.878248 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77ca0-1182-4de8-9430-a46206b816bc None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:48.912243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c2b9-49d9-49e2-809b-5418e247d6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:48.912891 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c2b9-49d9-49e2-809b-5418e247d6bb None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:48.913182 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c2b9-49d9-49e2-809b-5418e247d6bb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:48.913467 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c2b9-49d9-49e2-809b-5418e247d6bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:48.946155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:48.979013 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 43/86] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:34:48 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:34:48.979422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77c2b9-49d9-49e2-809b-5418e247d6bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:48.979699 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbbc92-ed8f-4e14-9feb-79011a50606b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:48.980945 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77c2b9-49d9-49e2-809b-5418e247d6bb None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:49.032836 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:49.093504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 44/87] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:49.099346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c2b9-49d9-49e2-809b-5418e247d6bb None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:49.110152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbbc92-ed8f-4e14-9feb-79011a50606b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:49.152364 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011bb85-ce1b-4405-9132-534bc0125e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:49.153041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011bb85-ce1b-4405-9132-534bc0125e70 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:49.153331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011bb85-ce1b-4405-9132-534bc0125e70 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:49.153611 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011bb85-ce1b-4405-9132-534bc0125e70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:49.174012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:49.217819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c2b9-49d9-49e2-809b-5418e247d6bb None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:49.240572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011bb85-ce1b-4405-9132-534bc0125e70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:49.242224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011bb85-ce1b-4405-9132-534bc0125e70 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:49.258554 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0734063-86e6-47f1-b2bc-e087a9130fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:49.258778 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0734063-86e6-47f1-b2bc-e087a9130fef None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:49.258925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0734063-86e6-47f1-b2bc-e087a9130fef None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:49.259208 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0734063-86e6-47f1-b2bc-e087a9130fef None admin] PATH_INFO: `/v3/users/eca02941be074229a99a5024c4561e96` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:49.260481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0734063-86e6-47f1-b2bc-e087a9130fef None admin] RBAC: Authorizing `identity:get_user(user_id=eca02941be074229a99a5024c4561e96)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:49.261968 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0734063-86e6-47f1-b2bc-e087a9130fef None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:49.265023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 45/88] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:49 2022] GET /identity/v3/users/eca02941be074229a99a5024c4561e96 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:49.265901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0734063-86e6-47f1-b2bc-e087a9130fef None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:49.294833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:49.378931 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 44/89] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:49.379843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011bb85-ce1b-4405-9132-534bc0125e70 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:49.431288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0734063-86e6-47f1-b2bc-e087a9130fef None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:49.469080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d19cd9-1ac5-44b4-84f0-5be434cfd2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:49.469916 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d19cd9-1ac5-44b4-84f0-5be434cfd2d9 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:49.470824 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d19cd9-1ac5-44b4-84f0-5be434cfd2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:49.471112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d19cd9-1ac5-44b4-84f0-5be434cfd2d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:49.472300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d19cd9-1ac5-44b4-84f0-5be434cfd2d9 None admin] RBAC: Adding query filter params (role.id=9507ef97f4954ddc90305c9d0f1d3608, scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f, user.id=eca02941be074229a99a5024c4561e96) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:49.472621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d19cd9-1ac5-44b4-84f0-5be434cfd2d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:49.475434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d19cd9-1ac5-44b4-84f0-5be434cfd2d9 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:49.477821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:49.485479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 46/90] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:34:49 2022] GET /identity/v3/role_assignments?user.id=eca02941be074229a99a5024c4561e96&scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f&role.id=9507ef97f4954ddc90305c9d0f1d3608 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:49.489059 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d19cd9-1ac5-44b4-84f0-5be434cfd2d9 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:49.565864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011bb85-ce1b-4405-9132-534bc0125e70 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:49.666249 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27e068-015c-46a6-9224-c4af13e1723e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:49.667209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27e068-015c-46a6-9224-c4af13e1723e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:49.667528 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27e068-015c-46a6-9224-c4af13e1723e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:49.667815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27e068-015c-46a6-9224-c4af13e1723e None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:49.670262 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27e068-015c-46a6-9224-c4af13e1723e None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:49.671822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27e068-015c-46a6-9224-c4af13e1723e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:49.673659 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 45/91] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:49 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:49.674484 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27e068-015c-46a6-9224-c4af13e1723e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:49.677194 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d19cd9-1ac5-44b4-84f0-5be434cfd2d9 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:49.689751 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:49.754937 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5afcd5-73b6-44f6-b898-6a410e3df8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:49.755554 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5afcd5-73b6-44f6-b898-6a410e3df8d2 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:49.755970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5afcd5-73b6-44f6-b898-6a410e3df8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:49.756258 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5afcd5-73b6-44f6-b898-6a410e3df8d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:49.828375 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27e068-015c-46a6-9224-c4af13e1723e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:49.878939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a94704-635b-40a7-ac3c-410bf9a04655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:49.879851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a94704-635b-40a7-ac3c-410bf9a04655 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:49.880140 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a94704-635b-40a7-ac3c-410bf9a04655 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:49.880423 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a94704-635b-40a7-ac3c-410bf9a04655 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:49.881803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a94704-635b-40a7-ac3c-410bf9a04655 None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:49.884691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a94704-635b-40a7-ac3c-410bf9a04655 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:49.886670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 46/92] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:49 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:49.887294 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a94704-635b-40a7-ac3c-410bf9a04655 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:49.898758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:49.904740 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5afcd5-73b6-44f6-b898-6a410e3df8d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:49.906260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5afcd5-73b6-44f6-b898-6a410e3df8d2 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:50.050542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:50.072238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 47/93] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:34:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:50.072935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5afcd5-73b6-44f6-b898-6a410e3df8d2 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:50.118616 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a94704-635b-40a7-ac3c-410bf9a04655 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:50.201111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:50.205744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5afcd5-73b6-44f6-b898-6a410e3df8d2 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:50.220821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51668609-694d-4538-9d2a-e5f827a95fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:50.221842 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51668609-694d-4538-9d2a-e5f827a95fb4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:50.222355 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51668609-694d-4538-9d2a-e5f827a95fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:50.222832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51668609-694d-4538-9d2a-e5f827a95fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:50.223917 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51668609-694d-4538-9d2a-e5f827a95fb4 None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f, user.id=c62a7303ac7c4c3a91bb0f96d54dfd52) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:50.224433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51668609-694d-4538-9d2a-e5f827a95fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:50.226092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51668609-694d-4538-9d2a-e5f827a95fb4 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:50.243070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 47/94] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:34:49 2022] GET /identity/v3/role_assignments?user.id=c62a7303ac7c4c3a91bb0f96d54dfd52&scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f&role.id=c5632345c9274d348669482f1f7414c8 => generated 259 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:50.243791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51668609-694d-4538-9d2a-e5f827a95fb4 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:50.257370 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb66a63-17a5-4a3f-bb2d-de9954c48256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:50.258287 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb66a63-17a5-4a3f-bb2d-de9954c48256 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:50.258795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb66a63-17a5-4a3f-bb2d-de9954c48256 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:50.259269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb66a63-17a5-4a3f-bb2d-de9954c48256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:50.260337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb66a63-17a5-4a3f-bb2d-de9954c48256 None admin] RBAC: Adding query filter params (role.id=e97885113c774466b7432083b511fa58, scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f, user.id=eca02941be074229a99a5024c4561e96) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:50.260877 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb66a63-17a5-4a3f-bb2d-de9954c48256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:50.262558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb66a63-17a5-4a3f-bb2d-de9954c48256 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:50.293697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 48/95] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:34:50 2022] GET /identity/v3/role_assignments?user.id=eca02941be074229a99a5024c4561e96&scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f&role.id=e97885113c774466b7432083b511fa58 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:50.423008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51668609-694d-4538-9d2a-e5f827a95fb4 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:50.469443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caeb4d-8697-424b-8183-ccf96d08431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:50.470371 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caeb4d-8697-424b-8183-ccf96d08431a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:50.470655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caeb4d-8697-424b-8183-ccf96d08431a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:50.470930 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caeb4d-8697-424b-8183-ccf96d08431a None admin] PATH_INFO: `/v3/projects/a73eb00ea9a94c9bb4e18ceea51ef2e5` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:50.476525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caeb4d-8697-424b-8183-ccf96d08431a None admin] RBAC: Authorizing `identity:get_project(project_id=a73eb00ea9a94c9bb4e18ceea51ef2e5)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:50.478190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caeb4d-8697-424b-8183-ccf96d08431a None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:50.480303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 48/96] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:50 2022] GET /identity/v3/projects/a73eb00ea9a94c9bb4e18ceea51ef2e5 => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:50.486417 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb66a63-17a5-4a3f-bb2d-de9954c48256 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:50.650382 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb66a63-17a5-4a3f-bb2d-de9954c48256 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:50.699951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ccc33-62f1-4ea1-bf4e-a155d0539104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:50.700630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ccc33-62f1-4ea1-bf4e-a155d0539104 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:50.700921 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ccc33-62f1-4ea1-bf4e-a155d0539104 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:50.701795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ccc33-62f1-4ea1-bf4e-a155d0539104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:50.702651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ccc33-62f1-4ea1-bf4e-a155d0539104 None admin] RBAC: Adding query filter params (role.id=9507ef97f4954ddc90305c9d0f1d3608, scope.project.id=a73eb00ea9a94c9bb4e18ceea51ef2e5, user.id=eca02941be074229a99a5024c4561e96) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:50.702969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ccc33-62f1-4ea1-bf4e-a155d0539104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:50.704471 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ccc33-62f1-4ea1-bf4e-a155d0539104 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:50.716146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 49/97] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:34:50 2022] GET /identity/v3/role_assignments?user.id=eca02941be074229a99a5024c4561e96&scope.project.id=a73eb00ea9a94c9bb4e18ceea51ef2e5&role.id=9507ef97f4954ddc90305c9d0f1d3608 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:52.082532 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70361ce-b72e-44cb-8a37-d1784684ba43 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:52.083086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70361ce-b72e-44cb-8a37-d1784684ba43 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:52.083086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70361ce-b72e-44cb-8a37-d1784684ba43 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:52.085005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 49/98] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:52.090790 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82fde9-4ffb-4d8e-bfd1-0bf0ab32f96d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:52.091309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82fde9-4ffb-4d8e-bfd1-0bf0ab32f96d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:52.091389 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82fde9-4ffb-4d8e-bfd1-0bf0ab32f96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:52.112535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ed82fde9-4ffb-4d8e-bfd1-0bf0ab32f96d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:52.113778 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ed82fde9-4ffb-4d8e-bfd1-0bf0ab32f96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:52.152222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:52.215093 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 50/99] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:52.216037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28157c41-f8da-43c7-9b20-666952b48ed6 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:52.216605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28157c41-f8da-43c7-9b20-666952b48ed6 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:52.217108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28157c41-f8da-43c7-9b20-666952b48ed6 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:52.218697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 50/100] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:52.224532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99bcfb-5f4d-4ac4-b010-d37a0fe57a0c None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:52.225296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99bcfb-5f4d-4ac4-b010-d37a0fe57a0c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:52.225779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99bcfb-5f4d-4ac4-b010-d37a0fe57a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:52.243393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ec99bcfb-5f4d-4ac4-b010-d37a0fe57a0c None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:52.245198 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ec99bcfb-5f4d-4ac4-b010-d37a0fe57a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:52.257006 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28157c41-f8da-43c7-9b20-666952b48ed6 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:52.260764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:52.393978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 51/101] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:52.437618 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99bcfb-5f4d-4ac4-b010-d37a0fe57a0c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:52.489127 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28157c41-f8da-43c7-9b20-666952b48ed6 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:52.573349 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856d5e5-6fa6-475a-9f97-71511c9d5e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:52.574572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856d5e5-6fa6-475a-9f97-71511c9d5e3b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:52.575075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856d5e5-6fa6-475a-9f97-71511c9d5e3b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:52.575582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856d5e5-6fa6-475a-9f97-71511c9d5e3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:52.608475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856d5e5-6fa6-475a-9f97-71511c9d5e3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-d856d5e5-6fa6-475a-9f97-71511c9d5e3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:52.616778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:52.617634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:52.618396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:52.618396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:52.618396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:52.618396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:52.618396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:52.618396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:52.618396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:52.618396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:52.618396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:52.618396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:52.618396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:34:52.618396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:34:52.621818 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:52.625614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 51/102] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:34:52.631485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856d5e5-6fa6-475a-9f97-71511c9d5e3b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:52.657270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99bcfb-5f4d-4ac4-b010-d37a0fe57a0c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:52.723040 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729eb2b-0bed-4442-949b-a65b6853370c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:52.724055 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729eb2b-0bed-4442-949b-a65b6853370c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:52.724502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729eb2b-0bed-4442-949b-a65b6853370c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:52.724953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729eb2b-0bed-4442-949b-a65b6853370c None admin] PATH_INFO: `/v3/domains/default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:52.729495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729eb2b-0bed-4442-949b-a65b6853370c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:52.731203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729eb2b-0bed-4442-949b-a65b6853370c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:52.733867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 52/103] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:34:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:52.735198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:52.745681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729eb2b-0bed-4442-949b-a65b6853370c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:52.812752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856d5e5-6fa6-475a-9f97-71511c9d5e3b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:52.879731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729eb2b-0bed-4442-949b-a65b6853370c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:52.920738 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64392421-7f0b-4139-a77d-6cac3c1571be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:52.921697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64392421-7f0b-4139-a77d-6cac3c1571be None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:52.922126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64392421-7f0b-4139-a77d-6cac3c1571be None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:52.922566 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64392421-7f0b-4139-a77d-6cac3c1571be None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:52.923609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64392421-7f0b-4139-a77d-6cac3c1571be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:52.925439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64392421-7f0b-4139-a77d-6cac3c1571be None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:52.926863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256eb2e-1ded-4dba-9797-7f5bb63b7075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:52.927676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256eb2e-1ded-4dba-9797-7f5bb63b7075 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:52.928061 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256eb2e-1ded-4dba-9797-7f5bb63b7075 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:52.928440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256eb2e-1ded-4dba-9797-7f5bb63b7075 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:52.929303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256eb2e-1ded-4dba-9797-7f5bb63b7075 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:52.929711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256eb2e-1ded-4dba-9797-7f5bb63b7075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:52.931222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256eb2e-1ded-4dba-9797-7f5bb63b7075 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:52.958760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 52/104] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:34:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:52.959928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256eb2e-1ded-4dba-9797-7f5bb63b7075 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:53.020328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 53/105] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 2 13:34:52 2022] POST /identity/v3/projects => generated 302 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:34:53.089990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256eb2e-1ded-4dba-9797-7f5bb63b7075 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:53.121954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:53.131808 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d1eac-4c12-4082-a1ee-271c2da9afaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:53.132709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1eac-4c12-4082-a1ee-271c2da9afaf None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:53.132995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1eac-4c12-4082-a1ee-271c2da9afaf None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:53.133270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1eac-4c12-4082-a1ee-271c2da9afaf None admin] PATH_INFO: `/v3/users/e9418bdf7ab44222b9a4b8d4fd6daac0` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:53.148727 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d1eac-4c12-4082-a1ee-271c2da9afaf None admin] RBAC: Authorizing `identity:get_user(user_id=e9418bdf7ab44222b9a4b8d4fd6daac0)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:53.150412 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d1eac-4c12-4082-a1ee-271c2da9afaf None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:53.152186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 53/106] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:52 2022] GET /identity/v3/users/e9418bdf7ab44222b9a4b8d4fd6daac0 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:53.158040 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64392421-7f0b-4139-a77d-6cac3c1571be None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:53.173803 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:53.296278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64392421-7f0b-4139-a77d-6cac3c1571be None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:53.301892 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c8b5-6763-4c74-b1b8-9b94c05c8abc None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:53.302486 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c8b5-6763-4c74-b1b8-9b94c05c8abc None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:53.302966 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c8b5-6763-4c74-b1b8-9b94c05c8abc None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:53.304952 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 54/107] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:53.334602 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae4540-2e78-4efa-a4f4-85755ea92205 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:53.335401 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae4540-2e78-4efa-a4f4-85755ea92205 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:53.336035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae4540-2e78-4efa-a4f4-85755ea92205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:53.351069 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62f558-1846-4b1d-a060-831f85c594c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:53.351792 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62f558-1846-4b1d-a060-831f85c594c9 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:53.352084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62f558-1846-4b1d-a060-831f85c594c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:53.352365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62f558-1846-4b1d-a060-831f85c594c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:53.365534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-66ae4540-2e78-4efa-a4f4-85755ea92205 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:53.367067 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-66ae4540-2e78-4efa-a4f4-85755ea92205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:53.486379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62f558-1846-4b1d-a060-831f85c594c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:53.489574 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62f558-1846-4b1d-a060-831f85c594c9 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:53.503129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:53.514873 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 55/108] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:53.516040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313ad88-8b80-4279-8910-30809d20c11c None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:53.516330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313ad88-8b80-4279-8910-30809d20c11c None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:53.516605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313ad88-8b80-4279-8910-30809d20c11c None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:53.518511 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 56/109] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:53.527087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0844e-9955-4a5f-b3af-3d2e42a93870 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:53.527555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0844e-9955-4a5f-b3af-3d2e42a93870 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:53.527911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0844e-9955-4a5f-b3af-3d2e42a93870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:53.559911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-6de0844e-9955-4a5f-b3af-3d2e42a93870 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:53.561193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6de0844e-9955-4a5f-b3af-3d2e42a93870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:53.623871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 54/110] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:34:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:53.625073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62f558-1846-4b1d-a060-831f85c594c9 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:53.730502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 57/111] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:34:53.731164 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0844e-9955-4a5f-b3af-3d2e42a93870 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:53.760781 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62f558-1846-4b1d-a060-831f85c594c9 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:53.770136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:53.806220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f8f3b-273d-4d02-9967-b07a192dc7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:53.807427 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f8f3b-273d-4d02-9967-b07a192dc7b7 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:53.811372 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f8f3b-273d-4d02-9967-b07a192dc7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:53.811372 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f8f3b-273d-4d02-9967-b07a192dc7b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:53.832053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f8f3b-273d-4d02-9967-b07a192dc7b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:53.836156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-db8f8f3b-273d-4d02-9967-b07a192dc7b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:53.840064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:53.840940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:53.842249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:53.842249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:53.842249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:53.842249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:53.842249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:53.842249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:53.842249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:53.842249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:53.842249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:53.842249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:53.842249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:34:53.842249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:34:53.842249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 55/112] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:53.842869 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f8f3b-273d-4d02-9967-b07a192dc7b7 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:53.902768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0844e-9955-4a5f-b3af-3d2e42a93870 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:53.972869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55759540-2593-4cd4-8279-b423a7ee5d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:53.974211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55759540-2593-4cd4-8279-b423a7ee5d0d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:53.974802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55759540-2593-4cd4-8279-b423a7ee5d0d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:53.975606 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55759540-2593-4cd4-8279-b423a7ee5d0d None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:53.977315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55759540-2593-4cd4-8279-b423a7ee5d0d None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:53.979146 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55759540-2593-4cd4-8279-b423a7ee5d0d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:53.981898 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 58/113] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:53 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:53.983302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55759540-2593-4cd4-8279-b423a7ee5d0d None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:54.017848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f8f3b-273d-4d02-9967-b07a192dc7b7 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:54.056324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e7594-ca00-4fa1-a6d7-88348c24f800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:54.057155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e7594-ca00-4fa1-a6d7-88348c24f800 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:54.057433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e7594-ca00-4fa1-a6d7-88348c24f800 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:54.057718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e7594-ca00-4fa1-a6d7-88348c24f800 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:54.069453 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e7594-ca00-4fa1-a6d7-88348c24f800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-a59e7594-ca00-4fa1-a6d7-88348c24f800 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:54.078787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:54.079669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:54.080445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:54.080445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:54.080445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:54.080445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:54.080445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:54.080445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:54.080445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:54.080445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:54.080445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:54.080445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:54.080445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:34:54.080445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:34:54.080445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 56/114] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:34:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:54.081633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e9d3f-f0eb-442f-9f17-150e5d433d2c None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:54.081975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e9d3f-f0eb-442f-9f17-150e5d433d2c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:54.082257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e9d3f-f0eb-442f-9f17-150e5d433d2c None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:54.083870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 57/115] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:54.084443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e9d3f-f0eb-442f-9f17-150e5d433d2c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:54.111809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55759540-2593-4cd4-8279-b423a7ee5d0d None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:54.119212 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:54.130064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:54.152117 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38ce81-f81b-4647-96b0-efacbc1722a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:54.152791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38ce81-f81b-4647-96b0-efacbc1722a9 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:54.153080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38ce81-f81b-4647-96b0-efacbc1722a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:54.153362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38ce81-f81b-4647-96b0-efacbc1722a9 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:54.154197 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38ce81-f81b-4647-96b0-efacbc1722a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:54.154472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38ce81-f81b-4647-96b0-efacbc1722a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:54.155884 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38ce81-f81b-4647-96b0-efacbc1722a9 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:54.167587 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 59/116] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:34:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:54.167587 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38ce81-f81b-4647-96b0-efacbc1722a9 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:54.203024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e9d3f-f0eb-442f-9f17-150e5d433d2c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:54.238936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8cc34-5265-49e7-aec7-1b658fa71614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:54.239633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8cc34-5265-49e7-aec7-1b658fa71614 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:54.239918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8cc34-5265-49e7-aec7-1b658fa71614 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:54.240203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8cc34-5265-49e7-aec7-1b658fa71614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:54.241046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8cc34-5265-49e7-aec7-1b658fa71614 None admin] RBAC: Adding query filter params (role.id=7f99c4626bbf4a6e8f81e07dc118b598, scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f, user.id=e9418bdf7ab44222b9a4b8d4fd6daac0) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:54.241361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8cc34-5265-49e7-aec7-1b658fa71614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:54.242816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8cc34-5265-49e7-aec7-1b658fa71614 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:54.249380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 58/117] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:34:54 2022] GET /identity/v3/role_assignments?user.id=e9418bdf7ab44222b9a4b8d4fd6daac0&scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f&role.id=7f99c4626bbf4a6e8f81e07dc118b598 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:54.250648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33578f71-114c-4102-ad71-d9239917449c None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:54.250943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33578f71-114c-4102-ad71-d9239917449c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:54.251226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33578f71-114c-4102-ad71-d9239917449c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:54.269704 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-33578f71-114c-4102-ad71-d9239917449c None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:54.270868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-33578f71-114c-4102-ad71-d9239917449c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:54.302824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38ce81-f81b-4647-96b0-efacbc1722a9 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:54.356721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131d2e6-c69d-4be8-93be-91144ef62219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:54.357555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d2e6-c69d-4be8-93be-91144ef62219 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:54.357920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d2e6-c69d-4be8-93be-91144ef62219 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:54.358270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d2e6-c69d-4be8-93be-91144ef62219 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:54.359121 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131d2e6-c69d-4be8-93be-91144ef62219 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:54.359485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 59/118] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:54.367628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131d2e6-c69d-4be8-93be-91144ef62219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:54.367628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131d2e6-c69d-4be8-93be-91144ef62219 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:54.369927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7aa453-0435-4a58-a9ca-d04072006ae3 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:54.370398 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7aa453-0435-4a58-a9ca-d04072006ae3 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:54.370917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7aa453-0435-4a58-a9ca-d04072006ae3 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:54.371560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 60/119] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:34:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:54.372490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131d2e6-c69d-4be8-93be-91144ef62219 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:54.373413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 60/120] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:54.378871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7aa453-0435-4a58-a9ca-d04072006ae3 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:54.414732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:54.427622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:54.517853 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131d2e6-c69d-4be8-93be-91144ef62219 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:54.523113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7aa453-0435-4a58-a9ca-d04072006ae3 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:54.557669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c9a9e-4310-4253-b84d-2d43dfc92c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:54.558854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c9a9e-4310-4253-b84d-2d43dfc92c8d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:54.559344 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c9a9e-4310-4253-b84d-2d43dfc92c8d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:54.559848 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c9a9e-4310-4253-b84d-2d43dfc92c8d None admin] PATH_INFO: `/v3/users/eca02941be074229a99a5024c4561e96` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:54.561330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c9a9e-4310-4253-b84d-2d43dfc92c8d None admin] RBAC: Authorizing `identity:get_user(user_id=eca02941be074229a99a5024c4561e96)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:54.563122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c9a9e-4310-4253-b84d-2d43dfc92c8d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:54.565399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 61/121] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:54 2022] GET /identity/v3/users/eca02941be074229a99a5024c4561e96 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:54.566888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49bb7-9224-4e2e-80f0-2e5d00fdb623 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:54.567371 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49bb7-9224-4e2e-80f0-2e5d00fdb623 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:54.567933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49bb7-9224-4e2e-80f0-2e5d00fdb623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:54.571784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb79bc-c3ec-459e-9882-7e77114ad98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:54.572693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb79bc-c3ec-459e-9882-7e77114ad98c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:54.572972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb79bc-c3ec-459e-9882-7e77114ad98c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:54.573245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb79bc-c3ec-459e-9882-7e77114ad98c None admin] PATH_INFO: `/v3/users/eca02941be074229a99a5024c4561e96` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:54.574713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb79bc-c3ec-459e-9882-7e77114ad98c None admin] RBAC: Authorizing `identity:get_user(user_id=eca02941be074229a99a5024c4561e96)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:54.577127 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb79bc-c3ec-459e-9882-7e77114ad98c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:54.578932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 61/122] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:54 2022] GET /identity/v3/users/eca02941be074229a99a5024c4561e96 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:54.579576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb79bc-c3ec-459e-9882-7e77114ad98c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:54.601040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-abf49bb7-9224-4e2e-80f0-2e5d00fdb623 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:54.602557 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-abf49bb7-9224-4e2e-80f0-2e5d00fdb623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:54.678547 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:54.680704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 62/123] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:54.681798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf49bb7-9224-4e2e-80f0-2e5d00fdb623 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:54.697303 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb79bc-c3ec-459e-9882-7e77114ad98c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:54.720148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:54.751081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c994397-3f38-4b38-8b97-7534c367774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:54.751824 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c994397-3f38-4b38-8b97-7534c367774a None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:54.752106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c994397-3f38-4b38-8b97-7534c367774a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:54.752378 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c994397-3f38-4b38-8b97-7534c367774a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:54.764648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c994397-3f38-4b38-8b97-7534c367774a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-1c994397-3f38-4b38-8b97-7534c367774a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:54.771664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:54.772539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:54.773357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:54.773357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:54.773357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:54.773357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:54.773357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:54.773357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:54.773357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:54.773357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:54.773357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:54.773357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:54.773357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:54.773357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:34:54.773357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 62/124] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:34:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:54.774002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c994397-3f38-4b38-8b97-7534c367774a None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:54.801276 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf49bb7-9224-4e2e-80f0-2e5d00fdb623 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:54.840188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342feb7-6f97-473a-8084-115d5b3760be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:54.841421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342feb7-6f97-473a-8084-115d5b3760be None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:54.842629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342feb7-6f97-473a-8084-115d5b3760be None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:54.843135 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342feb7-6f97-473a-8084-115d5b3760be None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:54.844830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342feb7-6f97-473a-8084-115d5b3760be None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:54.846728 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342feb7-6f97-473a-8084-115d5b3760be None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:54.848861 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 63/125] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:54 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:54.849911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342feb7-6f97-473a-8084-115d5b3760be None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:54.883477 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c994397-3f38-4b38-8b97-7534c367774a None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:54.918094 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584331a4-78af-4871-b794-66c83b878660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:54.918979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584331a4-78af-4871-b794-66c83b878660 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:54.919260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584331a4-78af-4871-b794-66c83b878660 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:54.919577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584331a4-78af-4871-b794-66c83b878660 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:54.921432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584331a4-78af-4871-b794-66c83b878660 None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:54.922893 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584331a4-78af-4871-b794-66c83b878660 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:54.924803 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 63/126] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:54 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:54.925672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584331a4-78af-4871-b794-66c83b878660 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:54.944271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:54.965332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342feb7-6f97-473a-8084-115d5b3760be None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:54.967879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:55.006025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545a00f-6267-4567-a9de-e2b288b50a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:55.007320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545a00f-6267-4567-a9de-e2b288b50a78 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:55.007840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545a00f-6267-4567-a9de-e2b288b50a78 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:55.008344 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545a00f-6267-4567-a9de-e2b288b50a78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:55.021169 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545a00f-6267-4567-a9de-e2b288b50a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:55.030620 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584331a4-78af-4871-b794-66c83b878660 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-5545a00f-6267-4567-a9de-e2b288b50a78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:55.031089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:55.031973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:55.032732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:55.032732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:55.032732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:55.032732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:55.032732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:55.032732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:55.032732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:55.032732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:55.032732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:55.032732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:55.032732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:34:55.032732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:34:55.035178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 64/127] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:55.036212 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545a00f-6267-4567-a9de-e2b288b50a78 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:55.070400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdff04-685c-4622-a957-cb4d41328cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:55.071071 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdff04-685c-4622-a957-cb4d41328cdb None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:55.071358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdff04-685c-4622-a957-cb4d41328cdb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:55.071665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdff04-685c-4622-a957-cb4d41328cdb None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:55.072418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdff04-685c-4622-a957-cb4d41328cdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:55.072725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdff04-685c-4622-a957-cb4d41328cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:55.074120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdff04-685c-4622-a957-cb4d41328cdb None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:55.083523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 64/128] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:55.084341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdff04-685c-4622-a957-cb4d41328cdb None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:55.151112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545a00f-6267-4567-a9de-e2b288b50a78 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:55.164570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:55.186513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdff04-685c-4622-a957-cb4d41328cdb None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:55.190391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8500b0-5b69-4379-8f30-3146f4cc06f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:55.191564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8500b0-5b69-4379-8f30-3146f4cc06f8 None admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:55.192059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8500b0-5b69-4379-8f30-3146f4cc06f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:55.192536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8500b0-5b69-4379-8f30-3146f4cc06f8 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f/users/eca02941be074229a99a5024c4561e96/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:55.194800 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8500b0-5b69-4379-8f30-3146f4cc06f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f275690aa244b3ea3d67cb4f7e3502f, user_id=eca02941be074229a99a5024c4561e96, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:55.196516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8500b0-5b69-4379-8f30-3146f4cc06f8 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:55.223602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e1cee-c210-4b53-b6ef-1134fc5a5c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:55.224607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e1cee-c210-4b53-b6ef-1134fc5a5c14 None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:55.224892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e1cee-c210-4b53-b6ef-1134fc5a5c14 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:55.225294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e1cee-c210-4b53-b6ef-1134fc5a5c14 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f/users/eca02941be074229a99a5024c4561e96/roles/e97885113c774466b7432083b511fa58` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:55.227675 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e1cee-c210-4b53-b6ef-1134fc5a5c14 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f275690aa244b3ea3d67cb4f7e3502f, user_id=eca02941be074229a99a5024c4561e96, role_id=e97885113c774466b7432083b511fa58)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:55.229151 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e1cee-c210-4b53-b6ef-1134fc5a5c14 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:55.279739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 65/129] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:34:55 2022] PUT /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f/users/eca02941be074229a99a5024c4561e96/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:34:55.281008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8500b0-5b69-4379-8f30-3146f4cc06f8 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:55.305665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 65/130] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:34:55 2022] PUT /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f/users/eca02941be074229a99a5024c4561e96/roles/e97885113c774466b7432083b511fa58 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:34:55.306798 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e1cee-c210-4b53-b6ef-1134fc5a5c14 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:55.346545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:55.462173 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8500b0-5b69-4379-8f30-3146f4cc06f8 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:55.514216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4c641-9166-4c09-b5e8-8f028cad8c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:55.515725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4c641-9166-4c09-b5e8-8f028cad8c10 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:55.516153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4c641-9166-4c09-b5e8-8f028cad8c10 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:55.516586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4c641-9166-4c09-b5e8-8f028cad8c10 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:55.517725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4c641-9166-4c09-b5e8-8f028cad8c10 None admin] RBAC: Adding query filter params (name=member) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:55.518176 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4c641-9166-4c09-b5e8-8f028cad8c10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:55.519831 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4c641-9166-4c09-b5e8-8f028cad8c10 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:55.535927 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 66/131] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:34:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:55.538863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4c641-9166-4c09-b5e8-8f028cad8c10 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:55.548731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e1cee-c210-4b53-b6ef-1134fc5a5c14 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:55.588624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0168dc-20f2-4604-bd54-65f0ee09386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:55.589573 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0168dc-20f2-4604-bd54-65f0ee09386e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:55.589860 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0168dc-20f2-4604-bd54-65f0ee09386e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:55.590139 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0168dc-20f2-4604-bd54-65f0ee09386e None admin] PATH_INFO: `/v3/users/c62a7303ac7c4c3a91bb0f96d54dfd52` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:55.592771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0168dc-20f2-4604-bd54-65f0ee09386e None admin] RBAC: Authorizing `identity:get_user(user_id=c62a7303ac7c4c3a91bb0f96d54dfd52)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:55.594309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0168dc-20f2-4604-bd54-65f0ee09386e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:55.597134 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 66/132] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:55 2022] GET /identity/v3/users/c62a7303ac7c4c3a91bb0f96d54dfd52 => generated 247 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:55.602913 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0168dc-20f2-4604-bd54-65f0ee09386e None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:55.614097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:55.642035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:55.662015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4c641-9166-4c09-b5e8-8f028cad8c10 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:55.705709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ab470-e4c1-468b-a0ef-7be36c7d5170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:55.707039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ab470-e4c1-468b-a0ef-7be36c7d5170 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:55.707546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ab470-e4c1-468b-a0ef-7be36c7d5170 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:55.708035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ab470-e4c1-468b-a0ef-7be36c7d5170 None admin] PATH_INFO: `/v3/users/eca02941be074229a99a5024c4561e96` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:55.709810 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ab470-e4c1-468b-a0ef-7be36c7d5170 None admin] RBAC: Authorizing `identity:get_user(user_id=eca02941be074229a99a5024c4561e96)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:55.712899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ab470-e4c1-468b-a0ef-7be36c7d5170 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:55.716042 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 67/133] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:55 2022] GET /identity/v3/users/eca02941be074229a99a5024c4561e96 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:55.722103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ab470-e4c1-468b-a0ef-7be36c7d5170 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:55.737213 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0168dc-20f2-4604-bd54-65f0ee09386e None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:55.779197 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1979ab9-3613-4d1f-a0ce-0f6e422a15f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:55.780616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1979ab9-3613-4d1f-a0ce-0f6e422a15f8 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:55.780902 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1979ab9-3613-4d1f-a0ce-0f6e422a15f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:55.781624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1979ab9-3613-4d1f-a0ce-0f6e422a15f8 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:55.783027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1979ab9-3613-4d1f-a0ce-0f6e422a15f8 None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:55.784678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1979ab9-3613-4d1f-a0ce-0f6e422a15f8 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:55.787049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 67/134] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:55 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:55.792743 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1979ab9-3613-4d1f-a0ce-0f6e422a15f8 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:55.912720 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:55.957051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1979ab9-3613-4d1f-a0ce-0f6e422a15f8 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:56.005325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ab470-e4c1-468b-a0ef-7be36c7d5170 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:56.025829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae2c4c-5ace-4dec-8248-a29891d92b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:56.026786 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae2c4c-5ace-4dec-8248-a29891d92b07 None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:56.027063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae2c4c-5ace-4dec-8248-a29891d92b07 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:56.027408 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae2c4c-5ace-4dec-8248-a29891d92b07 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f/users/c62a7303ac7c4c3a91bb0f96d54dfd52/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:56.044578 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae2c4c-5ace-4dec-8248-a29891d92b07 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f275690aa244b3ea3d67cb4f7e3502f, user_id=c62a7303ac7c4c3a91bb0f96d54dfd52, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:56.046580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae2c4c-5ace-4dec-8248-a29891d92b07 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:56.070576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae4cc7-02e4-4958-aa5e-00e57750e144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:56.071470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae4cc7-02e4-4958-aa5e-00e57750e144 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:56.071780 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae4cc7-02e4-4958-aa5e-00e57750e144 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:56.075029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae4cc7-02e4-4958-aa5e-00e57750e144 None admin] PATH_INFO: `/v3/projects/a73eb00ea9a94c9bb4e18ceea51ef2e5` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:56.075029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae4cc7-02e4-4958-aa5e-00e57750e144 None admin] RBAC: Authorizing `identity:get_project(project_id=a73eb00ea9a94c9bb4e18ceea51ef2e5)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:56.075029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae4cc7-02e4-4958-aa5e-00e57750e144 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:56.076712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 68/135] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:55 2022] GET /identity/v3/projects/a73eb00ea9a94c9bb4e18ceea51ef2e5 => generated 312 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:56.077894 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16e5aa-c14e-4ac8-b66c-174b4b9f32d7 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:56.078186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16e5aa-c14e-4ac8-b66c-174b4b9f32d7 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:56.078466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16e5aa-c14e-4ac8-b66c-174b4b9f32d7 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:56.080912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 69/136] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:56.084874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16e5aa-c14e-4ac8-b66c-174b4b9f32d7 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:56.139847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:56.145394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 68/137] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:34:55 2022] PUT /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f/users/c62a7303ac7c4c3a91bb0f96d54dfd52/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:34:56.146847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bd13f-590a-4ada-b2b3-06a12fdbc86f None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:56.147137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bd13f-590a-4ada-b2b3-06a12fdbc86f None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:56.147420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bd13f-590a-4ada-b2b3-06a12fdbc86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:56.177712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-977bd13f-590a-4ada-b2b3-06a12fdbc86f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:56.178976 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-977bd13f-590a-4ada-b2b3-06a12fdbc86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:56.259243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16e5aa-c14e-4ac8-b66c-174b4b9f32d7 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:56.324464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 69/138] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:56.331264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34d9dd-2948-4c77-b711-2d7a62df05b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:56.332223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34d9dd-2948-4c77-b711-2d7a62df05b0 None admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:56.332508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34d9dd-2948-4c77-b711-2d7a62df05b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:56.332789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34d9dd-2948-4c77-b711-2d7a62df05b0 None admin] PATH_INFO: `/v3/projects/a73eb00ea9a94c9bb4e18ceea51ef2e5/users/eca02941be074229a99a5024c4561e96/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:56.337135 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34d9dd-2948-4c77-b711-2d7a62df05b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a73eb00ea9a94c9bb4e18ceea51ef2e5, user_id=eca02941be074229a99a5024c4561e96, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:56.338700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34d9dd-2948-4c77-b711-2d7a62df05b0 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:56.364773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bd13f-590a-4ada-b2b3-06a12fdbc86f None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:56.419074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 70/139] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:34:56 2022] PUT /identity/v3/projects/a73eb00ea9a94c9bb4e18ceea51ef2e5/users/eca02941be074229a99a5024c4561e96/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:34:56.463552 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:56.525088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bd13f-590a-4ada-b2b3-06a12fdbc86f None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:56.571246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293a924-8987-40f0-8d59-e813b5a02596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:56.572490 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293a924-8987-40f0-8d59-e813b5a02596 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:56.572963 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293a924-8987-40f0-8d59-e813b5a02596 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:56.573379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293a924-8987-40f0-8d59-e813b5a02596 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:56.575195 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293a924-8987-40f0-8d59-e813b5a02596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:56.576944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293a924-8987-40f0-8d59-e813b5a02596 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:56.578777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 70/140] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:34:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:56.584429 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34d9dd-2948-4c77-b711-2d7a62df05b0 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:56.714741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:56.734409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34d9dd-2948-4c77-b711-2d7a62df05b0 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:56.770710 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68f30c-dda9-4851-b8d6-95d8995db4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:56.771400 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68f30c-dda9-4851-b8d6-95d8995db4d6 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:56.771778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68f30c-dda9-4851-b8d6-95d8995db4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:56.772060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68f30c-dda9-4851-b8d6-95d8995db4d6 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:56.772787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68f30c-dda9-4851-b8d6-95d8995db4d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:56.774361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68f30c-dda9-4851-b8d6-95d8995db4d6 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:56.877463 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 71/141] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:34:56 2022] POST /identity/v3/users => generated 283 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:34:57.093904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7515127-a6b8-4c8c-b4b0-6c3f50c8b2b9 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:57.094224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7515127-a6b8-4c8c-b4b0-6c3f50c8b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:57.094461 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7515127-a6b8-4c8c-b4b0-6c3f50c8b2b9 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:57.096053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 71/142] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:57.102155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25b767-21fe-4933-8005-9ee8f28d25ca None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:57.102592 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25b767-21fe-4933-8005-9ee8f28d25ca None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:57.102976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25b767-21fe-4933-8005-9ee8f28d25ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:57.122420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-4a25b767-21fe-4933-8005-9ee8f28d25ca None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:57.123699 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4a25b767-21fe-4933-8005-9ee8f28d25ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:57.199995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 72/143] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:57.222086 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7515127-a6b8-4c8c-b4b0-6c3f50c8b2b9 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:57.367238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7515127-a6b8-4c8c-b4b0-6c3f50c8b2b9 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:57.409799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:57.425599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57043578-a292-49d5-b9c1-07849e19cc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:57.426418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57043578-a292-49d5-b9c1-07849e19cc0c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:57.426705 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57043578-a292-49d5-b9c1-07849e19cc0c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:57.426983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57043578-a292-49d5-b9c1-07849e19cc0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:57.445919 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57043578-a292-49d5-b9c1-07849e19cc0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-57043578-a292-49d5-b9c1-07849e19cc0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:57.454609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:57.455520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:57.456275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:57.456275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:57.456275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:57.456275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:57.456275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:57.456275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:57.456275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:57.456275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:57.456275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:57.456275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:57.456275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:34:57.456275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:34:57.456275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 72/144] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:57.464630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25b767-21fe-4933-8005-9ee8f28d25ca None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:57.579858 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:57.626390 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25b767-21fe-4933-8005-9ee8f28d25ca None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:57.677332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6399b-246b-40aa-ba2f-aad1be339e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:57.678016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6399b-246b-40aa-ba2f-aad1be339e88 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:57.678301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6399b-246b-40aa-ba2f-aad1be339e88 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:57.678595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6399b-246b-40aa-ba2f-aad1be339e88 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:57.679336 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6399b-246b-40aa-ba2f-aad1be339e88 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:57.679667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6399b-246b-40aa-ba2f-aad1be339e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:57.688069 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6399b-246b-40aa-ba2f-aad1be339e88 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:57.697058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 73/145] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:34:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:57.702789 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57043578-a292-49d5-b9c1-07849e19cc0c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:57.833522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57043578-a292-49d5-b9c1-07849e19cc0c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:57.877105 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c66b56-26d1-4f12-9232-b05bbb81542e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:57.877994 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c66b56-26d1-4f12-9232-b05bbb81542e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:57.878277 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c66b56-26d1-4f12-9232-b05bbb81542e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:57.878551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c66b56-26d1-4f12-9232-b05bbb81542e None admin] PATH_INFO: `/v3/users/e9418bdf7ab44222b9a4b8d4fd6daac0` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:57.879818 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c66b56-26d1-4f12-9232-b05bbb81542e None admin] RBAC: Authorizing `identity:get_user(user_id=e9418bdf7ab44222b9a4b8d4fd6daac0)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:57.881304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c66b56-26d1-4f12-9232-b05bbb81542e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:57.882944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 73/146] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:57 2022] GET /identity/v3/users/e9418bdf7ab44222b9a4b8d4fd6daac0 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:57.889181 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6399b-246b-40aa-ba2f-aad1be339e88 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:58.025249 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6399b-246b-40aa-ba2f-aad1be339e88 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:58.062667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:58.071353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ec51f-d625-4586-9871-3d72dc1a46e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:58.072259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ec51f-d625-4586-9871-3d72dc1a46e7 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:58.072540 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ec51f-d625-4586-9871-3d72dc1a46e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:58.072811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ec51f-d625-4586-9871-3d72dc1a46e7 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:58.074017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ec51f-d625-4586-9871-3d72dc1a46e7 None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:58.075481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ec51f-d625-4586-9871-3d72dc1a46e7 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:58.077722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 74/147] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:57 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:58.088704 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c66b56-26d1-4f12-9232-b05bbb81542e None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:58.158062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:58.202109 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c66b56-26d1-4f12-9232-b05bbb81542e None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:58.263799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d82e4c-cbbb-4d43-a333-d3087f264fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:58.264704 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d82e4c-cbbb-4d43-a333-d3087f264fcb None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:58.264984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d82e4c-cbbb-4d43-a333-d3087f264fcb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:58.265255 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d82e4c-cbbb-4d43-a333-d3087f264fcb None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f/users/e9418bdf7ab44222b9a4b8d4fd6daac0/roles/7f99c4626bbf4a6e8f81e07dc118b598` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:58.267240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d82e4c-cbbb-4d43-a333-d3087f264fcb None admin] RBAC: Authorizing `identity:create_grant(project_id=8f275690aa244b3ea3d67cb4f7e3502f, user_id=e9418bdf7ab44222b9a4b8d4fd6daac0, role_id=7f99c4626bbf4a6e8f81e07dc118b598)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:58.270401 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d82e4c-cbbb-4d43-a333-d3087f264fcb None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:58.363204 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 74/148] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:34:58 2022] PUT /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f/users/e9418bdf7ab44222b9a4b8d4fd6daac0/roles/7f99c4626bbf4a6e8f81e07dc118b598 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:34:58.797593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a8c4-b3bc-4443-ab49-6812e6b87859 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:58.798102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a8c4-b3bc-4443-ab49-6812e6b87859 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:58.798174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a8c4-b3bc-4443-ab49-6812e6b87859 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:58.799781 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 75/149] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:58.805758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeda355-8bf7-42de-a92a-93d459adcf09 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:58.806258 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeda355-8bf7-42de-a92a-93d459adcf09 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:58.806351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeda355-8bf7-42de-a92a-93d459adcf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:58.829789 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-6eeda355-8bf7-42de-a92a-93d459adcf09 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:58.831030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6eeda355-8bf7-42de-a92a-93d459adcf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:58.913537 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 75/150] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:34:58.961011 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14a8c4-b3bc-4443-ab49-6812e6b87859 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:59.071622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14a8c4-b3bc-4443-ab49-6812e6b87859 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:59.107672 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d400c-8fb1-4c00-aab1-a969db8b215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:59.108502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d400c-8fb1-4c00-aab1-a969db8b215e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:59.108779 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d400c-8fb1-4c00-aab1-a969db8b215e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:59.109056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d400c-8fb1-4c00-aab1-a969db8b215e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:59.121188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d400c-8fb1-4c00-aab1-a969db8b215e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-b84d400c-8fb1-4c00-aab1-a969db8b215e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:59.130131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:59.131029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:59.131813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:59.131813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:59.131813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:59.131813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:59.131813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:59.131813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:59.131813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:59.131813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:59.131813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:59.131813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:59.131813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:34:59.131813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:34:59.131813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 76/151] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:34:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:59.140779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeda355-8bf7-42de-a92a-93d459adcf09 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:59.203291 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:59.275489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeda355-8bf7-42de-a92a-93d459adcf09 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:59.318387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4cc5f-5629-411f-a916-4aa3920f4fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:59.319062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4cc5f-5629-411f-a916-4aa3920f4fda None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:59.319341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4cc5f-5629-411f-a916-4aa3920f4fda None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:59.319639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4cc5f-5629-411f-a916-4aa3920f4fda None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:59.320394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4cc5f-5629-411f-a916-4aa3920f4fda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:59.320694 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4cc5f-5629-411f-a916-4aa3920f4fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:59.322222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4cc5f-5629-411f-a916-4aa3920f4fda None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:59.331237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 76/152] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:34:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:59.337545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d400c-8fb1-4c00-aab1-a969db8b215e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:59.407246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:59.437938 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b05d-dbbe-46da-8747-d2a907dda9af None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:59.438263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b05d-dbbe-46da-8747-d2a907dda9af None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:59.438503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b05d-dbbe-46da-8747-d2a907dda9af None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:59.440157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 77/153] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:59.456136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f873a-c66e-4e1f-a57d-2b667b8742e0 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:59.456427 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f873a-c66e-4e1f-a57d-2b667b8742e0 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:59.456683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f873a-c66e-4e1f-a57d-2b667b8742e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:59.476371 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d400c-8fb1-4c00-aab1-a969db8b215e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:59.482385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-7f0f873a-c66e-4e1f-a57d-2b667b8742e0 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:59.483604 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-7f0f873a-c66e-4e1f-a57d-2b667b8742e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:59.537546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b4fed-31bf-4d41-ba3f-9a59c11eaf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:59.538764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b4fed-31bf-4d41-ba3f-9a59c11eaf63 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:59.539209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b4fed-31bf-4d41-ba3f-9a59c11eaf63 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:59.552210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b4fed-31bf-4d41-ba3f-9a59c11eaf63 None admin] PATH_INFO: `/v3/users/eca02941be074229a99a5024c4561e96` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:59.552210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b4fed-31bf-4d41-ba3f-9a59c11eaf63 None admin] RBAC: Authorizing `identity:get_user(user_id=eca02941be074229a99a5024c4561e96)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:59.552210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b4fed-31bf-4d41-ba3f-9a59c11eaf63 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:59.552210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 77/154] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:59 2022] GET /identity/v3/users/eca02941be074229a99a5024c4561e96 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:59.553560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b4fed-31bf-4d41-ba3f-9a59c11eaf63 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:59.584786 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 78/155] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:34:59.638269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f873a-c66e-4e1f-a57d-2b667b8742e0 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:59.691316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:59.754473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b4fed-31bf-4d41-ba3f-9a59c11eaf63 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:59.771928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f873a-c66e-4e1f-a57d-2b667b8742e0 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:59.810134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:59.836848 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaa93c-d4fd-4a1c-80a3-8055f7ef3879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:59.837427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaa93c-d4fd-4a1c-80a3-8055f7ef3879 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:59.837710 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaa93c-d4fd-4a1c-80a3-8055f7ef3879 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:59.837985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaa93c-d4fd-4a1c-80a3-8055f7ef3879 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:59.851189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de692fa-daf5-4b4c-8996-0654da9260de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:59.852031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de692fa-daf5-4b4c-8996-0654da9260de None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:59.852310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de692fa-daf5-4b4c-8996-0654da9260de None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:59.852581 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de692fa-daf5-4b4c-8996-0654da9260de None admin] PATH_INFO: `/v3/roles/member` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:59.871105 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de692fa-daf5-4b4c-8996-0654da9260de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-7de692fa-daf5-4b4c-8996-0654da9260de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:59.879496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:59.880379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:59.881129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:59.881129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:59.881129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:59.881129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:59.881129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:59.881129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:59.881129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:59.881129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:59.881129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:59.881129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:59.881129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:34:59.881129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:34:59.881129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 79/156] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:34:59.889635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de692fa-daf5-4b4c-8996-0654da9260de None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:00.000003 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de692fa-daf5-4b4c-8996-0654da9260de None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:00.000476 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaa93c-d4fd-4a1c-80a3-8055f7ef3879 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:00.002068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaa93c-d4fd-4a1c-80a3-8055f7ef3879 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:00.007589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:00.036236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ead2f-a8b3-4df9-85dc-b51d822e3aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:00.036912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ead2f-a8b3-4df9-85dc-b51d822e3aed None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:00.037199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ead2f-a8b3-4df9-85dc-b51d822e3aed None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:00.037478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ead2f-a8b3-4df9-85dc-b51d822e3aed None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:00.038283 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ead2f-a8b3-4df9-85dc-b51d822e3aed None admin] RBAC: Adding query filter params (name=member) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:00.038630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ead2f-a8b3-4df9-85dc-b51d822e3aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:00.040088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ead2f-a8b3-4df9-85dc-b51d822e3aed None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:00.048938 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 80/157] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:34:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:00.050330 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21cc24-2690-494e-b383-5d108dda8446 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:00.050615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21cc24-2690-494e-b383-5d108dda8446 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:00.050894 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21cc24-2690-494e-b383-5d108dda8446 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:00.052409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 81/158] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:00.053829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad08a5-8c1b-4c28-a9bd-df6dc18e2bab None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:00.054113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad08a5-8c1b-4c28-a9bd-df6dc18e2bab None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:00.054388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad08a5-8c1b-4c28-a9bd-df6dc18e2bab None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:00.055692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 82/159] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:00.056432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad08a5-8c1b-4c28-a9bd-df6dc18e2bab None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:00.132879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 78/160] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:35:00.134569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b82b2-72a7-4095-b4e5-33bf7497b76c None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:00.134969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b82b2-72a7-4095-b4e5-33bf7497b76c None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:00.135352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b82b2-72a7-4095-b4e5-33bf7497b76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:00.158643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-bd6b82b2-72a7-4095-b4e5-33bf7497b76c None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:00.160090 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-bd6b82b2-72a7-4095-b4e5-33bf7497b76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:00.206835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:00.348008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 79/161] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:00.349329 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cad4c-de37-4a42-92e4-850c8c662ea5 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:00.349616 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cad4c-de37-4a42-92e4-850c8c662ea5 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:00.349893 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cad4c-de37-4a42-92e4-850c8c662ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:00.352332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad08a5-8c1b-4c28-a9bd-df6dc18e2bab None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:00.394179 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-980cad4c-de37-4a42-92e4-850c8c662ea5 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:00.395285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-980cad4c-de37-4a42-92e4-850c8c662ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:00.430862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ef8fa-754e-4e11-a152-c3ac61642b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:00.431773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ef8fa-754e-4e11-a152-c3ac61642b2e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:00.432054 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ef8fa-754e-4e11-a152-c3ac61642b2e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:00.432328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ef8fa-754e-4e11-a152-c3ac61642b2e None admin] PATH_INFO: `/v3/users/eca02941be074229a99a5024c4561e96` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:00.434328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ef8fa-754e-4e11-a152-c3ac61642b2e None admin] RBAC: Authorizing `identity:get_user(user_id=eca02941be074229a99a5024c4561e96)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:00.435864 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ef8fa-754e-4e11-a152-c3ac61642b2e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:00.438839 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 83/162] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:00 2022] GET /identity/v3/users/eca02941be074229a99a5024c4561e96 => generated 275 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:00.439633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ef8fa-754e-4e11-a152-c3ac61642b2e None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:00.520447 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:00.534630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 80/163] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:00.535732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cad4c-de37-4a42-92e4-850c8c662ea5 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:00.643365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:00.660829 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cad4c-de37-4a42-92e4-850c8c662ea5 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:00.710415 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ef8fa-754e-4e11-a152-c3ac61642b2e None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:00.713819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17048328-b105-4917-8a88-a81e83f06979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:00.714634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17048328-b105-4917-8a88-a81e83f06979 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:00.714919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17048328-b105-4917-8a88-a81e83f06979 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:00.715216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17048328-b105-4917-8a88-a81e83f06979 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:00.756201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17048328-b105-4917-8a88-a81e83f06979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-17048328-b105-4917-8a88-a81e83f06979 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:00.772115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:00.773134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:00.773885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:00.773885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:00.773885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:00.773885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:00.773885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:00.773885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:00.773885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:00.773885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:00.773885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:00.773885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:00.773885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:35:00.773885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:00.773885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 81/164] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:00.774509 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17048328-b105-4917-8a88-a81e83f06979 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:00.793003 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c6c3c-4441-45f6-9f52-25b244c4485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:00.794234 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c6c3c-4441-45f6-9f52-25b244c4485f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:00.795230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c6c3c-4441-45f6-9f52-25b244c4485f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:00.795756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c6c3c-4441-45f6-9f52-25b244c4485f None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:00.800636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c6c3c-4441-45f6-9f52-25b244c4485f None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:00.802769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c6c3c-4441-45f6-9f52-25b244c4485f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:00.805110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 84/165] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:00 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:00.806244 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c6c3c-4441-45f6-9f52-25b244c4485f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:00.950849 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17048328-b105-4917-8a88-a81e83f06979 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:00.997087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8b52-f51e-4ec3-b2a4-dd3aa56f6bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:00.997743 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8b52-f51e-4ec3-b2a4-dd3aa56f6bd0 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:00.998085 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8b52-f51e-4ec3-b2a4-dd3aa56f6bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:00.998361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8b52-f51e-4ec3-b2a4-dd3aa56f6bd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:01.024766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:01.025295 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:01.037441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c6c3c-4441-45f6-9f52-25b244c4485f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:01.115995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b8b52-f51e-4ec3-b2a4-dd3aa56f6bd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:01.117711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b8b52-f51e-4ec3-b2a4-dd3aa56f6bd0 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:01.144202 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc96b3-ccb5-4d9f-8294-33b5de3c4677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:01.145022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc96b3-ccb5-4d9f-8294-33b5de3c4677 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:01.145308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc96b3-ccb5-4d9f-8294-33b5de3c4677 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:01.145587 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc96b3-ccb5-4d9f-8294-33b5de3c4677 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:01.176400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc96b3-ccb5-4d9f-8294-33b5de3c4677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-21fc96b3-ccb5-4d9f-8294-33b5de3c4677 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:01.192392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:01.193307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:01.194104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:01.194104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:01.194104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:01.194104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:01.194104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:01.194104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:01.194104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:01.194104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:01.194104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:01.194104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:01.194104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:01.194104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:01.194104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 85/166] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:01.194746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc96b3-ccb5-4d9f-8294-33b5de3c4677 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:01.334151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 82/167] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:01.335183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8b52-f51e-4ec3-b2a4-dd3aa56f6bd0 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:01.383385 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:01.402523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc96b3-ccb5-4d9f-8294-33b5de3c4677 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:01.441944 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8b52-f51e-4ec3-b2a4-dd3aa56f6bd0 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:01.468271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7dc8a-842a-40a3-806d-199dab132144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:01.469013 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7dc8a-842a-40a3-806d-199dab132144 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:01.469291 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7dc8a-842a-40a3-806d-199dab132144 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:01.469562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7dc8a-842a-40a3-806d-199dab132144 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:01.470326 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7dc8a-842a-40a3-806d-199dab132144 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:01.470624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7dc8a-842a-40a3-806d-199dab132144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:01.472043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7dc8a-842a-40a3-806d-199dab132144 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:01.479080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701f539-933c-465b-9533-3a0d382aeda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:01.479809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701f539-933c-465b-9533-3a0d382aeda6 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:01.480104 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701f539-933c-465b-9533-3a0d382aeda6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:01.480387 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701f539-933c-465b-9533-3a0d382aeda6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:01.481149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 86/168] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:01.481322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701f539-933c-465b-9533-3a0d382aeda6 None admin] RBAC: Adding query filter params (role.id=e97885113c774466b7432083b511fa58, scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f, user.id=eca02941be074229a99a5024c4561e96) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:01.481621 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701f539-933c-465b-9533-3a0d382aeda6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:01.481805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7dc8a-842a-40a3-806d-199dab132144 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:01.487188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701f539-933c-465b-9533-3a0d382aeda6 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:01.499613 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 83/169] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:01 2022] GET /identity/v3/role_assignments?user.id=eca02941be074229a99a5024c4561e96&scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f&role.id=e97885113c774466b7432083b511fa58 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:01.500602 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701f539-933c-465b-9533-3a0d382aeda6 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:01.531720 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:01.677861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7dc8a-842a-40a3-806d-199dab132144 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:01.745202 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e04e5b-5765-4ac2-9339-1af33cca1e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:01.745889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e04e5b-5765-4ac2-9339-1af33cca1e39 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:01.746167 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e04e5b-5765-4ac2-9339-1af33cca1e39 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:01.746444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e04e5b-5765-4ac2-9339-1af33cca1e39 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:01.747209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e04e5b-5765-4ac2-9339-1af33cca1e39 None admin] RBAC: Adding query filter params (name=member) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:01.747539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e04e5b-5765-4ac2-9339-1af33cca1e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:01.749535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e04e5b-5765-4ac2-9339-1af33cca1e39 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:01.750066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701f539-933c-465b-9533-3a0d382aeda6 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:01.764517 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:01.766629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 87/170] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:01.767517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e04e5b-5765-4ac2-9339-1af33cca1e39 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:01.787976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4c92b-f26d-4527-b8ec-468a6b44ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:01.788902 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c92b-f26d-4527-b8ec-468a6b44ac29 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:01.789222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c92b-f26d-4527-b8ec-468a6b44ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:01.789513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c92b-f26d-4527-b8ec-468a6b44ac29 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:01.790928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4c92b-f26d-4527-b8ec-468a6b44ac29 None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:01.792462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4c92b-f26d-4527-b8ec-468a6b44ac29 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:01.794281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 84/171] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:01 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:01.795808 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4c92b-f26d-4527-b8ec-468a6b44ac29 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:01.922725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4c92b-f26d-4527-b8ec-468a6b44ac29 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:01.959628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff6a29-1343-415e-b904-271bc255e18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:01.960513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff6a29-1343-415e-b904-271bc255e18c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:01.960801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff6a29-1343-415e-b904-271bc255e18c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:01.961082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff6a29-1343-415e-b904-271bc255e18c None admin] PATH_INFO: `/v3/users/eca02941be074229a99a5024c4561e96` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:01.962324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff6a29-1343-415e-b904-271bc255e18c None admin] RBAC: Authorizing `identity:get_user(user_id=eca02941be074229a99a5024c4561e96)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:01.963819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff6a29-1343-415e-b904-271bc255e18c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:01.965662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 85/172] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:01 2022] GET /identity/v3/users/eca02941be074229a99a5024c4561e96 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:01.967926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff6a29-1343-415e-b904-271bc255e18c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:01.975815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:02.008384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e04e5b-5765-4ac2-9339-1af33cca1e39 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:02.063975 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:02.076454 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b36f2-8cb3-450f-860e-7cbc386cd448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:02.092868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b36f2-8cb3-450f-860e-7cbc386cd448 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:02.092868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b36f2-8cb3-450f-860e-7cbc386cd448 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:02.092868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b36f2-8cb3-450f-860e-7cbc386cd448 None admin] PATH_INFO: `/v3/users/c62a7303ac7c4c3a91bb0f96d54dfd52` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:02.092868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b36f2-8cb3-450f-860e-7cbc386cd448 None admin] RBAC: Authorizing `identity:get_user(user_id=c62a7303ac7c4c3a91bb0f96d54dfd52)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:02.092868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b36f2-8cb3-450f-860e-7cbc386cd448 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:02.092868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 88/173] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:01 2022] GET /identity/v3/users/c62a7303ac7c4c3a91bb0f96d54dfd52 => generated 247 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:02.093278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b36f2-8cb3-450f-860e-7cbc386cd448 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:02.168141 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff6a29-1343-415e-b904-271bc255e18c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:02.225317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b36f2-8cb3-450f-860e-7cbc386cd448 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:02.239370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dd0f8-9fcb-4d93-b47c-47eb4bbf3b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:02.240091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dd0f8-9fcb-4d93-b47c-47eb4bbf3b26 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:02.240378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dd0f8-9fcb-4d93-b47c-47eb4bbf3b26 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:02.240656 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dd0f8-9fcb-4d93-b47c-47eb4bbf3b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:02.241493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dd0f8-9fcb-4d93-b47c-47eb4bbf3b26 None admin] RBAC: Adding query filter params (role.id=9507ef97f4954ddc90305c9d0f1d3608, scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f, user.id=eca02941be074229a99a5024c4561e96) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:02.241808 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dd0f8-9fcb-4d93-b47c-47eb4bbf3b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:02.243273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dd0f8-9fcb-4d93-b47c-47eb4bbf3b26 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:02.250637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 86/174] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:01 2022] GET /identity/v3/role_assignments?user.id=eca02941be074229a99a5024c4561e96&scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f&role.id=9507ef97f4954ddc90305c9d0f1d3608 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:02.251590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dd0f8-9fcb-4d93-b47c-47eb4bbf3b26 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:02.285928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa9952-421b-4e7c-b4db-84cdf1f209d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:02.286610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa9952-421b-4e7c-b4db-84cdf1f209d5 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:02.286897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa9952-421b-4e7c-b4db-84cdf1f209d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:02.287175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa9952-421b-4e7c-b4db-84cdf1f209d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:02.340787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:02.378874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dd0f8-9fcb-4d93-b47c-47eb4bbf3b26 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:02.389844 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:02.420958 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb7ae7-3f6f-4552-80df-e26896ec0cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:02.422029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb7ae7-3f6f-4552-80df-e26896ec0cbc None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:02.422496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb7ae7-3f6f-4552-80df-e26896ec0cbc None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:02.422951 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb7ae7-3f6f-4552-80df-e26896ec0cbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:02.480783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa9952-421b-4e7c-b4db-84cdf1f209d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:02.482400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa9952-421b-4e7c-b4db-84cdf1f209d5 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:02.507409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb7ae7-3f6f-4552-80df-e26896ec0cbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:02.509358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb7ae7-3f6f-4552-80df-e26896ec0cbc None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:02.643079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 87/175] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:02.645066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38cd8a-47a0-4c04-9a5e-e99677346f56 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:02.645474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38cd8a-47a0-4c04-9a5e-e99677346f56 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:02.645647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38cd8a-47a0-4c04-9a5e-e99677346f56 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:02.647631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 88/176] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:02.649400 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bfb05-d288-45d2-b710-091d0d2e0d07 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:02.649692 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bfb05-d288-45d2-b710-091d0d2e0d07 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:02.650001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bfb05-d288-45d2-b710-091d0d2e0d07 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:02.652154 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 89/177] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:02.653627 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578996e-cffd-41dd-8c4a-bc4f1247b9ac None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:02.654034 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578996e-cffd-41dd-8c4a-bc4f1247b9ac None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:02.654477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578996e-cffd-41dd-8c4a-bc4f1247b9ac None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:02.656177 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 90/178] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:02.659480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851399e-bb72-4249-8578-dffe975dc9e8 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:02.659606 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 89/179] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:02.659685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851399e-bb72-4249-8578-dffe975dc9e8 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:02.659685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851399e-bb72-4249-8578-dffe975dc9e8 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:02.659827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa9952-421b-4e7c-b4db-84cdf1f209d5 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:02.659898 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 91/180] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:02.660678 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bd426-1b23-4295-b316-58a33c210fd2 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:02.660973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bd426-1b23-4295-b316-58a33c210fd2 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:02.661420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bd426-1b23-4295-b316-58a33c210fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:02.678254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-516bd426-1b23-4295-b316-58a33c210fd2 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:02.679487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-516bd426-1b23-4295-b316-58a33c210fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:02.681545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:02.714416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:02.748580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 92/181] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:02.749854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a803e3-f116-4bec-823c-f33eb1f00e79 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:02.750137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a803e3-f116-4bec-823c-f33eb1f00e79 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:02.750450 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a803e3-f116-4bec-823c-f33eb1f00e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:02.762184 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa9952-421b-4e7c-b4db-84cdf1f209d5 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:02.783138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-76a803e3-f116-4bec-823c-f33eb1f00e79 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:02.784378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-76a803e3-f116-4bec-823c-f33eb1f00e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:02.796895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146e9e6-2421-485f-98a3-d08235c9b86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:02.797757 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146e9e6-2421-485f-98a3-d08235c9b86f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:02.798038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146e9e6-2421-485f-98a3-d08235c9b86f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:02.798356 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146e9e6-2421-485f-98a3-d08235c9b86f None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:02.799537 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146e9e6-2421-485f-98a3-d08235c9b86f None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:02.800982 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146e9e6-2421-485f-98a3-d08235c9b86f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:02.802683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 90/182] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:02 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:02.803836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967becd-4bf9-430b-9377-ef4ec9d8534a None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:02.804122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967becd-4bf9-430b-9377-ef4ec9d8534a None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:02.804399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967becd-4bf9-430b-9377-ef4ec9d8534a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:02.820682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-e967becd-4bf9-430b-9377-ef4ec9d8534a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:02.821869 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e967becd-4bf9-430b-9377-ef4ec9d8534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:02.854968 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 93/183] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:02.856266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81ddf-d9e7-4778-8684-ac485f9fcb40 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:02.856554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81ddf-d9e7-4778-8684-ac485f9fcb40 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:02.856832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81ddf-d9e7-4778-8684-ac485f9fcb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:02.872727 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-8ec81ddf-d9e7-4778-8684-ac485f9fcb40 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:02.874417 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8ec81ddf-d9e7-4778-8684-ac485f9fcb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:02.891098 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 91/184] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:02.891988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967becd-4bf9-430b-9377-ef4ec9d8534a None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:02.938249 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:02.943288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:02.943564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 94/185] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:02.944379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec81ddf-d9e7-4778-8684-ac485f9fcb40 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:03.000711 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967becd-4bf9-430b-9377-ef4ec9d8534a None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:03.035367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c82adc-638e-435b-bbdd-99c2b00b5468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:03.036249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c82adc-638e-435b-bbdd-99c2b00b5468 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:03.036524 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c82adc-638e-435b-bbdd-99c2b00b5468 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:03.036800 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c82adc-638e-435b-bbdd-99c2b00b5468 None admin] PATH_INFO: `/v3/projects/a73eb00ea9a94c9bb4e18ceea51ef2e5` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:03.037984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c82adc-638e-435b-bbdd-99c2b00b5468 None admin] RBAC: Authorizing `identity:get_project(project_id=a73eb00ea9a94c9bb4e18ceea51ef2e5)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:03.039480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c82adc-638e-435b-bbdd-99c2b00b5468 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:03.041166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 92/186] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:02 2022] GET /identity/v3/projects/a73eb00ea9a94c9bb4e18ceea51ef2e5 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:03.041914 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c82adc-638e-435b-bbdd-99c2b00b5468 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:03.044546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec81ddf-d9e7-4778-8684-ac485f9fcb40 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:03.079493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099db587-8f60-42f3-a0fb-c052c30f874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:03.080290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099db587-8f60-42f3-a0fb-c052c30f874f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:03.080571 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099db587-8f60-42f3-a0fb-c052c30f874f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:03.080846 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099db587-8f60-42f3-a0fb-c052c30f874f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:03.091193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099db587-8f60-42f3-a0fb-c052c30f874f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-099db587-8f60-42f3-a0fb-c052c30f874f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:03.099487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:03.100448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:03.101216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:03.101216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:03.101216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:03.101216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:03.101216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:03.101216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:03.101216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:03.101216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:03.101216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:03.101216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:03.101216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:35:03.101216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:03.101216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 95/187] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:35:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:03.101850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099db587-8f60-42f3-a0fb-c052c30f874f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:03.145861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c82adc-638e-435b-bbdd-99c2b00b5468 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:03.161103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:03.163629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:03.180062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91b287-caf5-46ae-b291-3150efcc00b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:03.180711 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91b287-caf5-46ae-b291-3150efcc00b5 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:03.180993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91b287-caf5-46ae-b291-3150efcc00b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:03.181268 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91b287-caf5-46ae-b291-3150efcc00b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:03.182094 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91b287-caf5-46ae-b291-3150efcc00b5 None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f, user.id=c62a7303ac7c4c3a91bb0f96d54dfd52) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:03.182403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91b287-caf5-46ae-b291-3150efcc00b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:03.183880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91b287-caf5-46ae-b291-3150efcc00b5 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:03.207808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 93/188] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:03 2022] GET /identity/v3/role_assignments?user.id=c62a7303ac7c4c3a91bb0f96d54dfd52&scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f&role.id=c5632345c9274d348669482f1f7414c8 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:03.207808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91b287-caf5-46ae-b291-3150efcc00b5 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:03.208095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099db587-8f60-42f3-a0fb-c052c30f874f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:03.241999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ddfdf-0185-4237-83fd-fd16a1bd16d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:03.242801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ddfdf-0185-4237-83fd-fd16a1bd16d4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:03.243088 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ddfdf-0185-4237-83fd-fd16a1bd16d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:03.243359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ddfdf-0185-4237-83fd-fd16a1bd16d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:03.255363 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ddfdf-0185-4237-83fd-fd16a1bd16d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-857ddfdf-0185-4237-83fd-fd16a1bd16d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:03.264152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:03.265134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:03.265911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:03.265911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:03.265911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:03.265911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:03.265911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:03.265911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:03.265911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:03.265911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:03.265911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:03.265911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:03.265911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:35:03.265911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:03.265911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 96/189] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:03.266575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ddfdf-0185-4237-83fd-fd16a1bd16d4 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:03.334040 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91b287-caf5-46ae-b291-3150efcc00b5 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:03.374270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7814b2-cdf9-44f8-8950-15d84b21ef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:03.375093 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7814b2-cdf9-44f8-8950-15d84b21ef98 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:03.375371 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7814b2-cdf9-44f8-8950-15d84b21ef98 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:03.375686 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7814b2-cdf9-44f8-8950-15d84b21ef98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:03.387971 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7814b2-cdf9-44f8-8950-15d84b21ef98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:03.393206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ddfdf-0185-4237-83fd-fd16a1bd16d4 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-3e7814b2-cdf9-44f8-8950-15d84b21ef98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:03.396882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:03.397765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:03.399867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:03.399867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:03.399867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:03.399867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:03.399867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:03.399867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:03.399867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:03.399867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:03.399867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:03.399867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:03.399867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:03.399867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:03.399867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 94/190] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:35:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:03.399867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7814b2-cdf9-44f8-8950-15d84b21ef98 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:03.415085 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:03.440793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc03e7-de8e-423c-83dc-a88773b33c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:03.441609 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc03e7-de8e-423c-83dc-a88773b33c4c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:03.441897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc03e7-de8e-423c-83dc-a88773b33c4c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:03.442179 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc03e7-de8e-423c-83dc-a88773b33c4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:03.444834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc03e7-de8e-423c-83dc-a88773b33c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:03.446472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc03e7-de8e-423c-83dc-a88773b33c4c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:03.448056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 97/191] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:03.448675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc03e7-de8e-423c-83dc-a88773b33c4c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:03.456589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:03.520089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7814b2-cdf9-44f8-8950-15d84b21ef98 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:03.553763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36b2d1-7efc-4ac0-94f3-9bb40f3b8eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:03.554423 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b2d1-7efc-4ac0-94f3-9bb40f3b8eaa None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:03.554709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b2d1-7efc-4ac0-94f3-9bb40f3b8eaa None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:03.555038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b2d1-7efc-4ac0-94f3-9bb40f3b8eaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:03.555922 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36b2d1-7efc-4ac0-94f3-9bb40f3b8eaa None admin] RBAC: Adding query filter params (role.id=9507ef97f4954ddc90305c9d0f1d3608, scope.project.id=a73eb00ea9a94c9bb4e18ceea51ef2e5, user.id=eca02941be074229a99a5024c4561e96) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:03.556238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36b2d1-7efc-4ac0-94f3-9bb40f3b8eaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:03.557689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36b2d1-7efc-4ac0-94f3-9bb40f3b8eaa None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:03.562185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc03e7-de8e-423c-83dc-a88773b33c4c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:03.566169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 95/192] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:03 2022] GET /identity/v3/role_assignments?user.id=eca02941be074229a99a5024c4561e96&scope.project.id=a73eb00ea9a94c9bb4e18ceea51ef2e5&role.id=9507ef97f4954ddc90305c9d0f1d3608 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:03.566169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36b2d1-7efc-4ac0-94f3-9bb40f3b8eaa None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:03.610368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802b269-b8f4-4978-af87-9b4ddaf0074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:03.611295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b269-b8f4-4978-af87-9b4ddaf0074b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:03.611688 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b269-b8f4-4978-af87-9b4ddaf0074b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:03.612019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b269-b8f4-4978-af87-9b4ddaf0074b None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:03.612857 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802b269-b8f4-4978-af87-9b4ddaf0074b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:03.613238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802b269-b8f4-4978-af87-9b4ddaf0074b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:03.614759 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802b269-b8f4-4978-af87-9b4ddaf0074b None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:03.626333 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 98/193] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:03.627072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802b269-b8f4-4978-af87-9b4ddaf0074b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:03.684140 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:03.687228 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36b2d1-7efc-4ac0-94f3-9bb40f3b8eaa None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:03.695717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:03.732893 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c943c0b-841f-4a00-8f84-45055c823771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:03.733583 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c943c0b-841f-4a00-8f84-45055c823771 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:03.734021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c943c0b-841f-4a00-8f84-45055c823771 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:03.734299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c943c0b-841f-4a00-8f84-45055c823771 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:03.735513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c943c0b-841f-4a00-8f84-45055c823771 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:03.735885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c943c0b-841f-4a00-8f84-45055c823771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:03.737379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c943c0b-841f-4a00-8f84-45055c823771 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:03.744329 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802b269-b8f4-4978-af87-9b4ddaf0074b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:03.751625 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 96/194] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:03.752707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c943c0b-841f-4a00-8f84-45055c823771 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:03.790128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d08c5b-71d9-4ed0-ab0a-693f5ee9b20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:03.790733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d08c5b-71d9-4ed0-ab0a-693f5ee9b20c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:03.791016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d08c5b-71d9-4ed0-ab0a-693f5ee9b20c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:03.791291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d08c5b-71d9-4ed0-ab0a-693f5ee9b20c None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:03.792079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d08c5b-71d9-4ed0-ab0a-693f5ee9b20c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:03.795296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d08c5b-71d9-4ed0-ab0a-693f5ee9b20c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:03.795296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d08c5b-71d9-4ed0-ab0a-693f5ee9b20c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:03.802862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 99/195] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:03.803521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d08c5b-71d9-4ed0-ab0a-693f5ee9b20c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:03.867953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c943c0b-841f-4a00-8f84-45055c823771 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:03.901535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76418d9-dd20-45c8-b260-cdfda4f42583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:03.902199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76418d9-dd20-45c8-b260-cdfda4f42583 None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:03.902478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76418d9-dd20-45c8-b260-cdfda4f42583 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:03.902755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76418d9-dd20-45c8-b260-cdfda4f42583 None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:03.903473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76418d9-dd20-45c8-b260-cdfda4f42583 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:03.904957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76418d9-dd20-45c8-b260-cdfda4f42583 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:03.910042 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d08c5b-71d9-4ed0-ab0a-693f5ee9b20c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:03.920636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:03.942929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d5f8a-9e71-4ec2-b0fb-7cf1afc19e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:03.943817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d5f8a-9e71-4ec2-b0fb-7cf1afc19e01 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:03.944097 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d5f8a-9e71-4ec2-b0fb-7cf1afc19e01 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:03.944371 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d5f8a-9e71-4ec2-b0fb-7cf1afc19e01 None admin] PATH_INFO: `/v3/users/c4e2211591f54f1f9719a1b17f69f87b` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:03.957239 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d5f8a-9e71-4ec2-b0fb-7cf1afc19e01 None admin] RBAC: Authorizing `identity:get_user(user_id=c4e2211591f54f1f9719a1b17f69f87b)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:03.958677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d5f8a-9e71-4ec2-b0fb-7cf1afc19e01 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:03.960340 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 100/196] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:03 2022] GET /identity/v3/users/c4e2211591f54f1f9719a1b17f69f87b => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:03.961088 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d5f8a-9e71-4ec2-b0fb-7cf1afc19e01 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:04.002235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 97/197] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:35:03 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:35:04.002899 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76418d9-dd20-45c8-b260-cdfda4f42583 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:04.031557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:04.066993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d5f8a-9e71-4ec2-b0fb-7cf1afc19e01 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:04.109012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f15e6-9250-4147-a917-f189aea09aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:04.110220 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f15e6-9250-4147-a917-f189aea09aec None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:04.110505 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f15e6-9250-4147-a917-f189aea09aec None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:04.110854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f15e6-9250-4147-a917-f189aea09aec None admin] PATH_INFO: `/v3/users/e9418bdf7ab44222b9a4b8d4fd6daac0` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:04.112763 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f15e6-9250-4147-a917-f189aea09aec None admin] RBAC: Authorizing `identity:get_user(user_id=e9418bdf7ab44222b9a4b8d4fd6daac0)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:04.114906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f15e6-9250-4147-a917-f189aea09aec None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:04.116843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 101/198] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:03 2022] GET /identity/v3/users/e9418bdf7ab44222b9a4b8d4fd6daac0 => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:04.116843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f15e6-9250-4147-a917-f189aea09aec None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:04.125068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76418d9-dd20-45c8-b260-cdfda4f42583 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:04.161271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:04.164583 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee2478-b079-46ac-b4f0-c7c6156fc652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:04.165486 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee2478-b079-46ac-b4f0-c7c6156fc652 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:04.165764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee2478-b079-46ac-b4f0-c7c6156fc652 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:04.166035 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee2478-b079-46ac-b4f0-c7c6156fc652 None admin] PATH_INFO: `/v3/users/c4e2211591f54f1f9719a1b17f69f87b` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:04.167341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee2478-b079-46ac-b4f0-c7c6156fc652 None admin] RBAC: Authorizing `identity:get_user(user_id=c4e2211591f54f1f9719a1b17f69f87b)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:04.168914 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee2478-b079-46ac-b4f0-c7c6156fc652 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:04.171333 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 98/199] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:04 2022] GET /identity/v3/users/c4e2211591f54f1f9719a1b17f69f87b => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:04.176032 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee2478-b079-46ac-b4f0-c7c6156fc652 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:04.242243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f15e6-9250-4147-a917-f189aea09aec None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:04.287392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:04.295832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826da438-88f7-44f3-8e5e-ff36c1a58c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:04.296535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da438-88f7-44f3-8e5e-ff36c1a58c4d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:04.296832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da438-88f7-44f3-8e5e-ff36c1a58c4d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:04.297048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da438-88f7-44f3-8e5e-ff36c1a58c4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:04.301453 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee2478-b079-46ac-b4f0-c7c6156fc652 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:04.346783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce404fba-62d4-4928-bb3c-5d5984eb7748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:04.348238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce404fba-62d4-4928-bb3c-5d5984eb7748 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:04.348737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce404fba-62d4-4928-bb3c-5d5984eb7748 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:04.349200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce404fba-62d4-4928-bb3c-5d5984eb7748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:04.388294 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826da438-88f7-44f3-8e5e-ff36c1a58c4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:04.389898 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826da438-88f7-44f3-8e5e-ff36c1a58c4d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:04.432994 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce404fba-62d4-4928-bb3c-5d5984eb7748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:04.434509 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce404fba-62d4-4928-bb3c-5d5984eb7748 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:04.441418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:04.520912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 102/200] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:04.522442 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826da438-88f7-44f3-8e5e-ff36c1a58c4d None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:04.542579 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:04.554822 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 99/201] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:04.556076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce404fba-62d4-4928-bb3c-5d5984eb7748 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:04.648495 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826da438-88f7-44f3-8e5e-ff36c1a58c4d None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:04.672184 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce404fba-62d4-4928-bb3c-5d5984eb7748 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:04.691828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ac7f5-e7cc-47e7-ac8f-e3ccd8b6dfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:04.692732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ac7f5-e7cc-47e7-ac8f-e3ccd8b6dfb9 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:04.693188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ac7f5-e7cc-47e7-ac8f-e3ccd8b6dfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:04.693610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ac7f5-e7cc-47e7-ac8f-e3ccd8b6dfb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:04.698658 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:04.710832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5bd76-79f7-4969-b4f2-6c326914a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:04.712050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5bd76-79f7-4969-b4f2-6c326914a3ff None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:04.712628 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5bd76-79f7-4969-b4f2-6c326914a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:04.713079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5bd76-79f7-4969-b4f2-6c326914a3ff None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:04.714471 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5bd76-79f7-4969-b4f2-6c326914a3ff None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:04.716167 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5bd76-79f7-4969-b4f2-6c326914a3ff None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:04.718642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 100/202] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:04 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:04.719784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5bd76-79f7-4969-b4f2-6c326914a3ff None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:04.775513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ac7f5-e7cc-47e7-ac8f-e3ccd8b6dfb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:04.777477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ac7f5-e7cc-47e7-ac8f-e3ccd8b6dfb9 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:04.790588 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:04.835637 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5bd76-79f7-4969-b4f2-6c326914a3ff None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:04.872641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8cd65-fabe-4788-b9cd-ee0e34534ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:04.874041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8cd65-fabe-4788-b9cd-ee0e34534ac8 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:04.874325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8cd65-fabe-4788-b9cd-ee0e34534ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:04.874600 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8cd65-fabe-4788-b9cd-ee0e34534ac8 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:04.875858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8cd65-fabe-4788-b9cd-ee0e34534ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:04.877416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8cd65-fabe-4788-b9cd-ee0e34534ac8 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:04.883749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 101/203] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:04 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:04.883749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8cd65-fabe-4788-b9cd-ee0e34534ac8 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:04.896763 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 103/204] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:04.898103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ac7f5-e7cc-47e7-ac8f-e3ccd8b6dfb9 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:04.937447 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:04.996288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8cd65-fabe-4788-b9cd-ee0e34534ac8 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:05.009783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ac7f5-e7cc-47e7-ac8f-e3ccd8b6dfb9 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:05.025979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:05.034375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e9f2c-972d-4467-954b-605a28a4a4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:05.035075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e9f2c-972d-4467-954b-605a28a4a4aa None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:05.035317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e9f2c-972d-4467-954b-605a28a4a4aa None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:05.035654 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e9f2c-972d-4467-954b-605a28a4a4aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:05.036523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e9f2c-972d-4467-954b-605a28a4a4aa None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21, user.id=c4e2211591f54f1f9719a1b17f69f87b) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:05.036841 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e9f2c-972d-4467-954b-605a28a4a4aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:05.038554 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e9f2c-972d-4467-954b-605a28a4a4aa None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:05.049320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c40a6-385f-4f01-b9ca-71a6b29d905d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:05.050257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c40a6-385f-4f01-b9ca-71a6b29d905d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:05.050725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c40a6-385f-4f01-b9ca-71a6b29d905d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:05.051151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c40a6-385f-4f01-b9ca-71a6b29d905d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:05.051873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 102/205] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:04 2022] GET /identity/v3/role_assignments?user.id=c4e2211591f54f1f9719a1b17f69f87b&scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21&role.id=c5632345c9274d348669482f1f7414c8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:05.052847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e9f2c-972d-4467-954b-605a28a4a4aa None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:05.053170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c40a6-385f-4f01-b9ca-71a6b29d905d None admin] RBAC: Adding query filter params (role.id=7f99c4626bbf4a6e8f81e07dc118b598, scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f, user.id=e9418bdf7ab44222b9a4b8d4fd6daac0) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:05.053685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c40a6-385f-4f01-b9ca-71a6b29d905d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:05.055638 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c40a6-385f-4f01-b9ca-71a6b29d905d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:05.063084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 104/206] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:04 2022] GET /identity/v3/role_assignments?user.id=e9418bdf7ab44222b9a4b8d4fd6daac0&scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f&role.id=7f99c4626bbf4a6e8f81e07dc118b598 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:05.231492 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e9f2c-972d-4467-954b-605a28a4a4aa None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:05.291832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178cdf3-6d0b-453b-9a3e-62dd4daa2554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:05.292723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178cdf3-6d0b-453b-9a3e-62dd4daa2554 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:05.293010 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178cdf3-6d0b-453b-9a3e-62dd4daa2554 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:05.293291 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178cdf3-6d0b-453b-9a3e-62dd4daa2554 None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:05.295386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178cdf3-6d0b-453b-9a3e-62dd4daa2554 None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:05.296903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178cdf3-6d0b-453b-9a3e-62dd4daa2554 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:05.298756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 103/207] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:05 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:05.304798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c40a6-385f-4f01-b9ca-71a6b29d905d None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:05.422571 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:05.427670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c40a6-385f-4f01-b9ca-71a6b29d905d None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:05.474703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6abb5e-c8cf-42c8-9bc3-8c9e52a10cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:05.475394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6abb5e-c8cf-42c8-9bc3-8c9e52a10cac None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:05.475704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6abb5e-c8cf-42c8-9bc3-8c9e52a10cac None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:05.475984 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6abb5e-c8cf-42c8-9bc3-8c9e52a10cac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:05.476840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6abb5e-c8cf-42c8-9bc3-8c9e52a10cac None admin] RBAC: Adding query filter params (role.id=e97885113c774466b7432083b511fa58, scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21, user.id=c4e2211591f54f1f9719a1b17f69f87b) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:05.477206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6abb5e-c8cf-42c8-9bc3-8c9e52a10cac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:05.478801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6abb5e-c8cf-42c8-9bc3-8c9e52a10cac None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:05.486155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 105/208] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:05 2022] GET /identity/v3/role_assignments?user.id=c4e2211591f54f1f9719a1b17f69f87b&scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21&role.id=e97885113c774466b7432083b511fa58 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:06.518796 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbce91-b9ee-4186-aadd-64e5a6750a31 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:06.519570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbce91-b9ee-4186-aadd-64e5a6750a31 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:06.519570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbce91-b9ee-4186-aadd-64e5a6750a31 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:06.520830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 104/209] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:06.526359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbb5ba-8868-4215-a587-bb4fcd0cb72f None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:06.526767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbb5ba-8868-4215-a587-bb4fcd0cb72f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:06.526934 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbb5ba-8868-4215-a587-bb4fcd0cb72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:06.544204 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-26cbb5ba-8868-4215-a587-bb4fcd0cb72f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:06.545457 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-26cbb5ba-8868-4215-a587-bb4fcd0cb72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:06.642702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4942d-da01-4afb-aabf-bf03ae06adb2 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:06.643019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4942d-da01-4afb-aabf-bf03ae06adb2 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:06.643263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4942d-da01-4afb-aabf-bf03ae06adb2 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:06.644723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 105/211] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:06.648722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 106/211] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:06.650067 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6cd7-fffc-4c70-853d-59642a68e306 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:06.650595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6cd7-fffc-4c70-853d-59642a68e306 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:06.651078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6cd7-fffc-4c70-853d-59642a68e306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:06.668954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-c17c6cd7-fffc-4c70-853d-59642a68e306 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:06.671137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c17c6cd7-fffc-4c70-853d-59642a68e306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:06.672267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbb5ba-8868-4215-a587-bb4fcd0cb72f None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:06.758390 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 106/212] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:06.759055 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:06.783411 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6cd7-fffc-4c70-853d-59642a68e306 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:06.788465 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:06.795880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbb5ba-8868-4215-a587-bb4fcd0cb72f None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:06.831748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b65598-bba4-436d-ad7a-3e8ab4207086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:06.832825 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b65598-bba4-436d-ad7a-3e8ab4207086 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:06.833253 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b65598-bba4-436d-ad7a-3e8ab4207086 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:06.833763 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b65598-bba4-436d-ad7a-3e8ab4207086 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:06.836213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b65598-bba4-436d-ad7a-3e8ab4207086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:06.838019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b65598-bba4-436d-ad7a-3e8ab4207086 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:06.840222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 107/213] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:06.845763 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b65598-bba4-436d-ad7a-3e8ab4207086 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:06.889002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6cd7-fffc-4c70-853d-59642a68e306 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:06.923841 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3c033-4879-4611-871e-b558f9cc3dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:06.924642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3c033-4879-4611-871e-b558f9cc3dc9 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:06.924915 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3c033-4879-4611-871e-b558f9cc3dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:06.925321 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3c033-4879-4611-871e-b558f9cc3dc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:06.936357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3c033-4879-4611-871e-b558f9cc3dc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-36d3c033-4879-4611-871e-b558f9cc3dc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:06.944418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:06.945544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:06.946518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:06.946518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:06.946518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:06.946518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:06.946518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:06.946518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:06.946518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:06.946518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:06.946518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:06.946518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:06.946518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:06.946518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:06.950438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 107/214] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:06.951944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3c033-4879-4611-871e-b558f9cc3dc9 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:06.959627 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b65598-bba4-436d-ad7a-3e8ab4207086 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:06.998418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5623a66-af5e-42c6-a5f6-82e05e61baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:06.999494 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5623a66-af5e-42c6-a5f6-82e05e61baba None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:07.000029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5623a66-af5e-42c6-a5f6-82e05e61baba None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:07.000447 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5623a66-af5e-42c6-a5f6-82e05e61baba None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:07.001303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5623a66-af5e-42c6-a5f6-82e05e61baba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:07.003009 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5623a66-af5e-42c6-a5f6-82e05e61baba None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:07.003445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:07.056860 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3c033-4879-4611-871e-b558f9cc3dc9 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:07.092335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db507e-d540-49b1-87f3-988e944547dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:07.093004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db507e-d540-49b1-87f3-988e944547dd None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:07.093284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db507e-d540-49b1-87f3-988e944547dd None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:07.093555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db507e-d540-49b1-87f3-988e944547dd None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:07.094303 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db507e-d540-49b1-87f3-988e944547dd None admin] RBAC: Adding query filter params (name=member) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:07.094603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db507e-d540-49b1-87f3-988e944547dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:07.096018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db507e-d540-49b1-87f3-988e944547dd None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:07.105415 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 108/215] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:07.111709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db507e-d540-49b1-87f3-988e944547dd None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:07.155485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 108/216] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:35:06 2022] POST /identity/v3/users => generated 297 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:35:07.244267 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db507e-d540-49b1-87f3-988e944547dd None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:07.264693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:07.295370 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d195297-d08b-4fe1-b055-604f0addfc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:07.296317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d195297-d08b-4fe1-b055-604f0addfc2f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:07.296601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d195297-d08b-4fe1-b055-604f0addfc2f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:07.296878 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d195297-d08b-4fe1-b055-604f0addfc2f None admin] PATH_INFO: `/v3/users/c4ac54adce7f46a5a9779398948a2957` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:07.319278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d195297-d08b-4fe1-b055-604f0addfc2f None admin] RBAC: Authorizing `identity:get_user(user_id=c4ac54adce7f46a5a9779398948a2957)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:07.321137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d195297-d08b-4fe1-b055-604f0addfc2f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:07.323557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 109/217] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:07 2022] GET /identity/v3/users/c4ac54adce7f46a5a9779398948a2957 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:07.329275 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5623a66-af5e-42c6-a5f6-82e05e61baba None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:07.352607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:07.441208 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5623a66-af5e-42c6-a5f6-82e05e61baba None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:07.462021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437915e7-7f44-4938-a453-7f0585cd801a None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:07.462361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437915e7-7f44-4938-a453-7f0585cd801a None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:07.462605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437915e7-7f44-4938-a453-7f0585cd801a None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:07.471266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 110/218] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:35:07.477383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190551fd-fa84-46bd-8676-05d4a2d50642 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:07.478007 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190551fd-fa84-46bd-8676-05d4a2d50642 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:07.478284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190551fd-fa84-46bd-8676-05d4a2d50642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:07.489010 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63b16b-4f97-4435-81b3-00b9e41eec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:07.489673 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63b16b-4f97-4435-81b3-00b9e41eec89 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:07.489956 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63b16b-4f97-4435-81b3-00b9e41eec89 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:07.490229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63b16b-4f97-4435-81b3-00b9e41eec89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:07.501041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-190551fd-fa84-46bd-8676-05d4a2d50642 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:07.502930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-190551fd-fa84-46bd-8676-05d4a2d50642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:07.581169 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63b16b-4f97-4435-81b3-00b9e41eec89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:07.583052 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63b16b-4f97-4435-81b3-00b9e41eec89 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:07.606746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 111/219] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:35:07.609697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:07.637149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190551fd-fa84-46bd-8676-05d4a2d50642 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:07.724345 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 109/220] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:07.730128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63b16b-4f97-4435-81b3-00b9e41eec89 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:07.770795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:07.774425 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190551fd-fa84-46bd-8676-05d4a2d50642 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:07.812111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d7231-a617-42c3-91ec-d11529583cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:07.812913 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d7231-a617-42c3-91ec-d11529583cd8 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:07.813197 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d7231-a617-42c3-91ec-d11529583cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:07.813473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d7231-a617-42c3-91ec-d11529583cd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:07.825147 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d7231-a617-42c3-91ec-d11529583cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-a13d7231-a617-42c3-91ec-d11529583cd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:07.833616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:07.834470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:07.835245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:07.835245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:07.835245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:07.835245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:07.835245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:07.835245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:07.835245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:07.835245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:07.835245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:07.835245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:07.835245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:35:07.835245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:07.835245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 112/221] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:35:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:07.840752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d7231-a617-42c3-91ec-d11529583cd8 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:07.858064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63b16b-4f97-4435-81b3-00b9e41eec89 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:07.877451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:07.896284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7525531-3bcd-4174-8c64-ac03fd630530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:07.897164 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7525531-3bcd-4174-8c64-ac03fd630530 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:07.897449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7525531-3bcd-4174-8c64-ac03fd630530 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:07.897726 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7525531-3bcd-4174-8c64-ac03fd630530 None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:07.899307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7525531-3bcd-4174-8c64-ac03fd630530 None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:07.900562 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7525531-3bcd-4174-8c64-ac03fd630530 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:07.902553 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 110/222] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:07 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:07.908877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941174f2-ae81-4c86-a1a6-a47efdf3c885 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:07.909283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941174f2-ae81-4c86-a1a6-a47efdf3c885 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:07.909492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941174f2-ae81-4c86-a1a6-a47efdf3c885 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:07.911082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 111/223] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:07.911708 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941174f2-ae81-4c86-a1a6-a47efdf3c885 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:07.973378 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d7231-a617-42c3-91ec-d11529583cd8 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:08.012584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34253d0-2f31-4185-8835-44d378ff14a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:08.013318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34253d0-2f31-4185-8835-44d378ff14a7 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:08.013639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34253d0-2f31-4185-8835-44d378ff14a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:08.013946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34253d0-2f31-4185-8835-44d378ff14a7 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:08.014725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34253d0-2f31-4185-8835-44d378ff14a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:08.015036 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34253d0-2f31-4185-8835-44d378ff14a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:08.016695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34253d0-2f31-4185-8835-44d378ff14a7 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:08.026494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 113/224] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:08.028095 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecc5db-1f9a-453b-8d60-0f5cba4920bb None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:08.028436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecc5db-1f9a-453b-8d60-0f5cba4920bb None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:08.028720 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecc5db-1f9a-453b-8d60-0f5cba4920bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:08.043823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941174f2-ae81-4c86-a1a6-a47efdf3c885 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:08.047956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-cdecc5db-1f9a-453b-8d60-0f5cba4920bb None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:08.048940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-cdecc5db-1f9a-453b-8d60-0f5cba4920bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:08.066612 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:08.090221 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffbba1-d358-44da-985d-d56f04303496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:08.091195 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffbba1-d358-44da-985d-d56f04303496 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:08.092430 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffbba1-d358-44da-985d-d56f04303496 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:08.092909 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffbba1-d358-44da-985d-d56f04303496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:08.094355 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffbba1-d358-44da-985d-d56f04303496 None admin] RBAC: Adding query filter params (role.id=9507ef97f4954ddc90305c9d0f1d3608, scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21, user.id=c4ac54adce7f46a5a9779398948a2957) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:08.094869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffbba1-d358-44da-985d-d56f04303496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:08.097238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffbba1-d358-44da-985d-d56f04303496 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:08.104713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 112/225] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:07 2022] GET /identity/v3/role_assignments?user.id=c4ac54adce7f46a5a9779398948a2957&scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21&role.id=9507ef97f4954ddc90305c9d0f1d3608 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:08.105530 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffbba1-d358-44da-985d-d56f04303496 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:08.127396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 114/226] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:08.162077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecc5db-1f9a-453b-8d60-0f5cba4920bb None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:08.169690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:08.241277 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffbba1-d358-44da-985d-d56f04303496 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:08.281477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5fdc5-988a-46fb-ab25-084586e0b81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:08.282381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5fdc5-988a-46fb-ab25-084586e0b81e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:08.282663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5fdc5-988a-46fb-ab25-084586e0b81e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:08.282937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5fdc5-988a-46fb-ab25-084586e0b81e None admin] PATH_INFO: `/v3/users/c4e2211591f54f1f9719a1b17f69f87b` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:08.284301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5fdc5-988a-46fb-ab25-084586e0b81e None admin] RBAC: Authorizing `identity:get_user(user_id=c4e2211591f54f1f9719a1b17f69f87b)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:08.285785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5fdc5-988a-46fb-ab25-084586e0b81e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:08.287842 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 113/227] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:08 2022] GET /identity/v3/users/c4e2211591f54f1f9719a1b17f69f87b => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:08.293381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5fdc5-988a-46fb-ab25-084586e0b81e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:08.400583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5fdc5-988a-46fb-ab25-084586e0b81e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:08.416040 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecc5db-1f9a-453b-8d60-0f5cba4920bb None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:08.419625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:08.437358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1039e38-dbaf-4ac6-a843-764e27090f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:08.438354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1039e38-dbaf-4ac6-a843-764e27090f9e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:08.438638 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1039e38-dbaf-4ac6-a843-764e27090f9e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:08.438912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1039e38-dbaf-4ac6-a843-764e27090f9e None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:08.440262 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1039e38-dbaf-4ac6-a843-764e27090f9e None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:08.441791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1039e38-dbaf-4ac6-a843-764e27090f9e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:08.443604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 114/228] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:08 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:08.449095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1039e38-dbaf-4ac6-a843-764e27090f9e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:08.494605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e3e5e-1342-42ea-a868-2ad05588ad1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:08.496057 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e3e5e-1342-42ea-a868-2ad05588ad1f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:08.496537 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e3e5e-1342-42ea-a868-2ad05588ad1f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:08.497002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e3e5e-1342-42ea-a868-2ad05588ad1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:08.517882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e3e5e-1342-42ea-a868-2ad05588ad1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-200e3e5e-1342-42ea-a868-2ad05588ad1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:08.527019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:08.527973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:08.528750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:08.528750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:08.528750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:08.528750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:08.528750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:08.528750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:08.528750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:08.528750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:08.528750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:08.528750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:08.528750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:08.528750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:08.531987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 115/229] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:35:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:08.541307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e3e5e-1342-42ea-a868-2ad05588ad1f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:08.564596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1039e38-dbaf-4ac6-a843-764e27090f9e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:08.568590 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:08.598970 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a89bf4-3255-4c44-b05b-b72346824139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:08.599903 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a89bf4-3255-4c44-b05b-b72346824139 None admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:08.600189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a89bf4-3255-4c44-b05b-b72346824139 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:08.603680 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a89bf4-3255-4c44-b05b-b72346824139 None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21/users/c4e2211591f54f1f9719a1b17f69f87b/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:08.606992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a89bf4-3255-4c44-b05b-b72346824139 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f7ae5221dfd4916ad28175a8e6ccf21, user_id=c4e2211591f54f1f9719a1b17f69f87b, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:08.608647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a89bf4-3255-4c44-b05b-b72346824139 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:08.681517 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 115/230] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:35:08 2022] PUT /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21/users/c4e2211591f54f1f9719a1b17f69f87b/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:35:08.696189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e3e5e-1342-42ea-a868-2ad05588ad1f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:08.752091 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de86fc1-e422-40a8-8545-6caf1dd0dfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:08.753026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de86fc1-e422-40a8-8545-6caf1dd0dfe3 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:08.753478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de86fc1-e422-40a8-8545-6caf1dd0dfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:08.753894 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de86fc1-e422-40a8-8545-6caf1dd0dfe3 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:08.754793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de86fc1-e422-40a8-8545-6caf1dd0dfe3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:08.755254 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de86fc1-e422-40a8-8545-6caf1dd0dfe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:08.756826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de86fc1-e422-40a8-8545-6caf1dd0dfe3 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:08.772303 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 116/231] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:08.778283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a89bf4-3255-4c44-b05b-b72346824139 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:08.830022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:08.906936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a89bf4-3255-4c44-b05b-b72346824139 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:08.951890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd5140-3de5-49fa-a0d2-fc0fbaab10a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:08.952693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd5140-3de5-49fa-a0d2-fc0fbaab10a3 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:08.952975 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd5140-3de5-49fa-a0d2-fc0fbaab10a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:08.953247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd5140-3de5-49fa-a0d2-fc0fbaab10a3 None admin] PATH_INFO: `/v3/users/c4e2211591f54f1f9719a1b17f69f87b` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:08.954455 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd5140-3de5-49fa-a0d2-fc0fbaab10a3 None admin] RBAC: Authorizing `identity:get_user(user_id=c4e2211591f54f1f9719a1b17f69f87b)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:08.955964 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd5140-3de5-49fa-a0d2-fc0fbaab10a3 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:08.957783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 116/232] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:08 2022] GET /identity/v3/users/c4e2211591f54f1f9719a1b17f69f87b => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:08.964615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de86fc1-e422-40a8-8545-6caf1dd0dfe3 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:09.067434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:09.094446 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de86fc1-e422-40a8-8545-6caf1dd0dfe3 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:09.141231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e3be1-6f97-42d7-ba8c-182e7fec2432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:09.142130 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e3be1-6f97-42d7-ba8c-182e7fec2432 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:09.142416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e3be1-6f97-42d7-ba8c-182e7fec2432 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:09.142694 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e3be1-6f97-42d7-ba8c-182e7fec2432 None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:09.144077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e3be1-6f97-42d7-ba8c-182e7fec2432 None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:09.145607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e3be1-6f97-42d7-ba8c-182e7fec2432 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:09.147613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 117/233] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:08 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:09.153214 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd5140-3de5-49fa-a0d2-fc0fbaab10a3 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:09.264133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd5140-3de5-49fa-a0d2-fc0fbaab10a3 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:09.282735 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:09.309138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa74b9c-443d-409e-bd27-6181f1cbd1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:09.310042 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa74b9c-443d-409e-bd27-6181f1cbd1bb None admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:09.310321 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa74b9c-443d-409e-bd27-6181f1cbd1bb None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:09.310666 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa74b9c-443d-409e-bd27-6181f1cbd1bb None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21/users/c4e2211591f54f1f9719a1b17f69f87b/roles/e97885113c774466b7432083b511fa58` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:09.315087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa74b9c-443d-409e-bd27-6181f1cbd1bb None admin] RBAC: Authorizing `identity:create_grant(project_id=6f7ae5221dfd4916ad28175a8e6ccf21, user_id=c4e2211591f54f1f9719a1b17f69f87b, role_id=e97885113c774466b7432083b511fa58)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:09.316570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa74b9c-443d-409e-bd27-6181f1cbd1bb None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:09.425354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 117/234] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:35:09 2022] PUT /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21/users/c4e2211591f54f1f9719a1b17f69f87b/roles/e97885113c774466b7432083b511fa58 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:35:10.008641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0da1f-a20c-4012-be9b-345c44b60657 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:10.009155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0da1f-a20c-4012-be9b-345c44b60657 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:10.009155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0da1f-a20c-4012-be9b-345c44b60657 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:10.010793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 118/235] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:10.016286 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac9db3-0eac-4676-b9f5-caa994aca7a8 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:10.016697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac9db3-0eac-4676-b9f5-caa994aca7a8 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:10.016871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac9db3-0eac-4676-b9f5-caa994aca7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:10.034364 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-bfac9db3-0eac-4676-b9f5-caa994aca7a8 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:10.035567 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-bfac9db3-0eac-4676-b9f5-caa994aca7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:10.105892 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 118/236] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:35:10.129523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0da1f-a20c-4012-be9b-345c44b60657 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:10.275555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0da1f-a20c-4012-be9b-345c44b60657 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:10.326016 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09560b98-ba50-4d05-bc9b-f2daabec0d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:10.327324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09560b98-ba50-4d05-bc9b-f2daabec0d68 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:10.327630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09560b98-ba50-4d05-bc9b-f2daabec0d68 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:10.327902 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09560b98-ba50-4d05-bc9b-f2daabec0d68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:10.339036 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09560b98-ba50-4d05-bc9b-f2daabec0d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-09560b98-ba50-4d05-bc9b-f2daabec0d68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:10.346795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:10.347703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:10.348499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:10.348499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:10.348499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:10.348499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:10.348499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:10.348499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:10.348499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:10.348499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:10.348499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:10.348499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:10.348499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:35:10.348499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:10.348499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 119/237] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:10.353900 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daf3d2-5a7c-4692-a1bc-220bc4867c9a None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:10.354169 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daf3d2-5a7c-4692-a1bc-220bc4867c9a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:10.354452 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daf3d2-5a7c-4692-a1bc-220bc4867c9a None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:10.355856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 119/238] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:10.357706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09560b98-ba50-4d05-bc9b-f2daabec0d68 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:10.361372 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:10.370866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335f9d8-d68d-42d9-8ce3-d9c651a9d3b8 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:10.383106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335f9d8-d68d-42d9-8ce3-d9c651a9d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:10.383106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335f9d8-d68d-42d9-8ce3-d9c651a9d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:10.400623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-d335f9d8-d68d-42d9-8ce3-d9c651a9d3b8 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:10.401825 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d335f9d8-d68d-42d9-8ce3-d9c651a9d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:10.547094 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 120/239] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:35:10.563483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09560b98-ba50-4d05-bc9b-f2daabec0d68 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:10.583988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335f9d8-d68d-42d9-8ce3-d9c651a9d3b8 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:10.600942 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f9498-f5d3-4267-9eab-65d891fc99bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:10.602423 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f9498-f5d3-4267-9eab-65d891fc99bc None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:10.602915 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f9498-f5d3-4267-9eab-65d891fc99bc None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:10.603415 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f9498-f5d3-4267-9eab-65d891fc99bc None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:10.604739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f9498-f5d3-4267-9eab-65d891fc99bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:10.605252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f9498-f5d3-4267-9eab-65d891fc99bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:10.606854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f9498-f5d3-4267-9eab-65d891fc99bc None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:10.618045 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 120/240] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:10.623971 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f9498-f5d3-4267-9eab-65d891fc99bc None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:10.655106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:10.740459 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:10.765413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335f9d8-d68d-42d9-8ce3-d9c651a9d3b8 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:10.800672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f9498-f5d3-4267-9eab-65d891fc99bc None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:10.806686 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc492b9-f477-453e-890e-5dae5fd0fead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:10.807505 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc492b9-f477-453e-890e-5dae5fd0fead None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:10.807792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc492b9-f477-453e-890e-5dae5fd0fead None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:10.808067 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc492b9-f477-453e-890e-5dae5fd0fead None admin] PATH_INFO: `/v3/domains/default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:10.809237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc492b9-f477-453e-890e-5dae5fd0fead None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:10.810766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc492b9-f477-453e-890e-5dae5fd0fead None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:10.812408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 121/241] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:10.813746 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e41a1-81ce-486c-9628-4ec676cfe8ca None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:10.814039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e41a1-81ce-486c-9628-4ec676cfe8ca None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:10.814313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e41a1-81ce-486c-9628-4ec676cfe8ca None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:10.815705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 122/242] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:10.820315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e41a1-81ce-486c-9628-4ec676cfe8ca None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:10.846561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8415-b1b5-45b9-a09e-12f83fb19425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:10.848516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8415-b1b5-45b9-a09e-12f83fb19425 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:10.849027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8415-b1b5-45b9-a09e-12f83fb19425 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:10.849737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8415-b1b5-45b9-a09e-12f83fb19425 None admin] PATH_INFO: `/v3/users/e5a52aab95fd43afbdc22122926dcff0` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:10.871386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f8415-b1b5-45b9-a09e-12f83fb19425 None admin] RBAC: Authorizing `identity:get_user(user_id=e5a52aab95fd43afbdc22122926dcff0)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:10.874488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f8415-b1b5-45b9-a09e-12f83fb19425 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:10.877344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 121/243] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:10 2022] GET /identity/v3/users/e5a52aab95fd43afbdc22122926dcff0 => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:10.882430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ef9cd-c68d-4f34-b2a2-c7baca069132 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:10.882430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ef9cd-c68d-4f34-b2a2-c7baca069132 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:10.882430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ef9cd-c68d-4f34-b2a2-c7baca069132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:10.905504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-366ef9cd-c68d-4f34-b2a2-c7baca069132 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:10.906730 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-366ef9cd-c68d-4f34-b2a2-c7baca069132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:10.943607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e41a1-81ce-486c-9628-4ec676cfe8ca None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:10.945515 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:10.979679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfcdc1-c83a-4b79-bdc9-ee7b4f4b81ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:10.980358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfcdc1-c83a-4b79-bdc9-ee7b4f4b81ba None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:10.980701 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfcdc1-c83a-4b79-bdc9-ee7b4f4b81ba None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:10.980978 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfcdc1-c83a-4b79-bdc9-ee7b4f4b81ba None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:10.981757 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfcdc1-c83a-4b79-bdc9-ee7b4f4b81ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:10.983237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfcdc1-c83a-4b79-bdc9-ee7b4f4b81ba None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:10.991716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 122/244] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:10.992758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ef9cd-c68d-4f34-b2a2-c7baca069132 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:11.051278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:11.099243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ef9cd-c68d-4f34-b2a2-c7baca069132 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:11.116025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 123/245] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:35:10 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:35:11.118826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfcdc1-c83a-4b79-bdc9-ee7b4f4b81ba None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:11.148087 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493eea90-0b1b-4fbc-871b-07bde2a88fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:11.148813 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493eea90-0b1b-4fbc-871b-07bde2a88fd1 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:11.149094 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493eea90-0b1b-4fbc-871b-07bde2a88fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:11.149363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493eea90-0b1b-4fbc-871b-07bde2a88fd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:11.279816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493eea90-0b1b-4fbc-871b-07bde2a88fd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:11.281448 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493eea90-0b1b-4fbc-871b-07bde2a88fd1 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:11.345692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:11.379197 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfcdc1-c83a-4b79-bdc9-ee7b4f4b81ba None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:11.402606 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 123/246] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:11.411125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493eea90-0b1b-4fbc-871b-07bde2a88fd1 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:11.426744 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb322-afc8-45ad-a844-65572aeb1139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:11.427575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb322-afc8-45ad-a844-65572aeb1139 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:11.428085 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb322-afc8-45ad-a844-65572aeb1139 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:11.428192 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb322-afc8-45ad-a844-65572aeb1139 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:11.440873 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbb322-afc8-45ad-a844-65572aeb1139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-ccdbb322-afc8-45ad-a844-65572aeb1139 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:11.448875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:11.449774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:11.451079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:11.451079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:11.451079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:11.451079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:11.451079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:11.451079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:11.451079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:11.451079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:11.451079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:11.451079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:11.451079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:11.451079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:11.451079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 124/247] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:11.456176 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb322-afc8-45ad-a844-65572aeb1139 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:11.477401 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:11.549103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493eea90-0b1b-4fbc-871b-07bde2a88fd1 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:11.588504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb322-afc8-45ad-a844-65572aeb1139 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:11.606700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08078bb-5f93-453e-8776-6e8d46c0853a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:11.608733 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08078bb-5f93-453e-8776-6e8d46c0853a None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:11.609241 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08078bb-5f93-453e-8776-6e8d46c0853a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:11.609713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08078bb-5f93-453e-8776-6e8d46c0853a None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:11.611910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08078bb-5f93-453e-8776-6e8d46c0853a None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:11.614298 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08078bb-5f93-453e-8776-6e8d46c0853a None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:11.616398 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 124/248] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:11 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:11.626486 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08078bb-5f93-453e-8776-6e8d46c0853a None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:11.640440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836c7cf-d8e5-4e30-bfef-6152b177d25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:11.641341 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836c7cf-d8e5-4e30-bfef-6152b177d25c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:11.641761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836c7cf-d8e5-4e30-bfef-6152b177d25c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:11.642177 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836c7cf-d8e5-4e30-bfef-6152b177d25c None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:11.643126 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836c7cf-d8e5-4e30-bfef-6152b177d25c None admin] RBAC: Adding query filter params (name=member) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:11.643629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836c7cf-d8e5-4e30-bfef-6152b177d25c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:11.645381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836c7cf-d8e5-4e30-bfef-6152b177d25c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:11.653228 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:11.656833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 125/249] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:11.662674 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836c7cf-d8e5-4e30-bfef-6152b177d25c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:11.753345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08078bb-5f93-453e-8776-6e8d46c0853a None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:11.775991 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:11.803502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50753f6-e26d-4ea0-b1f3-66052e789b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:11.803840 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50753f6-e26d-4ea0-b1f3-66052e789b2f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:11.804162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50753f6-e26d-4ea0-b1f3-66052e789b2f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:11.804353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50753f6-e26d-4ea0-b1f3-66052e789b2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:11.805292 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50753f6-e26d-4ea0-b1f3-66052e789b2f None admin] RBAC: Adding query filter params (role.id=7f99c4626bbf4a6e8f81e07dc118b598, scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21, user.id=e5a52aab95fd43afbdc22122926dcff0) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:11.805984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50753f6-e26d-4ea0-b1f3-66052e789b2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:11.807162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50753f6-e26d-4ea0-b1f3-66052e789b2f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:11.808372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836c7cf-d8e5-4e30-bfef-6152b177d25c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:11.817974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 125/250] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:11 2022] GET /identity/v3/role_assignments?user.id=e5a52aab95fd43afbdc22122926dcff0&scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21&role.id=7f99c4626bbf4a6e8f81e07dc118b598 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:11.819861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904ac43-222b-41f6-8650-f2a0a52af355 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:11.820420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904ac43-222b-41f6-8650-f2a0a52af355 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:11.820909 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904ac43-222b-41f6-8650-f2a0a52af355 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:11.822891 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 126/251] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:11.829719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b959b96-68c8-4e78-ac92-d22a7c1779fc None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:11.830338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b959b96-68c8-4e78-ac92-d22a7c1779fc None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:11.830823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b959b96-68c8-4e78-ac92-d22a7c1779fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:11.851779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-4b959b96-68c8-4e78-ac92-d22a7c1779fc None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:11.853202 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4b959b96-68c8-4e78-ac92-d22a7c1779fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:11.858722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb65c0-ed65-43b5-80ff-68505e343f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:11.859969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb65c0-ed65-43b5-80ff-68505e343f30 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:11.860424 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb65c0-ed65-43b5-80ff-68505e343f30 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:11.860843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb65c0-ed65-43b5-80ff-68505e343f30 None admin] PATH_INFO: `/v3/users/c4ac54adce7f46a5a9779398948a2957` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:11.862518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb65c0-ed65-43b5-80ff-68505e343f30 None admin] RBAC: Authorizing `identity:get_user(user_id=c4ac54adce7f46a5a9779398948a2957)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:11.864440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb65c0-ed65-43b5-80ff-68505e343f30 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:11.866948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 126/252] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:11 2022] GET /identity/v3/users/c4ac54adce7f46a5a9779398948a2957 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:11.873549 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb65c0-ed65-43b5-80ff-68505e343f30 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:11.928811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 127/253] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:35:11.964740 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b959b96-68c8-4e78-ac92-d22a7c1779fc None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:11.995120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:12.031271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb65c0-ed65-43b5-80ff-68505e343f30 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:12.137555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b959b96-68c8-4e78-ac92-d22a7c1779fc None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:12.148207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a20a13-5353-4ccc-97fa-a44b93cdef1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:12.149116 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a20a13-5353-4ccc-97fa-a44b93cdef1e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:12.149402 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a20a13-5353-4ccc-97fa-a44b93cdef1e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:12.149681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a20a13-5353-4ccc-97fa-a44b93cdef1e None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:12.156279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a20a13-5353-4ccc-97fa-a44b93cdef1e None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:12.157777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a20a13-5353-4ccc-97fa-a44b93cdef1e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:12.159583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 127/254] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:11 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:12.168497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a20a13-5353-4ccc-97fa-a44b93cdef1e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:12.198251 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2f5ca-ddde-4957-be3a-f2c9a6c2e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:12.199068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2f5ca-ddde-4957-be3a-f2c9a6c2e1f4 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:12.199353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2f5ca-ddde-4957-be3a-f2c9a6c2e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:12.199707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2f5ca-ddde-4957-be3a-f2c9a6c2e1f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:12.206614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:12.219617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2f5ca-ddde-4957-be3a-f2c9a6c2e1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-ffd2f5ca-ddde-4957-be3a-f2c9a6c2e1f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:12.227556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:12.245918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:12.246693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:12.246693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:12.246693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:12.246693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:12.246693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:12.246693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:12.246693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:12.246693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:12.246693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:12.246693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:12.246693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:35:12.246693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:12.246693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 128/255] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:35:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:35:12.246693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2f5ca-ddde-4957-be3a-f2c9a6c2e1f4 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:12.337496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a20a13-5353-4ccc-97fa-a44b93cdef1e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:12.355697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:12.384852 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2f5ca-ddde-4957-be3a-f2c9a6c2e1f4 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:12.416263 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b8808-c322-41ae-bc25-1c5b561aa29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:12.417098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b8808-c322-41ae-bc25-1c5b561aa29f None admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:12.417381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b8808-c322-41ae-bc25-1c5b561aa29f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:12.417658 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b8808-c322-41ae-bc25-1c5b561aa29f None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21/users/c4ac54adce7f46a5a9779398948a2957/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:12.424709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15aa18-97f7-41ca-bf33-53b846a9e4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:12.425750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b8808-c322-41ae-bc25-1c5b561aa29f None admin] RBAC: Authorizing `identity:create_grant(project_id=6f7ae5221dfd4916ad28175a8e6ccf21, user_id=c4ac54adce7f46a5a9779398948a2957, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:12.426011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15aa18-97f7-41ca-bf33-53b846a9e4d2 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:12.426482 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15aa18-97f7-41ca-bf33-53b846a9e4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:12.426949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15aa18-97f7-41ca-bf33-53b846a9e4d2 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:12.427278 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b8808-c322-41ae-bc25-1c5b561aa29f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:12.428136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15aa18-97f7-41ca-bf33-53b846a9e4d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:12.428655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15aa18-97f7-41ca-bf33-53b846a9e4d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:12.430437 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15aa18-97f7-41ca-bf33-53b846a9e4d2 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:12.441025 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 129/256] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:12.442771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3332e9-abbf-493a-acb8-dfabebd749df None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:12.443223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3332e9-abbf-493a-acb8-dfabebd749df None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:12.445522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3332e9-abbf-493a-acb8-dfabebd749df None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:12.445522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 130/257] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:12.450223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3332e9-abbf-493a-acb8-dfabebd749df None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:12.509309 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 128/258] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:35:12 2022] PUT /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21/users/c4ac54adce7f46a5a9779398948a2957/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:35:12.510895 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127590ee-98f0-4771-a438-d26e487b16e9 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:12.511345 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127590ee-98f0-4771-a438-d26e487b16e9 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:12.515478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127590ee-98f0-4771-a438-d26e487b16e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:12.560386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-127590ee-98f0-4771-a438-d26e487b16e9 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:12.561822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-127590ee-98f0-4771-a438-d26e487b16e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:12.575539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3332e9-abbf-493a-acb8-dfabebd749df None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:12.609786 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b05f6-0d81-4ba1-b847-e1baa4818ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:12.610687 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b05f6-0d81-4ba1-b847-e1baa4818ec7 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:12.610970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b05f6-0d81-4ba1-b847-e1baa4818ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:12.611243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b05f6-0d81-4ba1-b847-e1baa4818ec7 None admin] PATH_INFO: `/v3/users/c4e2211591f54f1f9719a1b17f69f87b` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:12.612764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b05f6-0d81-4ba1-b847-e1baa4818ec7 None admin] RBAC: Authorizing `identity:get_user(user_id=c4e2211591f54f1f9719a1b17f69f87b)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:12.614256 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b05f6-0d81-4ba1-b847-e1baa4818ec7 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:12.616163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 131/259] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:12 2022] GET /identity/v3/users/c4e2211591f54f1f9719a1b17f69f87b => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:12.621823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b05f6-0d81-4ba1-b847-e1baa4818ec7 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:12.625807 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:12.736546 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b05f6-0d81-4ba1-b847-e1baa4818ec7 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:12.767174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 129/260] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:12.781855 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1291cc6-2343-479d-971d-a4fd165826b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:12.782521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291cc6-2343-479d-971d-a4fd165826b5 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:12.782809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291cc6-2343-479d-971d-a4fd165826b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:12.783084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291cc6-2343-479d-971d-a4fd165826b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:12.820096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127590ee-98f0-4771-a438-d26e487b16e9 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:12.833397 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:12.860997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1291cc6-2343-479d-971d-a4fd165826b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:12.862865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1291cc6-2343-479d-971d-a4fd165826b5 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:12.865967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:12.986249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 132/261] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:35:12.988779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1291cc6-2343-479d-971d-a4fd165826b5 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:13.027537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127590ee-98f0-4771-a438-d26e487b16e9 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:13.085573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da478118-0027-49a9-b3a6-3f260c08659a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:13.086396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478118-0027-49a9-b3a6-3f260c08659a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:13.086680 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478118-0027-49a9-b3a6-3f260c08659a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:13.086960 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478118-0027-49a9-b3a6-3f260c08659a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:13.098277 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1291cc6-2343-479d-971d-a4fd165826b5 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:13.109238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da478118-0027-49a9-b3a6-3f260c08659a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:13.120075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-da478118-0027-49a9-b3a6-3f260c08659a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:13.125651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:13.126548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:13.127357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:13.127357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:13.127357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:13.127357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:13.127357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:13.127357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:13.127357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:13.127357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:13.127357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:13.127357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:13.127357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:13.127357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:13.127357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 130/262] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:35:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:13.136523 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da478118-0027-49a9-b3a6-3f260c08659a None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:13.144872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877d83e-d6b9-4f08-9466-33f1a1900dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:13.146456 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877d83e-d6b9-4f08-9466-33f1a1900dbd None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:13.146911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877d83e-d6b9-4f08-9466-33f1a1900dbd None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:13.157342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877d83e-d6b9-4f08-9466-33f1a1900dbd None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:13.157342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877d83e-d6b9-4f08-9466-33f1a1900dbd None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:13.157342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877d83e-d6b9-4f08-9466-33f1a1900dbd None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:13.157342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 133/263] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:12 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:13.159249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877d83e-d6b9-4f08-9466-33f1a1900dbd None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:13.208982 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:13.243388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da478118-0027-49a9-b3a6-3f260c08659a None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:13.312009 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa529d3-3007-4a9a-b86f-c67aa640c1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:13.312691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa529d3-3007-4a9a-b86f-c67aa640c1b4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:13.312971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa529d3-3007-4a9a-b86f-c67aa640c1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:13.313394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa529d3-3007-4a9a-b86f-c67aa640c1b4 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:13.314162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa529d3-3007-4a9a-b86f-c67aa640c1b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:13.314466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa529d3-3007-4a9a-b86f-c67aa640c1b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:13.315908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa529d3-3007-4a9a-b86f-c67aa640c1b4 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:13.335239 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 131/264] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:13.344521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa529d3-3007-4a9a-b86f-c67aa640c1b4 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:13.379397 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877d83e-d6b9-4f08-9466-33f1a1900dbd None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:13.449092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093bf09-a2a6-4204-934e-ff7a24746ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:13.449834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093bf09-a2a6-4204-934e-ff7a24746ba8 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:13.450126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093bf09-a2a6-4204-934e-ff7a24746ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:13.450406 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093bf09-a2a6-4204-934e-ff7a24746ba8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:13.451372 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093bf09-a2a6-4204-934e-ff7a24746ba8 None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21, user.id=c4e2211591f54f1f9719a1b17f69f87b) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:13.451711 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093bf09-a2a6-4204-934e-ff7a24746ba8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:13.453178 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093bf09-a2a6-4204-934e-ff7a24746ba8 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:13.465323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 134/265] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:13 2022] GET /identity/v3/role_assignments?user.id=c4e2211591f54f1f9719a1b17f69f87b&scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21&role.id=c5632345c9274d348669482f1f7414c8 => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:13.525636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa529d3-3007-4a9a-b86f-c67aa640c1b4 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:13.568886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:13.577674 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf30c8-894f-4d8c-b8bc-da64ca944ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:13.578564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf30c8-894f-4d8c-b8bc-da64ca944ee2 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:13.578842 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf30c8-894f-4d8c-b8bc-da64ca944ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:13.579113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf30c8-894f-4d8c-b8bc-da64ca944ee2 None admin] PATH_INFO: `/v3/users/c4e2211591f54f1f9719a1b17f69f87b` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:13.584293 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf30c8-894f-4d8c-b8bc-da64ca944ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=c4e2211591f54f1f9719a1b17f69f87b)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:13.585792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf30c8-894f-4d8c-b8bc-da64ca944ee2 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:13.587869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 132/266] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:13 2022] GET /identity/v3/users/c4e2211591f54f1f9719a1b17f69f87b => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:13.593869 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093bf09-a2a6-4204-934e-ff7a24746ba8 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:13.668920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:13.769086 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093bf09-a2a6-4204-934e-ff7a24746ba8 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:13.823853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f39ea8-b5f7-4137-b946-8fc56d70be55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:13.824747 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f39ea8-b5f7-4137-b946-8fc56d70be55 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:13.825178 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f39ea8-b5f7-4137-b946-8fc56d70be55 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:13.825617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f39ea8-b5f7-4137-b946-8fc56d70be55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:13.918511 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f39ea8-b5f7-4137-b946-8fc56d70be55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:13.920350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f39ea8-b5f7-4137-b946-8fc56d70be55 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:13.966208 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:14.046505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 135/267] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:14.056663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf30c8-894f-4d8c-b8bc-da64ca944ee2 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:14.179908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf30c8-894f-4d8c-b8bc-da64ca944ee2 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:14.219219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c5e86-69d5-480e-aaad-3f5ab82f80b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:14.220155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c5e86-69d5-480e-aaad-3f5ab82f80b3 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:14.220440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c5e86-69d5-480e-aaad-3f5ab82f80b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:14.220719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c5e86-69d5-480e-aaad-3f5ab82f80b3 None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:14.223062 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c5e86-69d5-480e-aaad-3f5ab82f80b3 None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:14.224577 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c5e86-69d5-480e-aaad-3f5ab82f80b3 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:14.226659 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 133/268] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:14 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:14.233097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f39ea8-b5f7-4137-b946-8fc56d70be55 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:14.384383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f39ea8-b5f7-4137-b946-8fc56d70be55 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:14.431086 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b67a99-368e-4d8c-b90a-df6b07cb91f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:14.432022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b67a99-368e-4d8c-b90a-df6b07cb91f0 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:14.432450 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b67a99-368e-4d8c-b90a-df6b07cb91f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:14.432896 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b67a99-368e-4d8c-b90a-df6b07cb91f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:14.433889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b67a99-368e-4d8c-b90a-df6b07cb91f0 None admin] RBAC: Adding query filter params (role.id=e97885113c774466b7432083b511fa58, scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21, user.id=c4e2211591f54f1f9719a1b17f69f87b) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:14.434346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b67a99-368e-4d8c-b90a-df6b07cb91f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:14.436575 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b67a99-368e-4d8c-b90a-df6b07cb91f0 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:14.440381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:14.451873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 136/269] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:14 2022] GET /identity/v3/role_assignments?user.id=c4e2211591f54f1f9719a1b17f69f87b&scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21&role.id=e97885113c774466b7432083b511fa58 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:14.613340 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70d0a7-e0b5-4cc7-9f5e-e69a28aeb10f None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:14.613809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70d0a7-e0b5-4cc7-9f5e-e69a28aeb10f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:14.614099 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70d0a7-e0b5-4cc7-9f5e-e69a28aeb10f None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:14.616059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 134/270] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:14.622143 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45183592-26e1-4a24-871f-bc095770e2d5 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:14.622815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45183592-26e1-4a24-871f-bc095770e2d5 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:14.623859 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45183592-26e1-4a24-871f-bc095770e2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:14.652391 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-45183592-26e1-4a24-871f-bc095770e2d5 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:14.654070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-45183592-26e1-4a24-871f-bc095770e2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:14.750911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 137/271] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:14.786652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70d0a7-e0b5-4cc7-9f5e-e69a28aeb10f None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:14.872008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:14.913414 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70d0a7-e0b5-4cc7-9f5e-e69a28aeb10f None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:14.948792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1054b7c-3a22-487c-baf3-9712235fd462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:14.949593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1054b7c-3a22-487c-baf3-9712235fd462 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:14.949880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1054b7c-3a22-487c-baf3-9712235fd462 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:14.950153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1054b7c-3a22-487c-baf3-9712235fd462 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:14.954271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1054b7c-3a22-487c-baf3-9712235fd462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:14.955784 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1054b7c-3a22-487c-baf3-9712235fd462 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:14.957208 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f7eae-a3e6-4148-ac2c-fd0b98f1802e None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:14.957499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f7eae-a3e6-4148-ac2c-fd0b98f1802e None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:14.957747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 135/272] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:14.957925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f7eae-a3e6-4148-ac2c-fd0b98f1802e None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:14.959420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 138/273] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:14.962538 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1054b7c-3a22-487c-baf3-9712235fd462 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:14.964745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175327bb-be9b-42cc-94e2-51426b0c117a None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:14.965042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175327bb-be9b-42cc-94e2-51426b0c117a None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:14.965318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175327bb-be9b-42cc-94e2-51426b0c117a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:14.985275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-175327bb-be9b-42cc-94e2-51426b0c117a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:14.986454 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-175327bb-be9b-42cc-94e2-51426b0c117a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:15.071145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 139/274] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:35:15.072660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30da8a-9426-4412-87da-f0690986775d None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:15.073065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30da8a-9426-4412-87da-f0690986775d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:15.073398 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30da8a-9426-4412-87da-f0690986775d None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:15.079343 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 140/275] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:15.080996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1054b7c-3a22-487c-baf3-9712235fd462 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:15.084999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fd685-3752-415c-8b00-7cf3e8332789 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:15.085292 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fd685-3752-415c-8b00-7cf3e8332789 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:15.085571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fd685-3752-415c-8b00-7cf3e8332789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:15.107709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-2d8fd685-3752-415c-8b00-7cf3e8332789 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:15.108978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2d8fd685-3752-415c-8b00-7cf3e8332789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:15.113905 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:15.118637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c192bb-1fff-4142-a06e-cf031fb42340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:15.119642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c192bb-1fff-4142-a06e-cf031fb42340 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:15.119642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c192bb-1fff-4142-a06e-cf031fb42340 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:15.120180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c192bb-1fff-4142-a06e-cf031fb42340 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:15.131378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c192bb-1fff-4142-a06e-cf031fb42340 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:15.131378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c192bb-1fff-4142-a06e-cf031fb42340 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:15.168490 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:15.179356 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 141/276] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:15.187650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fd685-3752-415c-8b00-7cf3e8332789 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:15.279827 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 136/277] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:35:14 2022] POST /identity/v3/users => generated 293 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:35:15.279827 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c192bb-1fff-4142-a06e-cf031fb42340 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:15.287323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fd685-3752-415c-8b00-7cf3e8332789 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:15.329467 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbc5a3-5744-4195-a757-0facdaefc902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:15.330499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbc5a3-5744-4195-a757-0facdaefc902 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:15.331029 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbc5a3-5744-4195-a757-0facdaefc902 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:15.331437 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbc5a3-5744-4195-a757-0facdaefc902 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:15.346037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbc5a3-5744-4195-a757-0facdaefc902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-c5fbc5a3-5744-4195-a757-0facdaefc902 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:15.355489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:15.356702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:15.357676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:15.357676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:15.357676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:15.357676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:15.357676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:15.357676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:15.357676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:15.357676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:15.357676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:15.357676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:15.357676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:35:15.357676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:15.360018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 142/278] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:15.366511 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbc5a3-5744-4195-a757-0facdaefc902 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:15.427054 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c192bb-1fff-4142-a06e-cf031fb42340 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:15.436294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:15.478064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699fcb6-bb70-4c8c-93b2-1785e067f12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:15.479998 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699fcb6-bb70-4c8c-93b2-1785e067f12a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:15.480554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699fcb6-bb70-4c8c-93b2-1785e067f12a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:15.481039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699fcb6-bb70-4c8c-93b2-1785e067f12a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:15.496277 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbc5a3-5744-4195-a757-0facdaefc902 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:15.496781 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699fcb6-bb70-4c8c-93b2-1785e067f12a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-2699fcb6-bb70-4c8c-93b2-1785e067f12a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:15.505664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:15.506548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:15.507331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:15.507331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:15.507331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:15.507331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:15.507331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:15.507331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:15.507331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:15.507331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:15.507331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:15.507331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:15.507331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:15.507331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:15.510092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 137/279] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:15.516689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699fcb6-bb70-4c8c-93b2-1785e067f12a None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:15.539346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9d5a3-8022-4679-888e-5ac9a1ec80b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:15.540079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9d5a3-8022-4679-888e-5ac9a1ec80b7 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:15.540363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9d5a3-8022-4679-888e-5ac9a1ec80b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:15.540639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9d5a3-8022-4679-888e-5ac9a1ec80b7 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:15.541525 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9d5a3-8022-4679-888e-5ac9a1ec80b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:15.541835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9d5a3-8022-4679-888e-5ac9a1ec80b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:15.543264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9d5a3-8022-4679-888e-5ac9a1ec80b7 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:15.553592 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 143/280] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:15.559030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9d5a3-8022-4679-888e-5ac9a1ec80b7 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:15.579254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:15.654675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699fcb6-bb70-4c8c-93b2-1785e067f12a None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:15.690449 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9d5a3-8022-4679-888e-5ac9a1ec80b7 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:15.697251 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50685cc-ef51-4ff2-8528-f2729eaead1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:15.698012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50685cc-ef51-4ff2-8528-f2729eaead1f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:15.698409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50685cc-ef51-4ff2-8528-f2729eaead1f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:15.698769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50685cc-ef51-4ff2-8528-f2729eaead1f None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:15.699630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50685cc-ef51-4ff2-8528-f2729eaead1f None admin] RBAC: Adding query filter params (name=member) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:15.700016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50685cc-ef51-4ff2-8528-f2729eaead1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:15.702410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50685cc-ef51-4ff2-8528-f2729eaead1f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:15.713424 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 138/281] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:15.719263 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50685cc-ef51-4ff2-8528-f2729eaead1f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:15.731264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47564bf3-d155-4b91-81f3-48771d45f1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:15.733145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47564bf3-d155-4b91-81f3-48771d45f1c9 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:15.733588 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47564bf3-d155-4b91-81f3-48771d45f1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:15.734015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47564bf3-d155-4b91-81f3-48771d45f1c9 None admin] PATH_INFO: `/v3/users/e5a52aab95fd43afbdc22122926dcff0` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:15.735401 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47564bf3-d155-4b91-81f3-48771d45f1c9 None admin] RBAC: Authorizing `identity:get_user(user_id=e5a52aab95fd43afbdc22122926dcff0)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:15.737049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47564bf3-d155-4b91-81f3-48771d45f1c9 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:15.739287 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 144/282] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:15 2022] GET /identity/v3/users/e5a52aab95fd43afbdc22122926dcff0 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:15.740684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:15.747291 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47564bf3-d155-4b91-81f3-48771d45f1c9 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:15.851696 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50685cc-ef51-4ff2-8528-f2729eaead1f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:15.876778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:15.878848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47564bf3-d155-4b91-81f3-48771d45f1c9 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:15.899209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef9726-e37a-4bc2-b7b8-47d6018a9824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:15.900118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef9726-e37a-4bc2-b7b8-47d6018a9824 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:15.900404 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef9726-e37a-4bc2-b7b8-47d6018a9824 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:15.900679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef9726-e37a-4bc2-b7b8-47d6018a9824 None admin] PATH_INFO: `/v3/users/3fd9624781b8448ba100cf837bc5fe91` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:15.923963 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e9a1a-a41b-4398-b6ba-83e8905a1005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:15.924405 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef9726-e37a-4bc2-b7b8-47d6018a9824 None admin] RBAC: Authorizing `identity:get_user(user_id=3fd9624781b8448ba100cf837bc5fe91)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:15.924752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e9a1a-a41b-4398-b6ba-83e8905a1005 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:15.925053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e9a1a-a41b-4398-b6ba-83e8905a1005 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:15.925384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e9a1a-a41b-4398-b6ba-83e8905a1005 None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:15.926999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef9726-e37a-4bc2-b7b8-47d6018a9824 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:15.927427 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e9a1a-a41b-4398-b6ba-83e8905a1005 None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:15.928970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e9a1a-a41b-4398-b6ba-83e8905a1005 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:15.929721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 139/283] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:15 2022] GET /identity/v3/users/3fd9624781b8448ba100cf837bc5fe91 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:15.931231 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0add3c7-1828-4901-b89f-6dfc1598841c None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:15.931759 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0add3c7-1828-4901-b89f-6dfc1598841c None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:15.932278 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0add3c7-1828-4901-b89f-6dfc1598841c None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:15.933724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 140/284] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:15.935523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 145/285] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:15 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:15.936276 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0add3c7-1828-4901-b89f-6dfc1598841c None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:15.939473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbf3bc-2443-4498-9f65-7fc5d90fe986 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:15.939722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbf3bc-2443-4498-9f65-7fc5d90fe986 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:15.939989 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbf3bc-2443-4498-9f65-7fc5d90fe986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:15.961024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-b0bbf3bc-2443-4498-9f65-7fc5d90fe986 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:15.962355 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b0bbf3bc-2443-4498-9f65-7fc5d90fe986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:16.023222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:16.057026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 146/286] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:16.058985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbf3bc-2443-4498-9f65-7fc5d90fe986 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:16.060104 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0add3c7-1828-4901-b89f-6dfc1598841c None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:16.114967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb438bc-6414-45b7-b1e8-e520c4fb6bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:16.115664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb438bc-6414-45b7-b1e8-e520c4fb6bc9 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:16.115947 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb438bc-6414-45b7-b1e8-e520c4fb6bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:16.116221 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb438bc-6414-45b7-b1e8-e520c4fb6bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:16.117047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb438bc-6414-45b7-b1e8-e520c4fb6bc9 None admin] RBAC: Adding query filter params (role.id=9507ef97f4954ddc90305c9d0f1d3608, user.id=3fd9624781b8448ba100cf837bc5fe91, scope.system=all) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:16.117371 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb438bc-6414-45b7-b1e8-e520c4fb6bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:16.118826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb438bc-6414-45b7-b1e8-e520c4fb6bc9 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:16.127087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 141/287] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 2 13:35:15 2022] GET /identity/v3/role_assignments?user.id=3fd9624781b8448ba100cf837bc5fe91&scope.system=all&role.id=9507ef97f4954ddc90305c9d0f1d3608 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:16.128288 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb438bc-6414-45b7-b1e8-e520c4fb6bc9 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:16.174456 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:16.182959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbf3bc-2443-4498-9f65-7fc5d90fe986 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:16.229912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ed12e-e10a-413b-a9b4-f5ee89b66205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:16.230832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ed12e-e10a-413b-a9b4-f5ee89b66205 None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:16.231113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ed12e-e10a-413b-a9b4-f5ee89b66205 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:16.231386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ed12e-e10a-413b-a9b4-f5ee89b66205 None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21/users/e5a52aab95fd43afbdc22122926dcff0/roles/7f99c4626bbf4a6e8f81e07dc118b598` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:16.234779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ed12e-e10a-413b-a9b4-f5ee89b66205 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f7ae5221dfd4916ad28175a8e6ccf21, user_id=e5a52aab95fd43afbdc22122926dcff0, role_id=7f99c4626bbf4a6e8f81e07dc118b598)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:16.236442 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ed12e-e10a-413b-a9b4-f5ee89b66205 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:16.280348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb438bc-6414-45b7-b1e8-e520c4fb6bc9 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:16.320364 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc13b0-7be6-4959-90a0-5606b836b73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:16.321176 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc13b0-7be6-4959-90a0-5606b836b73a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:16.321460 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc13b0-7be6-4959-90a0-5606b836b73a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:16.321734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc13b0-7be6-4959-90a0-5606b836b73a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:16.334926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc13b0-7be6-4959-90a0-5606b836b73a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:16.342580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 147/288] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:35:16 2022] PUT /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21/users/e5a52aab95fd43afbdc22122926dcff0/roles/7f99c4626bbf4a6e8f81e07dc118b598 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-0adc13b0-7be6-4959-90a0-5606b836b73a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:16.347974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:16.348933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:16.349705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:16.349705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:16.349705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:16.349705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:16.349705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:16.349705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:16.349705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:16.349705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:16.349705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:16.349705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:16.349705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:16.349705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:16.349705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 142/289] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:16.352445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ed12e-e10a-413b-a9b4-f5ee89b66205 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:16.402471 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:16.472442 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ed12e-e10a-413b-a9b4-f5ee89b66205 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:16.512970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e7a07-0212-4f95-bc2f-de13a5cbc913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:16.513699 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e7a07-0212-4f95-bc2f-de13a5cbc913 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:16.513985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e7a07-0212-4f95-bc2f-de13a5cbc913 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:16.514261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e7a07-0212-4f95-bc2f-de13a5cbc913 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:16.515041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e7a07-0212-4f95-bc2f-de13a5cbc913 None admin] RBAC: Adding query filter params (name=member) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:16.515343 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e7a07-0212-4f95-bc2f-de13a5cbc913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:16.516838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e7a07-0212-4f95-bc2f-de13a5cbc913 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:16.526684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 148/290] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:16.532150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc13b0-7be6-4959-90a0-5606b836b73a None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:16.636108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:16.645411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc13b0-7be6-4959-90a0-5606b836b73a None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:16.682281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483cefe-ede3-4e30-b456-d72ae0b55e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:16.683678 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483cefe-ede3-4e30-b456-d72ae0b55e96 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:16.684501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483cefe-ede3-4e30-b456-d72ae0b55e96 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:16.684781 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483cefe-ede3-4e30-b456-d72ae0b55e96 None admin] PATH_INFO: `/v3/users/c4ac54adce7f46a5a9779398948a2957` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:16.686238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483cefe-ede3-4e30-b456-d72ae0b55e96 None admin] RBAC: Authorizing `identity:get_user(user_id=c4ac54adce7f46a5a9779398948a2957)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:16.687789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483cefe-ede3-4e30-b456-d72ae0b55e96 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:16.689722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 143/291] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:16 2022] GET /identity/v3/users/c4ac54adce7f46a5a9779398948a2957 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:16.695347 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e7a07-0212-4f95-bc2f-de13a5cbc913 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:16.801094 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:16.812067 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e7a07-0212-4f95-bc2f-de13a5cbc913 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:16.858834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e5cc-bd93-46b8-ba22-991d63462b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:16.859523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e5cc-bd93-46b8-ba22-991d63462b2b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:16.859813 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e5cc-bd93-46b8-ba22-991d63462b2b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:16.860093 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e5cc-bd93-46b8-ba22-991d63462b2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:16.949581 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374e5cc-bd93-46b8-ba22-991d63462b2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:16.951121 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374e5cc-bd93-46b8-ba22-991d63462b2b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:17.093053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:17.097464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 149/292] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:17.102965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483cefe-ede3-4e30-b456-d72ae0b55e96 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:17.206638 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483cefe-ede3-4e30-b456-d72ae0b55e96 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:17.242802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626002a6-75d6-4318-83fe-c497a62e3883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:17.243694 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626002a6-75d6-4318-83fe-c497a62e3883 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:17.243979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626002a6-75d6-4318-83fe-c497a62e3883 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:17.244253 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626002a6-75d6-4318-83fe-c497a62e3883 None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:17.245712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626002a6-75d6-4318-83fe-c497a62e3883 None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:17.247178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626002a6-75d6-4318-83fe-c497a62e3883 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:17.249773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 144/293] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:17 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:17.255654 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e5cc-bd93-46b8-ba22-991d63462b2b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:17.383967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e5cc-bd93-46b8-ba22-991d63462b2b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:17.441523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402edb7-1805-4789-9019-59ea409543df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:17.442188 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402edb7-1805-4789-9019-59ea409543df None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:17.442474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402edb7-1805-4789-9019-59ea409543df None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:17.442755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402edb7-1805-4789-9019-59ea409543df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:17.443624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402edb7-1805-4789-9019-59ea409543df None admin] RBAC: Adding query filter params (role.id=9507ef97f4954ddc90305c9d0f1d3608, scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21, user.id=c4ac54adce7f46a5a9779398948a2957) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:17.443943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402edb7-1805-4789-9019-59ea409543df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:17.445390 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402edb7-1805-4789-9019-59ea409543df None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:17.456617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 150/294] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:17 2022] GET /identity/v3/role_assignments?user.id=c4ac54adce7f46a5a9779398948a2957&scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21&role.id=9507ef97f4954ddc90305c9d0f1d3608 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:18.091009 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095ff5f-b1c8-4378-b2d1-4d0ec8117e4d None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:18.091577 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095ff5f-b1c8-4378-b2d1-4d0ec8117e4d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:18.091577 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095ff5f-b1c8-4378-b2d1-4d0ec8117e4d None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:18.093036 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 145/295] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:18.099409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55f617-0699-4d01-a5f8-a05b6ce46ad3 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:18.099724 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55f617-0699-4d01-a5f8-a05b6ce46ad3 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:18.100007 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55f617-0699-4d01-a5f8-a05b6ce46ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:18.120210 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-da55f617-0699-4d01-a5f8-a05b6ce46ad3 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:18.121377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-da55f617-0699-4d01-a5f8-a05b6ce46ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:18.182171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:18.191020 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 151/296] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:35:18.215058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095ff5f-b1c8-4378-b2d1-4d0ec8117e4d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:18.246653 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:18.329409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095ff5f-b1c8-4378-b2d1-4d0ec8117e4d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:18.363436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4860d-50b5-4d95-bd1c-80b11bd5a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:18.364172 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4860d-50b5-4d95-bd1c-80b11bd5a7ae None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:18.364448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4860d-50b5-4d95-bd1c-80b11bd5a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:18.364713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4860d-50b5-4d95-bd1c-80b11bd5a7ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:18.375861 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4860d-50b5-4d95-bd1c-80b11bd5a7ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-e6f4860d-50b5-4d95-bd1c-80b11bd5a7ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:18.383604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:18.384473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:18.385247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:18.385247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:18.385247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:18.385247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:18.385247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:18.385247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:18.385247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:18.385247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:18.385247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:18.385247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:18.385247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:35:18.385247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:18.389617 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 146/297] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:18.392913 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55f617-0699-4d01-a5f8-a05b6ce46ad3 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:18.426804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cefc49-42b7-43ed-9973-b5f22ff14276 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:18.427099 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cefc49-42b7-43ed-9973-b5f22ff14276 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:18.427389 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cefc49-42b7-43ed-9973-b5f22ff14276 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:18.429036 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 147/298] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:18.437244 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff883-915c-4425-a447-b90f76b4f6e9 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:18.437528 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff883-915c-4425-a447-b90f76b4f6e9 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:18.437803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff883-915c-4425-a447-b90f76b4f6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:18.456465 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-99bff883-915c-4425-a447-b90f76b4f6e9 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:18.457768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-99bff883-915c-4425-a447-b90f76b4f6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:18.503013 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55f617-0699-4d01-a5f8-a05b6ce46ad3 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:18.533133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 148/299] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:18.545911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11b04d-5e4b-476d-87a9-836c05cb196d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:18.546803 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11b04d-5e4b-476d-87a9-836c05cb196d None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:18.547234 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11b04d-5e4b-476d-87a9-836c05cb196d None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:18.547687 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11b04d-5e4b-476d-87a9-836c05cb196d None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:18.548651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11b04d-5e4b-476d-87a9-836c05cb196d None admin] RBAC: Adding query filter params (name=reader) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:18.549112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11b04d-5e4b-476d-87a9-836c05cb196d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:18.550637 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11b04d-5e4b-476d-87a9-836c05cb196d None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:18.557373 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff883-915c-4425-a447-b90f76b4f6e9 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:18.560513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 152/300] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:18.568623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11b04d-5e4b-476d-87a9-836c05cb196d None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:18.578127 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:18.648631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:18.693821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11b04d-5e4b-476d-87a9-836c05cb196d None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:18.695883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff883-915c-4425-a447-b90f76b4f6e9 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:18.735161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02359976-0130-4e13-abf9-561c9dc1f07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:18.736525 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359976-0130-4e13-abf9-561c9dc1f07a None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:18.737057 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359976-0130-4e13-abf9-561c9dc1f07a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:18.737537 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359976-0130-4e13-abf9-561c9dc1f07a None admin] PATH_INFO: `/v3/users/29cad78a1e604910ab7049b45503a75a` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:18.743378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1ac1d-c551-413a-87b9-d55b382f9bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:18.744261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1ac1d-c551-413a-87b9-d55b382f9bca None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:18.744555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1ac1d-c551-413a-87b9-d55b382f9bca None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:18.744815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1ac1d-c551-413a-87b9-d55b382f9bca None admin] PATH_INFO: `/v3/domains/default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:18.746365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1ac1d-c551-413a-87b9-d55b382f9bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:18.747939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1ac1d-c551-413a-87b9-d55b382f9bca None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:18.751504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 149/301] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:18.756800 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1ac1d-c551-413a-87b9-d55b382f9bca None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:18.764749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02359976-0130-4e13-abf9-561c9dc1f07a None admin] RBAC: Authorizing `identity:get_user(user_id=29cad78a1e604910ab7049b45503a75a)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:18.766267 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02359976-0130-4e13-abf9-561c9dc1f07a None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:18.771549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 153/302] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:18 2022] GET /identity/v3/users/29cad78a1e604910ab7049b45503a75a => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:18.776965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02359976-0130-4e13-abf9-561c9dc1f07a None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:18.861594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:18.877927 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1ac1d-c551-413a-87b9-d55b382f9bca None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:18.910222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02359976-0130-4e13-abf9-561c9dc1f07a None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:18.916717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c9024-54e1-4930-a397-e129453c3f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:18.917683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c9024-54e1-4930-a397-e129453c3f70 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:18.918175 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c9024-54e1-4930-a397-e129453c3f70 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:18.918662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c9024-54e1-4930-a397-e129453c3f70 None admin] PATH_INFO: `/v3/groups` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:18.919594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c9024-54e1-4930-a397-e129453c3f70 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:18.921282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c9024-54e1-4930-a397-e129453c3f70 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:18.927197 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:18.946543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2656c8-d832-4982-afa5-199c385708d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:18.949943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2656c8-d832-4982-afa5-199c385708d6 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:18.949943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2656c8-d832-4982-afa5-199c385708d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:18.949943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2656c8-d832-4982-afa5-199c385708d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:18.949943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2656c8-d832-4982-afa5-199c385708d6 None admin] RBAC: Adding query filter params (role.id=7f99c4626bbf4a6e8f81e07dc118b598, user.id=29cad78a1e604910ab7049b45503a75a, scope.system=all) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:18.949943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2656c8-d832-4982-afa5-199c385708d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:18.950354 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2656c8-d832-4982-afa5-199c385708d6 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:18.955899 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 154/303] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 2 13:35:18 2022] GET /identity/v3/role_assignments?user.id=29cad78a1e604910ab7049b45503a75a&scope.system=all&role.id=7f99c4626bbf4a6e8f81e07dc118b598 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:18.957112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcc855-3ef7-47fb-99b2-905b9ee70610 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:18.957400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcc855-3ef7-47fb-99b2-905b9ee70610 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:18.957674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcc855-3ef7-47fb-99b2-905b9ee70610 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:18.959184 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 155/304] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:18.965079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5b971-f592-4766-875d-bffa434809ae None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:18.965502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5b971-f592-4766-875d-bffa434809ae None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:18.965810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5b971-f592-4766-875d-bffa434809ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:18.984884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-3bc5b971-f592-4766-875d-bffa434809ae None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:18.986103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3bc5b971-f592-4766-875d-bffa434809ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:19.005368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 150/305] 10.222.0.39 () {60 vars in 1134 bytes} [Thu Jun 2 13:35:18 2022] POST /identity/v3/groups => generated 229 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:35:19.080046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 156/306] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:35:19.090654 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad50a5c-c34d-4b3c-92ff-3ffbb341d30b None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:19.090968 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad50a5c-c34d-4b3c-92ff-3ffbb341d30b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:19.091219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad50a5c-c34d-4b3c-92ff-3ffbb341d30b None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:19.093134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 151/307] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:19.099215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1290f7-7187-4107-9e3a-db28f23da606 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:19.099566 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1290f7-7187-4107-9e3a-db28f23da606 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:19.099826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1290f7-7187-4107-9e3a-db28f23da606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:19.102709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad50a5c-c34d-4b3c-92ff-3ffbb341d30b None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:19.118046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-3b1290f7-7187-4107-9e3a-db28f23da606 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:19.119316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3b1290f7-7187-4107-9e3a-db28f23da606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:19.206088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 157/308] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:19.230862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1290f7-7187-4107-9e3a-db28f23da606 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:19.244522 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad50a5c-c34d-4b3c-92ff-3ffbb341d30b None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:19.294118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842fd62-9c0d-4d6b-9307-4374d1d1a1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:19.294761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:19.295315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842fd62-9c0d-4d6b-9307-4374d1d1a1f8 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:19.295653 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842fd62-9c0d-4d6b-9307-4374d1d1a1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:19.295907 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842fd62-9c0d-4d6b-9307-4374d1d1a1f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:19.313332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842fd62-9c0d-4d6b-9307-4374d1d1a1f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-b842fd62-9c0d-4d6b-9307-4374d1d1a1f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:19.323804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:19.324919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:19.326803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:19.326803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:19.326803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:19.326803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:19.326803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:19.326803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:19.326803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:19.326803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:19.326803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:19.326803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:19.326803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:19.326803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:19.326803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 152/309] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:19.332858 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842fd62-9c0d-4d6b-9307-4374d1d1a1f8 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:19.345070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:19.376366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1290f7-7187-4107-9e3a-db28f23da606 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:19.423168 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ffb9e-32c9-455e-8e71-a6a8addf6db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:19.424175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ffb9e-32c9-455e-8e71-a6a8addf6db0 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:19.424322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ffb9e-32c9-455e-8e71-a6a8addf6db0 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:19.424557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ffb9e-32c9-455e-8e71-a6a8addf6db0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:19.439300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ffb9e-32c9-455e-8e71-a6a8addf6db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-da7ffb9e-32c9-455e-8e71-a6a8addf6db0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:19.448306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:19.449247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:19.450042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:19.450042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:19.450042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:19.450042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:19.450042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:19.450042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:19.450042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:19.450042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:19.450042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:19.450042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:19.450042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:35:19.450042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:19.453112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 158/310] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:35:19.459847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ffb9e-32c9-455e-8e71-a6a8addf6db0 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:19.473447 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842fd62-9c0d-4d6b-9307-4374d1d1a1f8 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:19.510826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876b277-ab24-45c7-9adf-5e385cb11a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:19.511590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876b277-ab24-45c7-9adf-5e385cb11a56 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:19.511904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876b277-ab24-45c7-9adf-5e385cb11a56 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:19.512473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876b277-ab24-45c7-9adf-5e385cb11a56 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:19.513111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876b277-ab24-45c7-9adf-5e385cb11a56 None admin] RBAC: Adding query filter params (name=member) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:19.513419 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876b277-ab24-45c7-9adf-5e385cb11a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:19.515409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876b277-ab24-45c7-9adf-5e385cb11a56 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:19.527957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 153/311] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:19.533676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876b277-ab24-45c7-9adf-5e385cb11a56 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:19.581702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:19.585913 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ffb9e-32c9-455e-8e71-a6a8addf6db0 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:19.621944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2fcd0-0e74-4b3f-a827-aea6696859b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:19.623029 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2fcd0-0e74-4b3f-a827-aea6696859b9 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:19.623592 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2fcd0-0e74-4b3f-a827-aea6696859b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:19.624075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2fcd0-0e74-4b3f-a827-aea6696859b9 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:19.625062 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:19.625173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2fcd0-0e74-4b3f-a827-aea6696859b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:19.625811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2fcd0-0e74-4b3f-a827-aea6696859b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:19.627404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2fcd0-0e74-4b3f-a827-aea6696859b9 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:19.636898 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 159/312] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:19.643235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2fcd0-0e74-4b3f-a827-aea6696859b9 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:19.665583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876b277-ab24-45c7-9adf-5e385cb11a56 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:19.704908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096824d-47b4-4f2d-862c-e5f5ddcea65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:19.705905 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096824d-47b4-4f2d-862c-e5f5ddcea65c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:19.706148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096824d-47b4-4f2d-862c-e5f5ddcea65c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:19.706420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096824d-47b4-4f2d-862c-e5f5ddcea65c None admin] PATH_INFO: `/v3/users/3fd9624781b8448ba100cf837bc5fe91` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:19.707644 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096824d-47b4-4f2d-862c-e5f5ddcea65c None admin] RBAC: Authorizing `identity:get_user(user_id=3fd9624781b8448ba100cf837bc5fe91)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:19.709213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096824d-47b4-4f2d-862c-e5f5ddcea65c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:19.716052 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 154/313] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:19 2022] GET /identity/v3/users/3fd9624781b8448ba100cf837bc5fe91 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:19.716884 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096824d-47b4-4f2d-862c-e5f5ddcea65c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:19.754020 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2fcd0-0e74-4b3f-a827-aea6696859b9 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:19.791646 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796828f7-9a31-47fe-a2ae-15c89efdfa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:19.792792 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796828f7-9a31-47fe-a2ae-15c89efdfa38 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:19.793253 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796828f7-9a31-47fe-a2ae-15c89efdfa38 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:19.793687 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796828f7-9a31-47fe-a2ae-15c89efdfa38 None admin] PATH_INFO: `/v3/users/e5a52aab95fd43afbdc22122926dcff0` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:19.796783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796828f7-9a31-47fe-a2ae-15c89efdfa38 None admin] RBAC: Authorizing `identity:get_user(user_id=e5a52aab95fd43afbdc22122926dcff0)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:19.798562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796828f7-9a31-47fe-a2ae-15c89efdfa38 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:19.805276 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 160/314] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:19 2022] GET /identity/v3/users/e5a52aab95fd43afbdc22122926dcff0 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:19.806433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796828f7-9a31-47fe-a2ae-15c89efdfa38 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:19.825547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096824d-47b4-4f2d-862c-e5f5ddcea65c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:19.845468 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:19.865967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0c771-ae38-479a-9a3f-f52bea00cde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:19.866942 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0c771-ae38-479a-9a3f-f52bea00cde3 None admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:19.867159 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0c771-ae38-479a-9a3f-f52bea00cde3 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:19.867432 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0c771-ae38-479a-9a3f-f52bea00cde3 None admin] PATH_INFO: `/v3/system/users/3fd9624781b8448ba100cf837bc5fe91/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:19.869225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0c771-ae38-479a-9a3f-f52bea00cde3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3fd9624781b8448ba100cf837bc5fe91, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:19.870857 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0c771-ae38-479a-9a3f-f52bea00cde3 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:19.874440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:19.928768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796828f7-9a31-47fe-a2ae-15c89efdfa38 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:19.963562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81300b-4df3-4463-8b83-6c9ca9641124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:19.964217 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81300b-4df3-4463-8b83-6c9ca9641124 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:19.964502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81300b-4df3-4463-8b83-6c9ca9641124 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:19.964780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81300b-4df3-4463-8b83-6c9ca9641124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:19.979566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 155/315] 10.222.0.39 () {58 vars in 1334 bytes} [Thu Jun 2 13:35:19 2022] PUT /identity/v3/system/users/3fd9624781b8448ba100cf837bc5fe91/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:35:20.050499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81300b-4df3-4463-8b83-6c9ca9641124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:20.052249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81300b-4df3-4463-8b83-6c9ca9641124 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:20.083217 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:20.170946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 161/316] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:20.176604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0c771-ae38-479a-9a3f-f52bea00cde3 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:20.294405 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0c771-ae38-479a-9a3f-f52bea00cde3 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:20.330195 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0705b0-2e70-4149-b112-819353b4197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:20.331111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0705b0-2e70-4149-b112-819353b4197f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:20.331393 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0705b0-2e70-4149-b112-819353b4197f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:20.331683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0705b0-2e70-4149-b112-819353b4197f None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:20.332871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0705b0-2e70-4149-b112-819353b4197f None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:20.334310 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0705b0-2e70-4149-b112-819353b4197f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:20.336335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 156/317] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:20 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:20.344595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81300b-4df3-4463-8b83-6c9ca9641124 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:20.455591 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81300b-4df3-4463-8b83-6c9ca9641124 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:20.484127 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:20.492156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24984289-699d-443f-a5c3-1992468bc63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:20.492817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24984289-699d-443f-a5c3-1992468bc63f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:20.493103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24984289-699d-443f-a5c3-1992468bc63f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:20.493381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24984289-699d-443f-a5c3-1992468bc63f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:20.494217 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24984289-699d-443f-a5c3-1992468bc63f None admin] RBAC: Adding query filter params (role.id=7f99c4626bbf4a6e8f81e07dc118b598, scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21, user.id=e5a52aab95fd43afbdc22122926dcff0) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:20.494530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24984289-699d-443f-a5c3-1992468bc63f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:20.496270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24984289-699d-443f-a5c3-1992468bc63f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:20.503070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 162/318] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:20 2022] GET /identity/v3/role_assignments?user.id=e5a52aab95fd43afbdc22122926dcff0&scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21&role.id=7f99c4626bbf4a6e8f81e07dc118b598 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:21.332022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cc087-2415-438e-8444-0fa6cee27d63 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:21.332521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cc087-2415-438e-8444-0fa6cee27d63 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:21.332595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cc087-2415-438e-8444-0fa6cee27d63 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:21.333910 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 157/319] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:21.339299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19cb4e-0fef-49a9-a0eb-80355e748a4d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:21.339624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19cb4e-0fef-49a9-a0eb-80355e748a4d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:21.339901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19cb4e-0fef-49a9-a0eb-80355e748a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:21.357012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-1f19cb4e-0fef-49a9-a0eb-80355e748a4d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:21.358750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1f19cb4e-0fef-49a9-a0eb-80355e748a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:21.387112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0646de-af6b-477d-8a85-1a26188cbf90 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:21.387440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0646de-af6b-477d-8a85-1a26188cbf90 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:21.387706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0646de-af6b-477d-8a85-1a26188cbf90 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:21.389101 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 158/320] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:35:21.394099 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae807ca-e47d-447f-8f85-cdb803879e0f None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:21.394467 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae807ca-e47d-447f-8f85-cdb803879e0f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:21.394752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae807ca-e47d-447f-8f85-cdb803879e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:21.411628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-6ae807ca-e47d-447f-8f85-cdb803879e0f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:21.412822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6ae807ca-e47d-447f-8f85-cdb803879e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:21.432659 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 163/321] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:21.454870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19cb4e-0fef-49a9-a0eb-80355e748a4d None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:21.479470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:21.486349 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 159/322] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:35:21.509691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae807ca-e47d-447f-8f85-cdb803879e0f None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:21.562593 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19cb4e-0fef-49a9-a0eb-80355e748a4d None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:21.587897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:21.599837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22111137-b129-473c-85ee-1d8c81e159fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:21.600673 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22111137-b129-473c-85ee-1d8c81e159fe None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:21.600949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22111137-b129-473c-85ee-1d8c81e159fe None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:21.601289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22111137-b129-473c-85ee-1d8c81e159fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:21.611801 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22111137-b129-473c-85ee-1d8c81e159fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-22111137-b129-473c-85ee-1d8c81e159fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:21.619571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:21.620718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:21.623033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:21.623033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:21.623033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:21.623033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:21.623033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:21.623033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:21.623033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:21.623033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:21.623033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:21.623033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:21.623033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:35:21.623033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:21.623033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 164/323] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:35:21.626750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22111137-b129-473c-85ee-1d8c81e159fe None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:21.651864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae807ca-e47d-447f-8f85-cdb803879e0f None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:21.687030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2adb2-bb2b-4394-8a84-24492f6e08cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:21.687840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2adb2-bb2b-4394-8a84-24492f6e08cd None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:21.688122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2adb2-bb2b-4394-8a84-24492f6e08cd None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:21.688402 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2adb2-bb2b-4394-8a84-24492f6e08cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:21.689593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2adb2-bb2b-4394-8a84-24492f6e08cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:21.691043 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2adb2-bb2b-4394-8a84-24492f6e08cd None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:21.692694 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 160/324] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:21.698295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2adb2-bb2b-4394-8a84-24492f6e08cd None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:21.732271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22111137-b129-473c-85ee-1d8c81e159fe None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:21.764691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:21.767635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b09a85-64e9-453c-ad4c-d283ade86e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:21.768529 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b09a85-64e9-453c-ad4c-d283ade86e8b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:21.769006 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b09a85-64e9-453c-ad4c-d283ade86e8b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:21.769468 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b09a85-64e9-453c-ad4c-d283ade86e8b None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:21.770414 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b09a85-64e9-453c-ad4c-d283ade86e8b None admin] RBAC: Adding query filter params (name=reader) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:21.770720 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b09a85-64e9-453c-ad4c-d283ade86e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:21.772155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b09a85-64e9-453c-ad4c-d283ade86e8b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:21.781911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 165/325] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:21.787913 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b09a85-64e9-453c-ad4c-d283ade86e8b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:21.802466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2adb2-bb2b-4394-8a84-24492f6e08cd None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:21.839838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:21.840350 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4501c9-6def-44c1-8e39-a2e6e7c126da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:21.841036 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4501c9-6def-44c1-8e39-a2e6e7c126da None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:21.841322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4501c9-6def-44c1-8e39-a2e6e7c126da None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:21.842377 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4501c9-6def-44c1-8e39-a2e6e7c126da None admin] PATH_INFO: `/v3/groups` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:21.842870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4501c9-6def-44c1-8e39-a2e6e7c126da None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:21.844362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4501c9-6def-44c1-8e39-a2e6e7c126da None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:21.903015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b09a85-64e9-453c-ad4c-d283ade86e8b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:21.937684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf85693-a21c-4758-b371-e984d0c4c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:21.938559 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf85693-a21c-4758-b371-e984d0c4c4bc None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:21.938840 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf85693-a21c-4758-b371-e984d0c4c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:21.939114 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf85693-a21c-4758-b371-e984d0c4c4bc None admin] PATH_INFO: `/v3/users/29cad78a1e604910ab7049b45503a75a` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:21.940347 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf85693-a21c-4758-b371-e984d0c4c4bc None admin] RBAC: Authorizing `identity:get_user(user_id=29cad78a1e604910ab7049b45503a75a)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:21.941809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf85693-a21c-4758-b371-e984d0c4c4bc None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:21.943642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 166/326] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:21 2022] GET /identity/v3/users/29cad78a1e604910ab7049b45503a75a => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:21.948991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf85693-a21c-4758-b371-e984d0c4c4bc None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:21.963661 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 161/327] 10.222.0.39 () {60 vars in 1134 bytes} [Thu Jun 2 13:35:21 2022] POST /identity/v3/groups => generated 226 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:35:22.070585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf85693-a21c-4758-b371-e984d0c4c4bc None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:22.085754 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:22.109241 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5488b-309e-41fe-9c85-9290db8acb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:22.110133 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5488b-309e-41fe-9c85-9290db8acb5c None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:22.110417 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5488b-309e-41fe-9c85-9290db8acb5c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:22.110689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5488b-309e-41fe-9c85-9290db8acb5c None admin] PATH_INFO: `/v3/system/users/29cad78a1e604910ab7049b45503a75a/roles/7f99c4626bbf4a6e8f81e07dc118b598` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:22.112299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5488b-309e-41fe-9c85-9290db8acb5c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=29cad78a1e604910ab7049b45503a75a, role_id=7f99c4626bbf4a6e8f81e07dc118b598)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:22.113729 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5488b-309e-41fe-9c85-9290db8acb5c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:22.219998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 167/328] 10.222.0.39 () {58 vars in 1334 bytes} [Thu Jun 2 13:35:21 2022] PUT /identity/v3/system/users/29cad78a1e604910ab7049b45503a75a/roles/7f99c4626bbf4a6e8f81e07dc118b598 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:35:22.358202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de33ff2-b14b-4079-ae96-4c1720f5adb0 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:22.358703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de33ff2-b14b-4079-ae96-4c1720f5adb0 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:22.358703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de33ff2-b14b-4079-ae96-4c1720f5adb0 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:22.360439 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 162/329] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:22.366316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c296f47-63fa-44e7-aa08-d896afe96e89 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:22.366621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c296f47-63fa-44e7-aa08-d896afe96e89 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:22.366890 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c296f47-63fa-44e7-aa08-d896afe96e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:22.387836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-3c296f47-63fa-44e7-aa08-d896afe96e89 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:22.389653 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3c296f47-63fa-44e7-aa08-d896afe96e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:22.470523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 168/330] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:22.494259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de33ff2-b14b-4079-ae96-4c1720f5adb0 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:22.605259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de33ff2-b14b-4079-ae96-4c1720f5adb0 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:22.635543 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:22.648793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78a98c-2916-4190-9b41-da32dbebd45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:22.649607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78a98c-2916-4190-9b41-da32dbebd45a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:22.649889 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78a98c-2916-4190-9b41-da32dbebd45a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:22.651083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78a98c-2916-4190-9b41-da32dbebd45a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:22.664169 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78a98c-2916-4190-9b41-da32dbebd45a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-bd78a98c-2916-4190-9b41-da32dbebd45a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:22.672860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:22.673773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:22.674732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:22.674732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:22.674732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:22.674732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:22.674732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:22.674732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:22.674732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:22.674732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:22.674732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:22.674732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:22.674732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:22.674732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:22.674732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 163/331] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:22.680099 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c296f47-63fa-44e7-aa08-d896afe96e89 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:22.794691 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c296f47-63fa-44e7-aa08-d896afe96e89 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:22.805487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:22.837752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977725c-635b-43dc-b204-3891752c827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:22.838433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977725c-635b-43dc-b204-3891752c827d None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:22.838718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977725c-635b-43dc-b204-3891752c827d None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:22.838992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977725c-635b-43dc-b204-3891752c827d None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:22.839818 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977725c-635b-43dc-b204-3891752c827d None admin] RBAC: Adding query filter params (name=member) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:22.840124 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977725c-635b-43dc-b204-3891752c827d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:22.841534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977725c-635b-43dc-b204-3891752c827d None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:22.853869 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 169/332] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:22.859687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78a98c-2916-4190-9b41-da32dbebd45a None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:22.968105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78a98c-2916-4190-9b41-da32dbebd45a None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:23.015887 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3b118-368e-4586-83c2-0c4b239fde20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:23.016901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b118-368e-4586-83c2-0c4b239fde20 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:23.017182 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b118-368e-4586-83c2-0c4b239fde20 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:23.017452 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b118-368e-4586-83c2-0c4b239fde20 None admin] PATH_INFO: `/v3/users/3fd9624781b8448ba100cf837bc5fe91` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:23.018728 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3b118-368e-4586-83c2-0c4b239fde20 None admin] RBAC: Authorizing `identity:get_user(user_id=3fd9624781b8448ba100cf837bc5fe91)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:23.020221 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3b118-368e-4586-83c2-0c4b239fde20 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:23.022159 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 164/333] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:22 2022] GET /identity/v3/users/3fd9624781b8448ba100cf837bc5fe91 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:23.028121 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977725c-635b-43dc-b204-3891752c827d None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:23.137777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977725c-635b-43dc-b204-3891752c827d None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:23.178350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee12cbb-bfa5-4e66-aa5f-9d46e573680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:23.179013 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee12cbb-bfa5-4e66-aa5f-9d46e573680c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:23.179299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee12cbb-bfa5-4e66-aa5f-9d46e573680c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:23.179599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee12cbb-bfa5-4e66-aa5f-9d46e573680c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:23.180447 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee12cbb-bfa5-4e66-aa5f-9d46e573680c None admin] RBAC: Adding query filter params (role.id=9507ef97f4954ddc90305c9d0f1d3608, user.id=3fd9624781b8448ba100cf837bc5fe91, scope.system=all) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:23.180758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee12cbb-bfa5-4e66-aa5f-9d46e573680c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:23.182217 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee12cbb-bfa5-4e66-aa5f-9d46e573680c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:23.196529 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 170/334] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 2 13:35:23 2022] GET /identity/v3/role_assignments?user.id=3fd9624781b8448ba100cf837bc5fe91&scope.system=all&role.id=9507ef97f4954ddc90305c9d0f1d3608 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:24.575441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949bdb7-c7fe-46aa-b697-86ff19864d82 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:24.575441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949bdb7-c7fe-46aa-b697-86ff19864d82 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:24.575441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949bdb7-c7fe-46aa-b697-86ff19864d82 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:24.576580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 165/335] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:24.583066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15a6e0-dd96-417b-91f0-811e0765b8c6 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:24.583066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15a6e0-dd96-417b-91f0-811e0765b8c6 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:24.583066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15a6e0-dd96-417b-91f0-811e0765b8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:24.608910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-1f15a6e0-dd96-417b-91f0-811e0765b8c6 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:24.610436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1f15a6e0-dd96-417b-91f0-811e0765b8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:24.639499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:24.694833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 171/336] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:35:24.730959 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949bdb7-c7fe-46aa-b697-86ff19864d82 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:24.806815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:24.871156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949bdb7-c7fe-46aa-b697-86ff19864d82 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:24.887314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70671a3-eb81-4a35-bcec-aff6fc1eef33 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:24.887680 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70671a3-eb81-4a35-bcec-aff6fc1eef33 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:24.887899 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70671a3-eb81-4a35-bcec-aff6fc1eef33 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:24.889319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 172/337] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:35:24.895209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439df35-8cd6-46f8-986f-8d5de0b5cea0 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:24.895540 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439df35-8cd6-46f8-986f-8d5de0b5cea0 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:24.895827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439df35-8cd6-46f8-986f-8d5de0b5cea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:24.918943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b996f-ff3b-489a-a4a1-b0588f94c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:24.920308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b996f-ff3b-489a-a4a1-b0588f94c063 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:24.920596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b996f-ff3b-489a-a4a1-b0588f94c063 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:24.920864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b996f-ff3b-489a-a4a1-b0588f94c063 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:24.938744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-4439df35-8cd6-46f8-986f-8d5de0b5cea0 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:24.939980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4439df35-8cd6-46f8-986f-8d5de0b5cea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:24.947186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b996f-ff3b-489a-a4a1-b0588f94c063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-5e2b996f-ff3b-489a-a4a1-b0588f94c063 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:24.955328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:24.956240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:24.957022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:24.957022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:24.957022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:24.957022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:24.957022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:24.957022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:24.957022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:24.957022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:24.957022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:24.957022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:24.957022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:24.957022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:24.957022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 166/338] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:24.963524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b996f-ff3b-489a-a4a1-b0588f94c063 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:25.057762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 173/339] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:25.136126 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b996f-ff3b-489a-a4a1-b0588f94c063 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:25.140145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439df35-8cd6-46f8-986f-8d5de0b5cea0 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:25.177749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:25.220501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5d0cc-c3a7-45ef-950e-d56f90a6dddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:25.221186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5d0cc-c3a7-45ef-950e-d56f90a6dddc None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:25.221466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5d0cc-c3a7-45ef-950e-d56f90a6dddc None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:25.221741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5d0cc-c3a7-45ef-950e-d56f90a6dddc None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:25.222496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5d0cc-c3a7-45ef-950e-d56f90a6dddc None admin] RBAC: Adding query filter params (name=member) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:25.222800 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5d0cc-c3a7-45ef-950e-d56f90a6dddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:25.224610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5d0cc-c3a7-45ef-950e-d56f90a6dddc None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:25.237747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 167/340] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:25.243566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5d0cc-c3a7-45ef-950e-d56f90a6dddc None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:25.307081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:25.337556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439df35-8cd6-46f8-986f-8d5de0b5cea0 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:25.396187 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5d0cc-c3a7-45ef-950e-d56f90a6dddc None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:25.435938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05daabb1-31c5-422b-b44a-5a5f689aa8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:25.436838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daabb1-31c5-422b-b44a-5a5f689aa8f9 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:25.437079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60028c-baa0-4b64-83f2-e8806c2d7653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:25.437447 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daabb1-31c5-422b-b44a-5a5f689aa8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:25.437855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daabb1-31c5-422b-b44a-5a5f689aa8f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:25.438156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60028c-baa0-4b64-83f2-e8806c2d7653 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:25.438531 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60028c-baa0-4b64-83f2-e8806c2d7653 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:25.438998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60028c-baa0-4b64-83f2-e8806c2d7653 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:25.468104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60028c-baa0-4b64-83f2-e8806c2d7653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-7e60028c-baa0-4b64-83f2-e8806c2d7653 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:25.476073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:25.476985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:25.477764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:25.477764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:25.477764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:25.477764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:25.477764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:25.477764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:25.477764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:25.477764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:25.477764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:25.477764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:25.477764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:35:25.477764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:25.477764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 174/341] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:25.484186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60028c-baa0-4b64-83f2-e8806c2d7653 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:25.502413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:25.519503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05daabb1-31c5-422b-b44a-5a5f689aa8f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:25.521220 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05daabb1-31c5-422b-b44a-5a5f689aa8f9 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:25.634971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 168/342] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:25.637010 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca69002-eec5-4ff5-8813-a815987cf17e None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:25.637466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca69002-eec5-4ff5-8813-a815987cf17e None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:25.637879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca69002-eec5-4ff5-8813-a815987cf17e None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:25.645305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 169/343] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:25.646438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca69002-eec5-4ff5-8813-a815987cf17e None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:25.717508 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60028c-baa0-4b64-83f2-e8806c2d7653 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:25.736131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:25.763539 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca69002-eec5-4ff5-8813-a815987cf17e None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:25.798976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeb2ba-53cc-425a-b7da-845a301ba686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:25.799956 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeb2ba-53cc-425a-b7da-845a301ba686 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:25.800235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeb2ba-53cc-425a-b7da-845a301ba686 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:25.800585 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeb2ba-53cc-425a-b7da-845a301ba686 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:25.801806 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeb2ba-53cc-425a-b7da-845a301ba686 None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:25.803268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeb2ba-53cc-425a-b7da-845a301ba686 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:25.805196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 170/344] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:25 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:25.806207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c7b46-c795-4f13-bab1-28ac6f166b0d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:25.806488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c7b46-c795-4f13-bab1-28ac6f166b0d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:25.806757 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c7b46-c795-4f13-bab1-28ac6f166b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:25.807519 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8a535-d2eb-4951-b32d-5de9e0362d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:25.808430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a535-d2eb-4951-b32d-5de9e0362d7f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:25.808910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a535-d2eb-4951-b32d-5de9e0362d7f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:25.809400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a535-d2eb-4951-b32d-5de9e0362d7f None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:25.810495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8a535-d2eb-4951-b32d-5de9e0362d7f None admin] RBAC: Adding query filter params (name=reader) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:25.815484 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8a535-d2eb-4951-b32d-5de9e0362d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:25.817331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8a535-d2eb-4951-b32d-5de9e0362d7f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:25.831200 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-172c7b46-c795-4f13-bab1-28ac6f166b0d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:25.832454 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-172c7b46-c795-4f13-bab1-28ac6f166b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:25.835635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 175/345] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:25.836764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8a535-d2eb-4951-b32d-5de9e0362d7f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:25.856270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:25.923384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 171/346] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:25.925140 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c7b46-c795-4f13-bab1-28ac6f166b0d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:26.022809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:26.040279 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8a535-d2eb-4951-b32d-5de9e0362d7f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:26.049192 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c7b46-c795-4f13-bab1-28ac6f166b0d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:26.089841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc332dd1-175d-4341-8655-6978104424c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:26.090896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc332dd1-175d-4341-8655-6978104424c3 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:26.091174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc332dd1-175d-4341-8655-6978104424c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:26.091477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc332dd1-175d-4341-8655-6978104424c3 None admin] PATH_INFO: `/v3/users/29cad78a1e604910ab7049b45503a75a` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:26.092924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc332dd1-175d-4341-8655-6978104424c3 None admin] RBAC: Authorizing `identity:get_user(user_id=29cad78a1e604910ab7049b45503a75a)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:26.094396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc332dd1-175d-4341-8655-6978104424c3 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:26.096548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 172/347] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:35:25 2022] GET /identity/v3/users/29cad78a1e604910ab7049b45503a75a => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:26.097846 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc332dd1-175d-4341-8655-6978104424c3 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:26.101325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf21f19-96e5-43c2-8f7e-da81531cf867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:26.102360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf21f19-96e5-43c2-8f7e-da81531cf867 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:26.102644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf21f19-96e5-43c2-8f7e-da81531cf867 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:26.102997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf21f19-96e5-43c2-8f7e-da81531cf867 None admin] PATH_INFO: `/v3/groups/40aec1b78195450d924ce47a537a831c` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:26.116554 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf21f19-96e5-43c2-8f7e-da81531cf867 None admin] RBAC: Authorizing `identity:get_group(group_id=40aec1b78195450d924ce47a537a831c)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:26.118195 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf21f19-96e5-43c2-8f7e-da81531cf867 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:26.120711 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 176/348] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:25 2022] GET /identity/v3/groups/40aec1b78195450d924ce47a537a831c => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:26.121549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf21f19-96e5-43c2-8f7e-da81531cf867 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:26.279728 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:26.322467 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc332dd1-175d-4341-8655-6978104424c3 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:26.370707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf21f19-96e5-43c2-8f7e-da81531cf867 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:26.398381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6310db-2b8c-4b9d-ba73-e746cbc3def5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:26.399215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6310db-2b8c-4b9d-ba73-e746cbc3def5 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:26.399521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6310db-2b8c-4b9d-ba73-e746cbc3def5 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:26.399801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6310db-2b8c-4b9d-ba73-e746cbc3def5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:26.425834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6310db-2b8c-4b9d-ba73-e746cbc3def5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-fd6310db-2b8c-4b9d-ba73-e746cbc3def5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:26.434428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:26.435470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:26.436809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:26.436809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:26.436809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:26.436809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:26.436809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:26.436809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:26.436809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:26.436809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:26.436809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:26.436809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:26.436809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:26.436809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:26.440597 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 173/349] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:35:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:26.446258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6310db-2b8c-4b9d-ba73-e746cbc3def5 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:26.451949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:26.452376 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb1321-654a-458c-90fe-8f1427011764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:26.453060 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1321-654a-458c-90fe-8f1427011764 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:26.453346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1321-654a-458c-90fe-8f1427011764 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:26.453624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1321-654a-458c-90fe-8f1427011764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:26.454484 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb1321-654a-458c-90fe-8f1427011764 None admin] RBAC: Adding query filter params (role.id=7f99c4626bbf4a6e8f81e07dc118b598, user.id=29cad78a1e604910ab7049b45503a75a, scope.system=all) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:26.454800 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb1321-654a-458c-90fe-8f1427011764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:26.456311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb1321-654a-458c-90fe-8f1427011764 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:26.482612 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 177/350] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 2 13:35:26 2022] GET /identity/v3/role_assignments?user.id=29cad78a1e604910ab7049b45503a75a&scope.system=all&role.id=7f99c4626bbf4a6e8f81e07dc118b598 => generated 510 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:26.483499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb1321-654a-458c-90fe-8f1427011764 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:26.653460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb1321-654a-458c-90fe-8f1427011764 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:26.664592 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6310db-2b8c-4b9d-ba73-e746cbc3def5 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:26.720348 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:26.734635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a6a38-3beb-438e-85e1-3cf1dbd429bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:26.735325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a6a38-3beb-438e-85e1-3cf1dbd429bc None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:26.736214 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a6a38-3beb-438e-85e1-3cf1dbd429bc None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:26.736214 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a6a38-3beb-438e-85e1-3cf1dbd429bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:26.741089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a6a38-3beb-438e-85e1-3cf1dbd429bc None admin] RBAC: Adding query filter params (group.id=40aec1b78195450d924ce47a537a831c, role.id=9507ef97f4954ddc90305c9d0f1d3608, scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:26.741089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a6a38-3beb-438e-85e1-3cf1dbd429bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:26.741089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a6a38-3beb-438e-85e1-3cf1dbd429bc None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:26.741355 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946d1a5-0569-4f70-a635-c781b5bb2841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:26.741355 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946d1a5-0569-4f70-a635-c781b5bb2841 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:26.741355 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946d1a5-0569-4f70-a635-c781b5bb2841 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:26.741355 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946d1a5-0569-4f70-a635-c781b5bb2841 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:26.742271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946d1a5-0569-4f70-a635-c781b5bb2841 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:26.742746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946d1a5-0569-4f70-a635-c781b5bb2841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:26.744456 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946d1a5-0569-4f70-a635-c781b5bb2841 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:26.752895 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 174/351] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 2 13:35:26 2022] GET /identity/v3/role_assignments?group.id=40aec1b78195450d924ce47a537a831c&scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f&role.id=9507ef97f4954ddc90305c9d0f1d3608 => generated 260 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:26.754424 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08498450-8f57-45d1-bf47-7a0157a3e14a None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:26.754618 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08498450-8f57-45d1-bf47-7a0157a3e14a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:26.754862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08498450-8f57-45d1-bf47-7a0157a3e14a None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:26.756604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 175/352] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:26.757549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 178/353] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:26.764342 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cae58-aac0-43d8-8547-8e9dff52681d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:26.764682 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cae58-aac0-43d8-8547-8e9dff52681d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:26.764883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cae58-aac0-43d8-8547-8e9dff52681d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:26.768937 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946d1a5-0569-4f70-a635-c781b5bb2841 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:26.799051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-ff0cae58-aac0-43d8-8547-8e9dff52681d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:26.800451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ff0cae58-aac0-43d8-8547-8e9dff52681d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:26.978687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:26.989290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 176/354] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:27.024949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946d1a5-0569-4f70-a635-c781b5bb2841 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:27.030039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cae58-aac0-43d8-8547-8e9dff52681d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:27.104811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93684b-eeea-462c-be0e-acfa182e722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:27.105491 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93684b-eeea-462c-be0e-acfa182e722e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:27.105774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93684b-eeea-462c-be0e-acfa182e722e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:27.106048 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93684b-eeea-462c-be0e-acfa182e722e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:27.205227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cae58-aac0-43d8-8547-8e9dff52681d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:27.237105 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:27.262528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93684b-eeea-462c-be0e-acfa182e722e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:27.264800 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93684b-eeea-462c-be0e-acfa182e722e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:27.276300 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39b33f-1e09-475b-aea1-526aab9fac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:27.277222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39b33f-1e09-475b-aea1-526aab9fac61 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:27.277516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39b33f-1e09-475b-aea1-526aab9fac61 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:27.277847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39b33f-1e09-475b-aea1-526aab9fac61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:27.307894 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39b33f-1e09-475b-aea1-526aab9fac61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-6f39b33f-1e09-475b-aea1-526aab9fac61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:27.316365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:27.317305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:27.318080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:27.318080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:27.318080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:27.318080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:27.318080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:27.318080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:27.318080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:27.318080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:27.318080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:27.318080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:27.318080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:27.318080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:27.324368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 177/355] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:35:27.326582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bd296-9637-4dc1-8c16-bb729346b17d None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:27.327199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bd296-9637-4dc1-8c16-bb729346b17d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:27.327683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bd296-9637-4dc1-8c16-bb729346b17d None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:27.329359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 178/356] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:27.330856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bd296-9637-4dc1-8c16-bb729346b17d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:27.398270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 179/357] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:35:27.399627 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f5c41-16de-42f7-ae61-45c16b5ad8bb None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:27.400069 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f5c41-16de-42f7-ae61-45c16b5ad8bb None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:27.400364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f5c41-16de-42f7-ae61-45c16b5ad8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:27.423235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-234f5c41-16de-42f7-ae61-45c16b5ad8bb None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:27.424515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-234f5c41-16de-42f7-ae61-45c16b5ad8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:27.431087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:27.497048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bd296-9637-4dc1-8c16-bb729346b17d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:27.525087 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 180/358] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:27.526883 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1816e63-8137-4d0e-93b1-d8688a09a35f None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:27.527365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1816e63-8137-4d0e-93b1-d8688a09a35f None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:27.527861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1816e63-8137-4d0e-93b1-d8688a09a35f None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:27.529894 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 181/359] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:27.530768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1816e63-8137-4d0e-93b1-d8688a09a35f None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:27.558131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0e83f-4121-4ab1-be72-67f602ce8854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:27.558936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0e83f-4121-4ab1-be72-67f602ce8854 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:27.559424 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0e83f-4121-4ab1-be72-67f602ce8854 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:27.561730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0e83f-4121-4ab1-be72-67f602ce8854 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:27.563045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0e83f-4121-4ab1-be72-67f602ce8854 None admin] RBAC: Adding query filter params (name=member) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:27.564482 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0e83f-4121-4ab1-be72-67f602ce8854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:27.565718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0e83f-4121-4ab1-be72-67f602ce8854 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:27.576430 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 179/360] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:27.577884 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28ffa-4fd0-41c1-9f96-d32a9b363c47 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:27.578185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28ffa-4fd0-41c1-9f96-d32a9b363c47 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:27.578465 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28ffa-4fd0-41c1-9f96-d32a9b363c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:27.580138 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:27.599910 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-4ae28ffa-4fd0-41c1-9f96-d32a9b363c47 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:27.602858 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4ae28ffa-4fd0-41c1-9f96-d32a9b363c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:27.690898 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 180/361] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:27.698566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae28ffa-4fd0-41c1-9f96-d32a9b363c47 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:27.708257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1816e63-8137-4d0e-93b1-d8688a09a35f None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:27.761667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c5cf8-e2bb-45e2-a463-5315e92ae11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:27.763088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c5cf8-e2bb-45e2-a463-5315e92ae11f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:27.763377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c5cf8-e2bb-45e2-a463-5315e92ae11f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:27.764220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c5cf8-e2bb-45e2-a463-5315e92ae11f None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:27.765834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c5cf8-e2bb-45e2-a463-5315e92ae11f None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:27.770421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c5cf8-e2bb-45e2-a463-5315e92ae11f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:27.770421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 182/362] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:27 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:27.772098 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c5cf8-e2bb-45e2-a463-5315e92ae11f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:27.772961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:27.852553 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae28ffa-4fd0-41c1-9f96-d32a9b363c47 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:27.897435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344923c1-91aa-454d-bc9b-ff4d1acf5895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:27.897795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:27.898491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344923c1-91aa-454d-bc9b-ff4d1acf5895 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:27.898768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344923c1-91aa-454d-bc9b-ff4d1acf5895 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:27.899043 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344923c1-91aa-454d-bc9b-ff4d1acf5895 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:27.906354 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c5cf8-e2bb-45e2-a463-5315e92ae11f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:27.916478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344923c1-91aa-454d-bc9b-ff4d1acf5895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-344923c1-91aa-454d-bc9b-ff4d1acf5895 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:27.928381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:27.929330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:27.930110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:27.930110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:27.930110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:27.930110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:27.930110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:27.930110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:27.930110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:27.930110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:27.930110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:27.930110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:27.930110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:27.930110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:27.936175 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 181/363] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:35:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:27.937404 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344923c1-91aa-454d-bc9b-ff4d1acf5895 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:27.951831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5856d-e51a-477c-9b11-4bbcd1b18c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:27.951831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5856d-e51a-477c-9b11-4bbcd1b18c95 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:27.951831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5856d-e51a-477c-9b11-4bbcd1b18c95 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:27.951831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5856d-e51a-477c-9b11-4bbcd1b18c95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:28.049647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5856d-e51a-477c-9b11-4bbcd1b18c95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:28.050572 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5856d-e51a-477c-9b11-4bbcd1b18c95 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:28.064312 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344923c1-91aa-454d-bc9b-ff4d1acf5895 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:28.075544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:28.114996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43540a-46f4-4a33-a390-2dd6261cd218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:28.116422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43540a-46f4-4a33-a390-2dd6261cd218 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:28.116422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43540a-46f4-4a33-a390-2dd6261cd218 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:28.116675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43540a-46f4-4a33-a390-2dd6261cd218 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:28.133674 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43540a-46f4-4a33-a390-2dd6261cd218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-eb43540a-46f4-4a33-a390-2dd6261cd218 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:28.142102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:28.143039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:28.143888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:28.143888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:28.143888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:28.143888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:28.143888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:28.143888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:28.143888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:28.143888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:28.143888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:28.143888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:28.143888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:35:28.143888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:28.148207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 182/364] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:35:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:28.149190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43540a-46f4-4a33-a390-2dd6261cd218 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:28.179399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:28.195244 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 183/365] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:28.196690 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5856d-e51a-477c-9b11-4bbcd1b18c95 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:28.313248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43540a-46f4-4a33-a390-2dd6261cd218 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:28.361942 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11844b9-b35c-4b84-b9fb-81b0ada9af40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:28.363088 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11844b9-b35c-4b84-b9fb-81b0ada9af40 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:28.363822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11844b9-b35c-4b84-b9fb-81b0ada9af40 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:28.364111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11844b9-b35c-4b84-b9fb-81b0ada9af40 None admin] PATH_INFO: `/v3/groups/40aec1b78195450d924ce47a537a831c` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:28.365407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11844b9-b35c-4b84-b9fb-81b0ada9af40 None admin] RBAC: Authorizing `identity:get_group(group_id=40aec1b78195450d924ce47a537a831c)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:28.366901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11844b9-b35c-4b84-b9fb-81b0ada9af40 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:28.371418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 183/366] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:28 2022] GET /identity/v3/groups/40aec1b78195450d924ce47a537a831c => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:28.371418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11844b9-b35c-4b84-b9fb-81b0ada9af40 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:28.382558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5856d-e51a-477c-9b11-4bbcd1b18c95 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:28.431727 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:28.446191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18c28b-7ba0-4abd-ab2c-eb9871accae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:28.450614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18c28b-7ba0-4abd-ab2c-eb9871accae1 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:28.450614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18c28b-7ba0-4abd-ab2c-eb9871accae1 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:28.450614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18c28b-7ba0-4abd-ab2c-eb9871accae1 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:28.450614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18c28b-7ba0-4abd-ab2c-eb9871accae1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:28.450912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18c28b-7ba0-4abd-ab2c-eb9871accae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:28.454537 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18c28b-7ba0-4abd-ab2c-eb9871accae1 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:28.467815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 184/367] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:28.468702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18c28b-7ba0-4abd-ab2c-eb9871accae1 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:28.533962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11844b9-b35c-4b84-b9fb-81b0ada9af40 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:28.551797 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:28.614752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40400d9-9bf8-427b-a592-499148c693b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:28.615808 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40400d9-9bf8-427b-a592-499148c693b6 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:28.616323 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40400d9-9bf8-427b-a592-499148c693b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:28.616833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40400d9-9bf8-427b-a592-499148c693b6 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:28.618512 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40400d9-9bf8-427b-a592-499148c693b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:28.619901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40400d9-9bf8-427b-a592-499148c693b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:28.623608 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40400d9-9bf8-427b-a592-499148c693b6 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:28.639922 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18c28b-7ba0-4abd-ab2c-eb9871accae1 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:28.641711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 184/368] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:28.642926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40400d9-9bf8-427b-a592-499148c693b6 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:28.689574 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b53f6-3956-4ad0-8458-7f9c9a7bb10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:28.690467 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b53f6-3956-4ad0-8458-7f9c9a7bb10e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:28.690761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b53f6-3956-4ad0-8458-7f9c9a7bb10e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:28.691028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b53f6-3956-4ad0-8458-7f9c9a7bb10e None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:28.696338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b53f6-3956-4ad0-8458-7f9c9a7bb10e None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:28.696338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b53f6-3956-4ad0-8458-7f9c9a7bb10e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:28.696954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 185/369] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:28 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:28.697756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b53f6-3956-4ad0-8458-7f9c9a7bb10e None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:28.786495 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:28.791136 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40400d9-9bf8-427b-a592-499148c693b6 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:28.850790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f316b96-9986-40e4-b8d6-1a69ea16e2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:28.851930 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f316b96-9986-40e4-b8d6-1a69ea16e2df None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:28.852424 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f316b96-9986-40e4-b8d6-1a69ea16e2df None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:28.852924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f316b96-9986-40e4-b8d6-1a69ea16e2df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:28.853242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b53f6-3956-4ad0-8458-7f9c9a7bb10e None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:28.854566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f316b96-9986-40e4-b8d6-1a69ea16e2df None admin] RBAC: Adding query filter params (group.id=40aec1b78195450d924ce47a537a831c, role.id=e97885113c774466b7432083b511fa58, scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:28.855219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f316b96-9986-40e4-b8d6-1a69ea16e2df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:28.856985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f316b96-9986-40e4-b8d6-1a69ea16e2df None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:28.865624 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 185/370] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 2 13:35:28 2022] GET /identity/v3/role_assignments?group.id=40aec1b78195450d924ce47a537a831c&scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f&role.id=e97885113c774466b7432083b511fa58 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:28.866816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f316b96-9986-40e4-b8d6-1a69ea16e2df None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:28.895655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:28.915396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7645f-bec1-4f46-9be8-db7d8bb30257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:28.916530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7645f-bec1-4f46-9be8-db7d8bb30257 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:28.917145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7645f-bec1-4f46-9be8-db7d8bb30257 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:28.917657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7645f-bec1-4f46-9be8-db7d8bb30257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:29.016758 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f316b96-9986-40e4-b8d6-1a69ea16e2df None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:29.052586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7645f-bec1-4f46-9be8-db7d8bb30257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:29.054642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7645f-bec1-4f46-9be8-db7d8bb30257 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:29.082915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140f4ca-7ff1-4dff-a5b1-22a3dac5803e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:29.083660 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f4ca-7ff1-4dff-a5b1-22a3dac5803e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:29.083943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f4ca-7ff1-4dff-a5b1-22a3dac5803e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:29.084216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f4ca-7ff1-4dff-a5b1-22a3dac5803e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:29.129567 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:29.181090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 186/371] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:29.181724 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7645f-bec1-4f46-9be8-db7d8bb30257 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:29.183898 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140f4ca-7ff1-4dff-a5b1-22a3dac5803e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:29.185734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140f4ca-7ff1-4dff-a5b1-22a3dac5803e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:29.205565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:29.298642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7645f-bec1-4f46-9be8-db7d8bb30257 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:29.309138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 186/372] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:29.310281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140f4ca-7ff1-4dff-a5b1-22a3dac5803e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:29.348805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e064b8d-c6b3-472b-987b-afac56a5c24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:29.349840 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e064b8d-c6b3-472b-987b-afac56a5c24a None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:29.350347 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e064b8d-c6b3-472b-987b-afac56a5c24a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:29.350819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e064b8d-c6b3-472b-987b-afac56a5c24a None admin] PATH_INFO: `/v3/groups/40aec1b78195450d924ce47a537a831c` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:29.352577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e064b8d-c6b3-472b-987b-afac56a5c24a None admin] RBAC: Authorizing `identity:get_group(group_id=40aec1b78195450d924ce47a537a831c)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:29.354305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e064b8d-c6b3-472b-987b-afac56a5c24a None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:29.356337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 187/373] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:29 2022] GET /identity/v3/groups/40aec1b78195450d924ce47a537a831c => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:29.357390 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e064b8d-c6b3-472b-987b-afac56a5c24a None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:29.392912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:29.445672 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140f4ca-7ff1-4dff-a5b1-22a3dac5803e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:29.468960 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:29.495420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e064b8d-c6b3-472b-987b-afac56a5c24a None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:29.520176 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4dfe7-ea94-4743-896e-945a02812c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:29.521061 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4dfe7-ea94-4743-896e-945a02812c9d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:29.521344 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4dfe7-ea94-4743-896e-945a02812c9d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:29.521623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4dfe7-ea94-4743-896e-945a02812c9d None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:29.522997 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4dfe7-ea94-4743-896e-945a02812c9d None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:29.524543 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4dfe7-ea94-4743-896e-945a02812c9d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:29.526390 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 187/374] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:29 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:29.527761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948b142-593a-4f70-87c0-b4078d2bb8da None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:29.528132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948b142-593a-4f70-87c0-b4078d2bb8da None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:29.528413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948b142-593a-4f70-87c0-b4078d2bb8da None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:29.534577 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 188/375] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:29.535813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948b142-593a-4f70-87c0-b4078d2bb8da None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:29.570093 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd4842-7c4b-4d7b-a120-a3c1401e4f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:29.571081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd4842-7c4b-4d7b-a120-a3c1401e4f1e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:29.571369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd4842-7c4b-4d7b-a120-a3c1401e4f1e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:29.571678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd4842-7c4b-4d7b-a120-a3c1401e4f1e None admin] PATH_INFO: `/v3/projects/dbf6a4ee0a34470ea6e2b9b95f130787` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:29.573422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd4842-7c4b-4d7b-a120-a3c1401e4f1e None admin] RBAC: Authorizing `identity:get_project(project_id=dbf6a4ee0a34470ea6e2b9b95f130787)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:29.574491 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd4842-7c4b-4d7b-a120-a3c1401e4f1e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:29.577893 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 188/376] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:29 2022] GET /identity/v3/projects/dbf6a4ee0a34470ea6e2b9b95f130787 => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:29.577893 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd4842-7c4b-4d7b-a120-a3c1401e4f1e None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:29.695628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948b142-593a-4f70-87c0-b4078d2bb8da None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:29.708707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd4842-7c4b-4d7b-a120-a3c1401e4f1e None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:29.739850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:29.746253 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44104a-8fd0-4b42-85db-2d6ceb418d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:29.746918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44104a-8fd0-4b42-85db-2d6ceb418d56 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:29.747199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44104a-8fd0-4b42-85db-2d6ceb418d56 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:29.747508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44104a-8fd0-4b42-85db-2d6ceb418d56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:29.748948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44104a-8fd0-4b42-85db-2d6ceb418d56 None admin] RBAC: Adding query filter params (group.id=40aec1b78195450d924ce47a537a831c, role.id=9507ef97f4954ddc90305c9d0f1d3608, scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:29.749268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44104a-8fd0-4b42-85db-2d6ceb418d56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:29.750705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44104a-8fd0-4b42-85db-2d6ceb418d56 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:29.756446 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 189/377] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 2 13:35:29 2022] GET /identity/v3/role_assignments?group.id=40aec1b78195450d924ce47a537a831c&scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21&role.id=9507ef97f4954ddc90305c9d0f1d3608 => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:29.757640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d53d19-a8d3-4a7b-a741-7de6e7cff379 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:29.757938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d53d19-a8d3-4a7b-a741-7de6e7cff379 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:29.758211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d53d19-a8d3-4a7b-a741-7de6e7cff379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:29.764827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cc097-7441-484b-9595-df15153f5d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:29.765704 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cc097-7441-484b-9595-df15153f5d72 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:29.766044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cc097-7441-484b-9595-df15153f5d72 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:29.766403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cc097-7441-484b-9595-df15153f5d72 None admin] PATH_INFO: `/v3/groups/40aec1b78195450d924ce47a537a831c` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:29.767890 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cc097-7441-484b-9595-df15153f5d72 None admin] RBAC: Authorizing `identity:get_group(group_id=40aec1b78195450d924ce47a537a831c)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:29.769462 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cc097-7441-484b-9595-df15153f5d72 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:29.771284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 189/378] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:29 2022] GET /identity/v3/groups/40aec1b78195450d924ce47a537a831c => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:29.772252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cc097-7441-484b-9595-df15153f5d72 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:29.778654 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-96d53d19-a8d3-4a7b-a741-7de6e7cff379 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:29.780294 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-96d53d19-a8d3-4a7b-a741-7de6e7cff379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:29.803484 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:29.891930 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 190/379] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:29.894342 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d53d19-a8d3-4a7b-a741-7de6e7cff379 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:29.918788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cc097-7441-484b-9595-df15153f5d72 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:29.974610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf0178-5d90-46dd-953b-6546d73e34d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:29.975398 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf0178-5d90-46dd-953b-6546d73e34d1 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:29.975706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf0178-5d90-46dd-953b-6546d73e34d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:29.975981 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf0178-5d90-46dd-953b-6546d73e34d1 None admin] PATH_INFO: `/v3/groups/c281fcb301af42d7859337ed102c29e6` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:29.981175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf0178-5d90-46dd-953b-6546d73e34d1 None admin] RBAC: Authorizing `identity:get_group(group_id=c281fcb301af42d7859337ed102c29e6)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:29.983156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf0178-5d90-46dd-953b-6546d73e34d1 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:29.984852 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 190/380] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:29 2022] GET /identity/v3/groups/c281fcb301af42d7859337ed102c29e6 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:29.985690 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf0178-5d90-46dd-953b-6546d73e34d1 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:30.036238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d53d19-a8d3-4a7b-a741-7de6e7cff379 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:30.072332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:30.089398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2f34c-d5a5-4e86-a168-23e7f9ceec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:30.090413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2f34c-d5a5-4e86-a168-23e7f9ceec9a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:30.090943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2f34c-d5a5-4e86-a168-23e7f9ceec9a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:30.091419 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2f34c-d5a5-4e86-a168-23e7f9ceec9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:30.092507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2f34c-d5a5-4e86-a168-23e7f9ceec9a None admin] RBAC: Adding query filter params (group.id=40aec1b78195450d924ce47a537a831c, role.id=e97885113c774466b7432083b511fa58, scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:30.093039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2f34c-d5a5-4e86-a168-23e7f9ceec9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:30.094715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2f34c-d5a5-4e86-a168-23e7f9ceec9a None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:30.099589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:30.107793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 191/381] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 2 13:35:29 2022] GET /identity/v3/role_assignments?group.id=40aec1b78195450d924ce47a537a831c&scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21&role.id=e97885113c774466b7432083b511fa58 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:30.107793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2f34c-d5a5-4e86-a168-23e7f9ceec9a None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:30.133518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf0178-5d90-46dd-953b-6546d73e34d1 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:30.212129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eda5da-3542-4870-a833-ce5bbc1637eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:30.212910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eda5da-3542-4870-a833-ce5bbc1637eb None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:30.213187 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eda5da-3542-4870-a833-ce5bbc1637eb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:30.213466 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eda5da-3542-4870-a833-ce5bbc1637eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:30.236078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eda5da-3542-4870-a833-ce5bbc1637eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-47eda5da-3542-4870-a833-ce5bbc1637eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:30.244101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:30.245318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:30.246289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:30.246289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:30.246289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:30.246289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:30.246289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:30.246289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:30.246289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:30.246289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:30.246289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:30.246289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:30.246289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:30.246289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:30.246289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 191/382] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:30.252317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eda5da-3542-4870-a833-ce5bbc1637eb None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:30.363265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2f34c-d5a5-4e86-a168-23e7f9ceec9a None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:30.404980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34399f75-f777-43fc-9618-25b1d1c54fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:30.405644 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34399f75-f777-43fc-9618-25b1d1c54fbb None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:30.405927 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34399f75-f777-43fc-9618-25b1d1c54fbb None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:30.406202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34399f75-f777-43fc-9618-25b1d1c54fbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:30.407033 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34399f75-f777-43fc-9618-25b1d1c54fbb None admin] RBAC: Adding query filter params (group.id=c281fcb301af42d7859337ed102c29e6, role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=dbf6a4ee0a34470ea6e2b9b95f130787) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:30.407346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34399f75-f777-43fc-9618-25b1d1c54fbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:30.408843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34399f75-f777-43fc-9618-25b1d1c54fbb None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:30.415587 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 192/383] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 2 13:35:30 2022] GET /identity/v3/role_assignments?group.id=c281fcb301af42d7859337ed102c29e6&scope.project.id=dbf6a4ee0a34470ea6e2b9b95f130787&role.id=c5632345c9274d348669482f1f7414c8 => generated 260 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:30.465588 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eda5da-3542-4870-a833-ce5bbc1637eb None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:30.524271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eceac0-2bc7-4a5a-a185-0789dfcb0905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:30.525764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eceac0-2bc7-4a5a-a185-0789dfcb0905 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:30.526482 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eceac0-2bc7-4a5a-a185-0789dfcb0905 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:30.526973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eceac0-2bc7-4a5a-a185-0789dfcb0905 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:30.528035 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eceac0-2bc7-4a5a-a185-0789dfcb0905 None admin] RBAC: Adding query filter params (name=member) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:30.528559 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eceac0-2bc7-4a5a-a185-0789dfcb0905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:30.530839 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eceac0-2bc7-4a5a-a185-0789dfcb0905 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:30.547803 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 192/384] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:30.553717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34399f75-f777-43fc-9618-25b1d1c54fbb None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:30.634818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:30.703266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34399f75-f777-43fc-9618-25b1d1c54fbb None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:30.750772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e5e6a-cd3d-4578-922d-9f52f19ebff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:30.751669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5e6a-cd3d-4578-922d-9f52f19ebff8 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:30.751951 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5e6a-cd3d-4578-922d-9f52f19ebff8 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:30.752228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5e6a-cd3d-4578-922d-9f52f19ebff8 None admin] PATH_INFO: `/v3/groups/40aec1b78195450d924ce47a537a831c` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:30.753412 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e5e6a-cd3d-4578-922d-9f52f19ebff8 None admin] RBAC: Authorizing `identity:get_group(group_id=40aec1b78195450d924ce47a537a831c)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:30.754863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e5e6a-cd3d-4578-922d-9f52f19ebff8 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:30.757051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 193/385] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:30 2022] GET /identity/v3/groups/40aec1b78195450d924ce47a537a831c => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:30.764748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eceac0-2bc7-4a5a-a185-0789dfcb0905 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:30.791896 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:30.919491 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eceac0-2bc7-4a5a-a185-0789dfcb0905 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:30.972422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc913e-225a-4011-bf0a-a39b2fb880f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:30.973290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc913e-225a-4011-bf0a-a39b2fb880f9 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:30.973576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc913e-225a-4011-bf0a-a39b2fb880f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:30.973854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc913e-225a-4011-bf0a-a39b2fb880f9 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:30.975047 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc913e-225a-4011-bf0a-a39b2fb880f9 None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:30.976525 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc913e-225a-4011-bf0a-a39b2fb880f9 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:30.978585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 193/386] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:30 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:30.984381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e5e6a-cd3d-4578-922d-9f52f19ebff8 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:31.098626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e5e6a-cd3d-4578-922d-9f52f19ebff8 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:31.121079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:31.136081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3bb4c-83d4-4cbe-bc9c-eb38b9d5e459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:31.136974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3bb4c-83d4-4cbe-bc9c-eb38b9d5e459 None admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:31.137260 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3bb4c-83d4-4cbe-bc9c-eb38b9d5e459 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:31.137537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3bb4c-83d4-4cbe-bc9c-eb38b9d5e459 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f/groups/40aec1b78195450d924ce47a537a831c/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:31.140134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3bb4c-83d4-4cbe-bc9c-eb38b9d5e459 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f275690aa244b3ea3d67cb4f7e3502f, group_id=40aec1b78195450d924ce47a537a831c, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:31.141660 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3bb4c-83d4-4cbe-bc9c-eb38b9d5e459 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:31.242269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 194/387] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 2 13:35:30 2022] PUT /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f/groups/40aec1b78195450d924ce47a537a831c/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:35:31.563205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22286691-aa7f-4120-9273-5ce131721afb None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:31.563614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22286691-aa7f-4120-9273-5ce131721afb None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:31.563793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22286691-aa7f-4120-9273-5ce131721afb None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:31.565486 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 194/388] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:31.571368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce3ec0-cb48-4e78-ae83-146a5be21199 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:31.571680 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce3ec0-cb48-4e78-ae83-146a5be21199 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:31.571968 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce3ec0-cb48-4e78-ae83-146a5be21199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:31.596557 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-77ce3ec0-cb48-4e78-ae83-146a5be21199 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:31.597774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-77ce3ec0-cb48-4e78-ae83-146a5be21199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:31.684239 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 195/389] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:31.708164 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22286691-aa7f-4120-9273-5ce131721afb None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:31.848001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:31.879122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22286691-aa7f-4120-9273-5ce131721afb None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:31.936791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bb927-f462-40c4-b7ba-6137e0efcc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:31.937629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bb927-f462-40c4-b7ba-6137e0efcc8c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:31.937909 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bb927-f462-40c4-b7ba-6137e0efcc8c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:31.938177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bb927-f462-40c4-b7ba-6137e0efcc8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:31.953023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bb927-f462-40c4-b7ba-6137e0efcc8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-752bb927-f462-40c4-b7ba-6137e0efcc8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:31.961988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:31.964541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:31.965407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:31.965407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:31.965407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:31.965407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:31.965407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:31.965407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:31.965407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:31.965407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:31.965407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:31.965407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:31.965407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:31.965407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:31.965407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 195/390] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:35:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:31.973502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce3ec0-cb48-4e78-ae83-146a5be21199 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:32.098893 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce3ec0-cb48-4e78-ae83-146a5be21199 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:32.118959 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:32.138103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b990ddf-f02d-4d3d-9b7a-6ab7111c42cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:32.138807 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b990ddf-f02d-4d3d-9b7a-6ab7111c42cf None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:32.139094 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b990ddf-f02d-4d3d-9b7a-6ab7111c42cf None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:32.139372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b990ddf-f02d-4d3d-9b7a-6ab7111c42cf None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:32.140183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b990ddf-f02d-4d3d-9b7a-6ab7111c42cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:32.140494 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b990ddf-f02d-4d3d-9b7a-6ab7111c42cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:32.141882 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b990ddf-f02d-4d3d-9b7a-6ab7111c42cf None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:32.155594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 196/391] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:32.157313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bb927-f462-40c4-b7ba-6137e0efcc8c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:32.302286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bb927-f462-40c4-b7ba-6137e0efcc8c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:32.347836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66298f22-9325-432d-9393-c9d6d1f2261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:32.348709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298f22-9325-432d-9393-c9d6d1f2261f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:32.349042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298f22-9325-432d-9393-c9d6d1f2261f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:32.349262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298f22-9325-432d-9393-c9d6d1f2261f None admin] PATH_INFO: `/v3/groups/40aec1b78195450d924ce47a537a831c` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:32.356230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66298f22-9325-432d-9393-c9d6d1f2261f None admin] RBAC: Authorizing `identity:get_group(group_id=40aec1b78195450d924ce47a537a831c)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:32.357740 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66298f22-9325-432d-9393-c9d6d1f2261f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:32.359864 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 196/392] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:32 2022] GET /identity/v3/groups/40aec1b78195450d924ce47a537a831c => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:32.365303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b990ddf-f02d-4d3d-9b7a-6ab7111c42cf None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:32.396773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf694e-1fa1-49b6-9f99-9f044e662f83 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:32.397113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf694e-1fa1-49b6-9f99-9f044e662f83 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:32.397342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf694e-1fa1-49b6-9f99-9f044e662f83 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:32.398980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 197/393] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:35:32.414970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa77f18-f598-4fb3-8bab-106855840877 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:32.415258 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa77f18-f598-4fb3-8bab-106855840877 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:32.415561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa77f18-f598-4fb3-8bab-106855840877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:32.435814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:32.448516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-3fa77f18-f598-4fb3-8bab-106855840877 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:32.450007 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3fa77f18-f598-4fb3-8bab-106855840877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:32.494636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b990ddf-f02d-4d3d-9b7a-6ab7111c42cf None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:32.536714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda1c4b-b584-439f-946c-ebd72b4bb111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:32.537609 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda1c4b-b584-439f-946c-ebd72b4bb111 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:32.537889 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda1c4b-b584-439f-946c-ebd72b4bb111 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:32.538160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda1c4b-b584-439f-946c-ebd72b4bb111 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:32.541152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda1c4b-b584-439f-946c-ebd72b4bb111 None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:32.542670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda1c4b-b584-439f-946c-ebd72b4bb111 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:32.550615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 197/394] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:32 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:32.556402 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda1c4b-b584-439f-946c-ebd72b4bb111 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:32.605964 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:32.618166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 198/395] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:32.692462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda1c4b-b584-439f-946c-ebd72b4bb111 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:32.701947 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa77f18-f598-4fb3-8bab-106855840877 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:32.739750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec40d52-9d3f-430d-b2cb-15b1f23f72d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:32.741021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec40d52-9d3f-430d-b2cb-15b1f23f72d9 None admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:32.741496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec40d52-9d3f-430d-b2cb-15b1f23f72d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:32.741967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec40d52-9d3f-430d-b2cb-15b1f23f72d9 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f/groups/40aec1b78195450d924ce47a537a831c/roles/e97885113c774466b7432083b511fa58` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:32.744426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec40d52-9d3f-430d-b2cb-15b1f23f72d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f275690aa244b3ea3d67cb4f7e3502f, group_id=40aec1b78195450d924ce47a537a831c, role_id=e97885113c774466b7432083b511fa58)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:32.746373 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec40d52-9d3f-430d-b2cb-15b1f23f72d9 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:32.819757 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa77f18-f598-4fb3-8bab-106855840877 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:32.856490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 198/396] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 2 13:35:32 2022] PUT /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f/groups/40aec1b78195450d924ce47a537a831c/roles/e97885113c774466b7432083b511fa58 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:35:32.868442 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d419cdd-9acd-44f5-b295-26fd3de5cb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:32.869285 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d419cdd-9acd-44f5-b295-26fd3de5cb5b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:32.869568 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d419cdd-9acd-44f5-b295-26fd3de5cb5b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:32.869847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d419cdd-9acd-44f5-b295-26fd3de5cb5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:32.879004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:32.888124 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d419cdd-9acd-44f5-b295-26fd3de5cb5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-7d419cdd-9acd-44f5-b295-26fd3de5cb5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:32.897403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:32.898395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:32.899196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:32.899196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:32.899196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:32.899196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:32.899196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:32.899196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:32.899196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:32.899196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:32.899196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:32.899196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:32.899196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:32.899196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:32.904819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 199/397] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:35:32.906485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0a4f3-4c81-4283-9d57-e4ea3df7fcce None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:32.906780 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0a4f3-4c81-4283-9d57-e4ea3df7fcce None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:32.907060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0a4f3-4c81-4283-9d57-e4ea3df7fcce None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:32.908481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 199/398] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:32.910160 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d419cdd-9acd-44f5-b295-26fd3de5cb5b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:32.915402 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3ad6b-91b0-4f40-8f95-d104693e2e76 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:32.919242 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3ad6b-91b0-4f40-8f95-d104693e2e76 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:32.919551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3ad6b-91b0-4f40-8f95-d104693e2e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:32.958652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-0dd3ad6b-91b0-4f40-8f95-d104693e2e76 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:32.959911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0dd3ad6b-91b0-4f40-8f95-d104693e2e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:33.093675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 200/399] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:33.106205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d419cdd-9acd-44f5-b295-26fd3de5cb5b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:33.119580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3ad6b-91b0-4f40-8f95-d104693e2e76 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:33.162529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:33.171085 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432068fd-4aa3-4fda-900e-0840c071adae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:33.176346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432068fd-4aa3-4fda-900e-0840c071adae None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:33.176346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432068fd-4aa3-4fda-900e-0840c071adae None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:33.176346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432068fd-4aa3-4fda-900e-0840c071adae None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:33.176346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432068fd-4aa3-4fda-900e-0840c071adae None admin] RBAC: Adding query filter params (name=member) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:33.176346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432068fd-4aa3-4fda-900e-0840c071adae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:33.176678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432068fd-4aa3-4fda-900e-0840c071adae None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:33.191356 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 200/400] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:33.199807 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432068fd-4aa3-4fda-900e-0840c071adae None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:33.286403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:33.317452 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3ad6b-91b0-4f40-8f95-d104693e2e76 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:33.331051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432068fd-4aa3-4fda-900e-0840c071adae None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:33.367763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6883e5-b902-4f59-86f6-9c93a449ebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:33.369012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6883e5-b902-4f59-86f6-9c93a449ebf2 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:33.369695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6883e5-b902-4f59-86f6-9c93a449ebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:33.370417 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6883e5-b902-4f59-86f6-9c93a449ebf2 None admin] PATH_INFO: `/v3/groups/40aec1b78195450d924ce47a537a831c` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:33.372348 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6883e5-b902-4f59-86f6-9c93a449ebf2 None admin] RBAC: Authorizing `identity:get_group(group_id=40aec1b78195450d924ce47a537a831c)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:33.374735 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6883e5-b902-4f59-86f6-9c93a449ebf2 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:33.377538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 201/401] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:33 2022] GET /identity/v3/groups/40aec1b78195450d924ce47a537a831c => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:33.384967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6883e5-b902-4f59-86f6-9c93a449ebf2 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:33.400162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e9577-da51-480c-903c-e1727c4a0b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:33.401031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9577-da51-480c-903c-e1727c4a0b65 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:33.401359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9577-da51-480c-903c-e1727c4a0b65 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:33.401630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9577-da51-480c-903c-e1727c4a0b65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:33.424604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e9577-da51-480c-903c-e1727c4a0b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-6a8e9577-da51-480c-903c-e1727c4a0b65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:33.439550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:33.440488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:33.441322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:33.441322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:33.441322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:33.441322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:33.441322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:33.441322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:33.441322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:33.441322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:33.441322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:33.441322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:33.441322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:33.441322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:33.442422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 201/402] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:35:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:35:33.450748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e9577-da51-480c-903c-e1727c4a0b65 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:33.575196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6883e5-b902-4f59-86f6-9c93a449ebf2 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:33.586477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:33.598274 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e9577-da51-480c-903c-e1727c4a0b65 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:33.606693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:33.616276 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863d7d2-5640-46f1-b367-b0a3472b8116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:33.617518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d7d2-5640-46f1-b367-b0a3472b8116 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:33.618144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d7d2-5640-46f1-b367-b0a3472b8116 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:33.618637 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d7d2-5640-46f1-b367-b0a3472b8116 None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:33.620443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863d7d2-5640-46f1-b367-b0a3472b8116 None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:33.622143 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863d7d2-5640-46f1-b367-b0a3472b8116 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:33.629375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 202/403] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:33 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:33.631051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b98ea-e2af-4f39-adee-119ff342b3e3 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:33.631602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b98ea-e2af-4f39-adee-119ff342b3e3 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:33.632075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b98ea-e2af-4f39-adee-119ff342b3e3 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:33.633588 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 203/404] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:33.634800 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b98ea-e2af-4f39-adee-119ff342b3e3 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:33.643240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e3d10-1886-4b7c-9015-591bc929a85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:33.643951 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e3d10-1886-4b7c-9015-591bc929a85f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:33.644238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e3d10-1886-4b7c-9015-591bc929a85f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:33.644574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e3d10-1886-4b7c-9015-591bc929a85f None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:33.645334 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e3d10-1886-4b7c-9015-591bc929a85f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:33.645640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e3d10-1886-4b7c-9015-591bc929a85f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:33.647556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e3d10-1886-4b7c-9015-591bc929a85f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:33.664706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 202/405] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:33.664706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d75f4-6e1f-464c-bb8b-593c9053ceab None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:33.664706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d75f4-6e1f-464c-bb8b-593c9053ceab None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:33.664706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d75f4-6e1f-464c-bb8b-593c9053ceab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:33.682409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-547d75f4-6e1f-464c-bb8b-593c9053ceab None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:33.683913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-547d75f4-6e1f-464c-bb8b-593c9053ceab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:33.759736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 203/406] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:33.760869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d75f4-6e1f-464c-bb8b-593c9053ceab None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:33.785465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b98ea-e2af-4f39-adee-119ff342b3e3 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:33.822968 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621b07f-e9e5-461b-8d5d-8576e661131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:33.824358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621b07f-e9e5-461b-8d5d-8576e661131b None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:33.824886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621b07f-e9e5-461b-8d5d-8576e661131b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:33.825483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621b07f-e9e5-461b-8d5d-8576e661131b None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21/groups/40aec1b78195450d924ce47a537a831c/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:33.827811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621b07f-e9e5-461b-8d5d-8576e661131b None admin] RBAC: Authorizing `identity:create_grant(project_id=6f7ae5221dfd4916ad28175a8e6ccf21, group_id=40aec1b78195450d924ce47a537a831c, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:33.829501 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621b07f-e9e5-461b-8d5d-8576e661131b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:33.862282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:33.883132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d75f4-6e1f-464c-bb8b-593c9053ceab None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:33.917394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6978ac7-d499-450c-94b1-b836f6c65a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:33.918255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6978ac7-d499-450c-94b1-b836f6c65a43 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:33.918534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6978ac7-d499-450c-94b1-b836f6c65a43 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:33.918800 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6978ac7-d499-450c-94b1-b836f6c65a43 None admin] PATH_INFO: `/v3/groups/40aec1b78195450d924ce47a537a831c` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:33.923795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6978ac7-d499-450c-94b1-b836f6c65a43 None admin] RBAC: Authorizing `identity:get_group(group_id=40aec1b78195450d924ce47a537a831c)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:33.923795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6978ac7-d499-450c-94b1-b836f6c65a43 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:33.928581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 204/407] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:33 2022] GET /identity/v3/groups/40aec1b78195450d924ce47a537a831c => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:33.928581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6978ac7-d499-450c-94b1-b836f6c65a43 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:33.963543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 204/408] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 2 13:35:33 2022] PUT /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21/groups/40aec1b78195450d924ce47a537a831c/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:35:33.964837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621b07f-e9e5-461b-8d5d-8576e661131b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:34.061580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:34.088898 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6978ac7-d499-450c-94b1-b836f6c65a43 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:34.132475 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621b07f-e9e5-461b-8d5d-8576e661131b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:34.135924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29764029-8287-46f5-9098-960e02496599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:34.137606 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29764029-8287-46f5-9098-960e02496599 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:34.137965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29764029-8287-46f5-9098-960e02496599 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:34.138201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29764029-8287-46f5-9098-960e02496599 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:34.152457 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29764029-8287-46f5-9098-960e02496599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-29764029-8287-46f5-9098-960e02496599 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:34.165365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:34.166622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:34.167410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:34.167410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:34.167410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:34.167410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:34.167410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:34.167410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:34.167410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:34.167410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:34.167410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:34.167410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:34.167410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:35:34.167410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:34.167410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 205/409] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:35:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:34.168614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b29f2e-448f-4ac7-9212-6229d69f7a08 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:34.168712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b29f2e-448f-4ac7-9212-6229d69f7a08 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:34.169161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b29f2e-448f-4ac7-9212-6229d69f7a08 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:34.175542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 206/410] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:34.177222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b29f2e-448f-4ac7-9212-6229d69f7a08 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:34.188922 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128937b5-ae37-4852-b69d-4df47069deb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:34.189423 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128937b5-ae37-4852-b69d-4df47069deb5 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:34.189706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128937b5-ae37-4852-b69d-4df47069deb5 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:34.189981 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128937b5-ae37-4852-b69d-4df47069deb5 None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:34.191422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128937b5-ae37-4852-b69d-4df47069deb5 None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:34.193463 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:34.194075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128937b5-ae37-4852-b69d-4df47069deb5 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:34.199555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 205/411] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:33 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:34.199555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eef233-8d06-4ee4-8a81-99fc069030cf None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:34.199555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eef233-8d06-4ee4-8a81-99fc069030cf None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:34.199555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eef233-8d06-4ee4-8a81-99fc069030cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:34.218518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-21eef233-8d06-4ee4-8a81-99fc069030cf None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:34.219799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-21eef233-8d06-4ee4-8a81-99fc069030cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:34.323549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 206/412] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:34.324733 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eef233-8d06-4ee4-8a81-99fc069030cf None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:34.337249 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b29f2e-448f-4ac7-9212-6229d69f7a08 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:34.394000 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b69da-9dcc-46d9-a907-8a18a044fcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:34.395043 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b69da-9dcc-46d9-a907-8a18a044fcf2 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:34.395515 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b69da-9dcc-46d9-a907-8a18a044fcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:34.396547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b69da-9dcc-46d9-a907-8a18a044fcf2 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:34.397814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b69da-9dcc-46d9-a907-8a18a044fcf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:34.398285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b69da-9dcc-46d9-a907-8a18a044fcf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:34.400598 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b69da-9dcc-46d9-a907-8a18a044fcf2 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:34.403973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:34.414950 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 207/413] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:34.416217 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b69da-9dcc-46d9-a907-8a18a044fcf2 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:34.472071 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eef233-8d06-4ee4-8a81-99fc069030cf None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:34.505356 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:34.520676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9a3f0-8f4f-4aab-ba10-47191791a23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:34.522153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a3f0-8f4f-4aab-ba10-47191791a23d None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:34.522558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a3f0-8f4f-4aab-ba10-47191791a23d None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:34.522936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a3f0-8f4f-4aab-ba10-47191791a23d None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21/groups/40aec1b78195450d924ce47a537a831c/roles/e97885113c774466b7432083b511fa58` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:34.525991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9a3f0-8f4f-4aab-ba10-47191791a23d None admin] RBAC: Authorizing `identity:create_grant(project_id=6f7ae5221dfd4916ad28175a8e6ccf21, group_id=40aec1b78195450d924ce47a537a831c, role_id=e97885113c774466b7432083b511fa58)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:34.527856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9a3f0-8f4f-4aab-ba10-47191791a23d None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:34.552467 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b69da-9dcc-46d9-a907-8a18a044fcf2 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:34.593326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cae045-f0d5-4db4-8514-2654c920187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:34.594161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cae045-f0d5-4db4-8514-2654c920187c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:34.594444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cae045-f0d5-4db4-8514-2654c920187c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:34.594774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cae045-f0d5-4db4-8514-2654c920187c None admin] PATH_INFO: `/v3/roles/member` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:34.606675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cae045-f0d5-4db4-8514-2654c920187c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-19cae045-f0d5-4db4-8514-2654c920187c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:34.614939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:34.616160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:34.616945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:34.616945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:34.616945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:34.616945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:34.616945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:34.616945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:34.616945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:34.616945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:34.616945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:34.616945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:34.616945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:34.616945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:34.616945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 208/414] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:34.617622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cae045-f0d5-4db4-8514-2654c920187c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:34.637399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 207/415] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 2 13:35:34 2022] PUT /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21/groups/40aec1b78195450d924ce47a537a831c/roles/e97885113c774466b7432083b511fa58 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:35:34.638264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9a3f0-8f4f-4aab-ba10-47191791a23d None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:34.846672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9a3f0-8f4f-4aab-ba10-47191791a23d None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:34.868332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cae045-f0d5-4db4-8514-2654c920187c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:34.875843 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:34.907204 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:34.907648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eca23-e4a4-4a87-9786-2db75aca57d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:34.908367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eca23-e4a4-4a87-9786-2db75aca57d0 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:34.908652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eca23-e4a4-4a87-9786-2db75aca57d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:34.908928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eca23-e4a4-4a87-9786-2db75aca57d0 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:34.909698 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eca23-e4a4-4a87-9786-2db75aca57d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:34.910004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eca23-e4a4-4a87-9786-2db75aca57d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:34.911406 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eca23-e4a4-4a87-9786-2db75aca57d0 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:34.913051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ce312-fe5e-4331-a154-875609820794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:34.914104 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ce312-fe5e-4331-a154-875609820794 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:34.914545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ce312-fe5e-4331-a154-875609820794 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:34.914999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ce312-fe5e-4331-a154-875609820794 None admin] PATH_INFO: `/v3/groups/c281fcb301af42d7859337ed102c29e6` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:34.916880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ce312-fe5e-4331-a154-875609820794 None admin] RBAC: Authorizing `identity:get_group(group_id=c281fcb301af42d7859337ed102c29e6)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:34.918565 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ce312-fe5e-4331-a154-875609820794 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:34.920874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 209/416] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:34 2022] GET /identity/v3/groups/c281fcb301af42d7859337ed102c29e6 => generated 229 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:34.921508 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 208/417] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:34.928796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ce312-fe5e-4331-a154-875609820794 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:34.929972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eca23-e4a4-4a87-9786-2db75aca57d0 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:35.110241 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eca23-e4a4-4a87-9786-2db75aca57d0 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:35.147630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0b7ad-3f8a-4889-be1f-ef7b329ad87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:35.148401 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0b7ad-3f8a-4889-be1f-ef7b329ad87e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:35.148675 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0b7ad-3f8a-4889-be1f-ef7b329ad87e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:35.148934 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0b7ad-3f8a-4889-be1f-ef7b329ad87e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:35.151997 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ce312-fe5e-4331-a154-875609820794 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:35.196049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:35.224217 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0b7ad-3f8a-4889-be1f-ef7b329ad87e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:35.225916 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0b7ad-3f8a-4889-be1f-ef7b329ad87e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:35.308657 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5af046-6874-4877-b6f1-5b3fe7cc55ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:35.310234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5af046-6874-4877-b6f1-5b3fe7cc55ab None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:35.311287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5af046-6874-4877-b6f1-5b3fe7cc55ab None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:35.311811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5af046-6874-4877-b6f1-5b3fe7cc55ab None admin] PATH_INFO: `/v3/projects/dbf6a4ee0a34470ea6e2b9b95f130787` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:35.320961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5af046-6874-4877-b6f1-5b3fe7cc55ab None admin] RBAC: Authorizing `identity:get_project(project_id=dbf6a4ee0a34470ea6e2b9b95f130787)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:35.323801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5af046-6874-4877-b6f1-5b3fe7cc55ab None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:35.336091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 210/418] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:34 2022] GET /identity/v3/projects/dbf6a4ee0a34470ea6e2b9b95f130787 => generated 344 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:35.344556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 209/419] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:35:35.344903 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5af046-6874-4877-b6f1-5b3fe7cc55ab None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:35.358355 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0b7ad-3f8a-4889-be1f-ef7b329ad87e None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:35.442755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:35.479165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0b7ad-3f8a-4889-be1f-ef7b329ad87e None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:35.506495 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:35.531565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0237302-2b0c-4766-840b-40e61bbc0b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:35.533034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0237302-2b0c-4766-840b-40e61bbc0b64 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:35.533551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0237302-2b0c-4766-840b-40e61bbc0b64 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:35.534050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0237302-2b0c-4766-840b-40e61bbc0b64 None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:35.536598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0237302-2b0c-4766-840b-40e61bbc0b64 None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:35.539261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0237302-2b0c-4766-840b-40e61bbc0b64 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:35.543191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 210/420] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:35 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:35.546417 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228737c-818c-478f-9f8d-62c67a6cf18c None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:35.546870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228737c-818c-478f-9f8d-62c67a6cf18c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:35.547636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228737c-818c-478f-9f8d-62c67a6cf18c None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:35.550522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 211/421] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:35.554771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228737c-818c-478f-9f8d-62c67a6cf18c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:35.559212 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5af046-6874-4877-b6f1-5b3fe7cc55ab None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:35.612669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc1075-7cfc-464d-84e5-7f493cb4cd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:35.613835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1075-7cfc-464d-84e5-7f493cb4cd64 None admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:35.614301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1075-7cfc-464d-84e5-7f493cb4cd64 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:35.614726 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1075-7cfc-464d-84e5-7f493cb4cd64 None admin] PATH_INFO: `/v3/projects/dbf6a4ee0a34470ea6e2b9b95f130787/groups/c281fcb301af42d7859337ed102c29e6/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:35.617159 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc1075-7cfc-464d-84e5-7f493cb4cd64 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbf6a4ee0a34470ea6e2b9b95f130787, group_id=c281fcb301af42d7859337ed102c29e6, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:35.618882 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc1075-7cfc-464d-84e5-7f493cb4cd64 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:35.705411 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228737c-818c-478f-9f8d-62c67a6cf18c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:35.742285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 211/422] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 2 13:35:35 2022] PUT /identity/v3/projects/dbf6a4ee0a34470ea6e2b9b95f130787/groups/c281fcb301af42d7859337ed102c29e6/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:35:35.746896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103c0b4-a3f1-49af-9fa9-16708b3a6068 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:35.749028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103c0b4-a3f1-49af-9fa9-16708b3a6068 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:35.750144 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103c0b4-a3f1-49af-9fa9-16708b3a6068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:35.753211 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961fbea-ac52-45f4-99f7-d03662e16ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:35.754365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961fbea-ac52-45f4-99f7-d03662e16ace None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:35.754652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961fbea-ac52-45f4-99f7-d03662e16ace None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:35.754914 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961fbea-ac52-45f4-99f7-d03662e16ace None admin] PATH_INFO: `/v3/groups/40aec1b78195450d924ce47a537a831c` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:35.756471 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961fbea-ac52-45f4-99f7-d03662e16ace None admin] RBAC: Authorizing `identity:get_group(group_id=40aec1b78195450d924ce47a537a831c)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:35.758094 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961fbea-ac52-45f4-99f7-d03662e16ace None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:35.760285 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 212/423] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:35 2022] GET /identity/v3/groups/40aec1b78195450d924ce47a537a831c => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:35.767071 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961fbea-ac52-45f4-99f7-d03662e16ace None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:35.786350 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-a103c0b4-a3f1-49af-9fa9-16708b3a6068 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:35.789205 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a103c0b4-a3f1-49af-9fa9-16708b3a6068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:35.793767 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:35.968832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 212/424] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:35.985881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961fbea-ac52-45f4-99f7-d03662e16ace None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:36.014327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103c0b4-a3f1-49af-9fa9-16708b3a6068 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:36.034786 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092656dc-885e-4bb2-80d1-228971bcf89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:36.035478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092656dc-885e-4bb2-80d1-228971bcf89e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:36.035760 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092656dc-885e-4bb2-80d1-228971bcf89e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:36.036023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092656dc-885e-4bb2-80d1-228971bcf89e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:36.036864 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092656dc-885e-4bb2-80d1-228971bcf89e None admin] RBAC: Adding query filter params (group.id=40aec1b78195450d924ce47a537a831c, role.id=9507ef97f4954ddc90305c9d0f1d3608, scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:36.037173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092656dc-885e-4bb2-80d1-228971bcf89e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:36.038615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092656dc-885e-4bb2-80d1-228971bcf89e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:36.046018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 213/425] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 2 13:35:35 2022] GET /identity/v3/role_assignments?group.id=40aec1b78195450d924ce47a537a831c&scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f&role.id=9507ef97f4954ddc90305c9d0f1d3608 => generated 611 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:36.101724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:36.153868 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103c0b4-a3f1-49af-9fa9-16708b3a6068 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:36.197697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3f833-ecf7-4bd3-bfee-1df0e473fdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:36.198868 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3f833-ecf7-4bd3-bfee-1df0e473fdec None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:36.199353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3f833-ecf7-4bd3-bfee-1df0e473fdec None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:36.199878 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3f833-ecf7-4bd3-bfee-1df0e473fdec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:36.212241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3f833-ecf7-4bd3-bfee-1df0e473fdec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-b6e3f833-ecf7-4bd3-bfee-1df0e473fdec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:36.227626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:36.228556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:36.229324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:36.229324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:36.229324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:36.229324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:36.229324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:36.229324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:36.229324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:36.229324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:36.229324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:36.229324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:36.229324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:36.229324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:36.231420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 213/426] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:35:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:36.238022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092656dc-885e-4bb2-80d1-228971bcf89e None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:36.383017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:36.415052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092656dc-885e-4bb2-80d1-228971bcf89e None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:36.461233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc74472-eebc-4cb5-8a55-2f6aaf5268df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:36.461924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc74472-eebc-4cb5-8a55-2f6aaf5268df None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:36.462208 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc74472-eebc-4cb5-8a55-2f6aaf5268df None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:36.462485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc74472-eebc-4cb5-8a55-2f6aaf5268df None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:36.463261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc74472-eebc-4cb5-8a55-2f6aaf5268df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:36.463603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc74472-eebc-4cb5-8a55-2f6aaf5268df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:36.465013 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc74472-eebc-4cb5-8a55-2f6aaf5268df None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:36.476089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 214/427] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:36.481343 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3f833-ecf7-4bd3-bfee-1df0e473fdec None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:36.611432 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3f833-ecf7-4bd3-bfee-1df0e473fdec None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:36.635862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:36.652236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a1d19-224e-496a-8ac6-e2028f56021e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:36.652902 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a1d19-224e-496a-8ac6-e2028f56021e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:36.653442 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a1d19-224e-496a-8ac6-e2028f56021e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:36.653721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a1d19-224e-496a-8ac6-e2028f56021e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:36.729835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a1d19-224e-496a-8ac6-e2028f56021e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:36.731313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a1d19-224e-496a-8ac6-e2028f56021e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:36.839983 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 214/428] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:36.845799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc74472-eebc-4cb5-8a55-2f6aaf5268df None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:36.979010 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d3fa7-cbd7-4659-ae6c-89b82281ed35 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:36.979333 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d3fa7-cbd7-4659-ae6c-89b82281ed35 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:36.979645 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d3fa7-cbd7-4659-ae6c-89b82281ed35 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:36.981354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 215/429] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:36.988668 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d482ff7-6ae4-4a94-b97e-014ac26ce00e None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:36.989238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d482ff7-6ae4-4a94-b97e-014ac26ce00e None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:36.989767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d482ff7-6ae4-4a94-b97e-014ac26ce00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:37.000723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc74472-eebc-4cb5-8a55-2f6aaf5268df None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:37.013858 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-4d482ff7-6ae4-4a94-b97e-014ac26ce00e None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:37.016829 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4d482ff7-6ae4-4a94-b97e-014ac26ce00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:37.039664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:37.048091 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f56dd-63cd-4816-a0e5-9bc3ed8a7baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:37.048988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f56dd-63cd-4816-a0e5-9bc3ed8a7baf None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:37.049332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f56dd-63cd-4816-a0e5-9bc3ed8a7baf None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:37.049610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f56dd-63cd-4816-a0e5-9bc3ed8a7baf None admin] PATH_INFO: `/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:37.050930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f56dd-63cd-4816-a0e5-9bc3ed8a7baf None admin] RBAC: Authorizing `identity:get_project(project_id=8f275690aa244b3ea3d67cb4f7e3502f)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:37.052513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f56dd-63cd-4816-a0e5-9bc3ed8a7baf None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:37.055665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 215/430] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:36 2022] GET /identity/v3/projects/8f275690aa244b3ea3d67cb4f7e3502f => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:37.062590 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f56dd-63cd-4816-a0e5-9bc3ed8a7baf None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:37.069283 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:37.122815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 216/431] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:35:37.156465 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d482ff7-6ae4-4a94-b97e-014ac26ce00e None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:37.208035 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f56dd-63cd-4816-a0e5-9bc3ed8a7baf None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:37.258667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262d101-513b-4455-ac20-b8639cc6792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:37.258667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d101-513b-4455-ac20-b8639cc6792f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:37.258667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d101-513b-4455-ac20-b8639cc6792f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:37.258667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d101-513b-4455-ac20-b8639cc6792f None admin] PATH_INFO: `/v3/groups/40aec1b78195450d924ce47a537a831c` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:37.260351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262d101-513b-4455-ac20-b8639cc6792f None admin] RBAC: Authorizing `identity:get_group(group_id=40aec1b78195450d924ce47a537a831c)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:37.262010 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262d101-513b-4455-ac20-b8639cc6792f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:37.266980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 216/432] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:37 2022] GET /identity/v3/groups/40aec1b78195450d924ce47a537a831c => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:37.274947 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262d101-513b-4455-ac20-b8639cc6792f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:37.300862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d482ff7-6ae4-4a94-b97e-014ac26ce00e None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:37.337865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d3ea3-8be0-4421-b8c7-3775ae0c78fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:37.339077 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d3ea3-8be0-4421-b8c7-3775ae0c78fe None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:37.339595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d3ea3-8be0-4421-b8c7-3775ae0c78fe None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:37.340075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d3ea3-8be0-4421-b8c7-3775ae0c78fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:37.351971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d3ea3-8be0-4421-b8c7-3775ae0c78fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:37.355220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-971d3ea3-8be0-4421-b8c7-3775ae0c78fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:37.360739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:37.361702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:37.362481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:37.362481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:37.362481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:37.362481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:37.362481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:37.362481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:37.362481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:37.362481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:37.362481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:37.362481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:37.362481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:35:37.362481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:37.365387 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 217/433] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:35:37.374489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d3ea3-8be0-4421-b8c7-3775ae0c78fe None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:37.388393 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:37.495532 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d3ea3-8be0-4421-b8c7-3775ae0c78fe None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:37.519433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262d101-513b-4455-ac20-b8639cc6792f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:37.539481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cec3f-1b77-4284-8be1-2cb703ec5a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:37.543026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cec3f-1b77-4284-8be1-2cb703ec5a4e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:37.543026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cec3f-1b77-4284-8be1-2cb703ec5a4e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:37.543026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cec3f-1b77-4284-8be1-2cb703ec5a4e None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:37.543026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cec3f-1b77-4284-8be1-2cb703ec5a4e None admin] RBAC: Adding query filter params (name=member) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:37.543026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cec3f-1b77-4284-8be1-2cb703ec5a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:37.543441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cec3f-1b77-4284-8be1-2cb703ec5a4e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:37.558103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 218/434] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:35:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:37.558103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7cae2-41c1-40e1-8397-330abb24037a None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:37.558103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7cae2-41c1-40e1-8397-330abb24037a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:37.558103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7cae2-41c1-40e1-8397-330abb24037a None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:37.558103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 219/435] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:37.562803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7cae2-41c1-40e1-8397-330abb24037a None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:37.565971 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e74c6a-89e8-4c88-90a1-e3fe00a848c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:37.566672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e74c6a-89e8-4c88-90a1-e3fe00a848c8 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:37.566953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e74c6a-89e8-4c88-90a1-e3fe00a848c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:37.567267 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e74c6a-89e8-4c88-90a1-e3fe00a848c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:37.568166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e74c6a-89e8-4c88-90a1-e3fe00a848c8 None admin] RBAC: Adding query filter params (group.id=40aec1b78195450d924ce47a537a831c, role.id=e97885113c774466b7432083b511fa58, scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:37.571777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e74c6a-89e8-4c88-90a1-e3fe00a848c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:37.571777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e74c6a-89e8-4c88-90a1-e3fe00a848c8 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:37.583046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 217/436] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 2 13:35:37 2022] GET /identity/v3/role_assignments?group.id=40aec1b78195450d924ce47a537a831c&scope.project.id=8f275690aa244b3ea3d67cb4f7e3502f&role.id=e97885113c774466b7432083b511fa58 => generated 611 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:37.583046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7c2d9-7125-4f0b-9088-ef8142cb82f3 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:37.583046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7c2d9-7125-4f0b-9088-ef8142cb82f3 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:37.583046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7c2d9-7125-4f0b-9088-ef8142cb82f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:37.610885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-f8e7c2d9-7125-4f0b-9088-ef8142cb82f3 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:37.612666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f8e7c2d9-7125-4f0b-9088-ef8142cb82f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:37.669757 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:37.711899 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 218/437] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:37.715214 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7cae2-41c1-40e1-8397-330abb24037a None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:37.733221 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7c2d9-7125-4f0b-9088-ef8142cb82f3 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:37.759200 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46943329-25ef-4c88-9c4a-44519da12d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:37.760285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46943329-25ef-4c88-9c4a-44519da12d72 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:37.760779 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46943329-25ef-4c88-9c4a-44519da12d72 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:37.761262 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46943329-25ef-4c88-9c4a-44519da12d72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:37.815260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:37.841079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46943329-25ef-4c88-9c4a-44519da12d72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:37.843401 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46943329-25ef-4c88-9c4a-44519da12d72 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:37.865178 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7c2d9-7125-4f0b-9088-ef8142cb82f3 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:37.911234 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd2c72-322e-444a-b4ba-a2ff54a3c346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:37.912121 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd2c72-322e-444a-b4ba-a2ff54a3c346 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:37.912836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd2c72-322e-444a-b4ba-a2ff54a3c346 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:37.912836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd2c72-322e-444a-b4ba-a2ff54a3c346 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:37.926465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd2c72-322e-444a-b4ba-a2ff54a3c346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:37.935171 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-b4dd2c72-322e-444a-b4ba-a2ff54a3c346 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:37.935978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:37.936805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:37.937586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:37.937586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:37.937586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:37.937586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:37.937586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:37.937586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:37.937586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:37.937586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:37.937586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:37.937586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:37.937586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:37.937586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:37.938173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 219/438] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:35:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:37.944477 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd2c72-322e-444a-b4ba-a2ff54a3c346 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:37.980439 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 220/439] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:37.987558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46943329-25ef-4c88-9c4a-44519da12d72 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:38.098804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd2c72-322e-444a-b4ba-a2ff54a3c346 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:38.134055 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:38.137029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46943329-25ef-4c88-9c4a-44519da12d72 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:38.142386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b2ee2-750c-480d-8d94-27628927f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:38.149053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b2ee2-750c-480d-8d94-27628927f356 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:38.149053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b2ee2-750c-480d-8d94-27628927f356 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:38.149053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b2ee2-750c-480d-8d94-27628927f356 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:38.149053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b2ee2-750c-480d-8d94-27628927f356 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:38.149053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b2ee2-750c-480d-8d94-27628927f356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:38.149053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b2ee2-750c-480d-8d94-27628927f356 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:38.155481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 220/440] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:38.160910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b2ee2-750c-480d-8d94-27628927f356 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:38.174388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cb33d-f1e0-4454-968a-f2772c98b87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:38.175270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cb33d-f1e0-4454-968a-f2772c98b87e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:38.175591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cb33d-f1e0-4454-968a-f2772c98b87e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:38.175971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cb33d-f1e0-4454-968a-f2772c98b87e None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:38.177177 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cb33d-f1e0-4454-968a-f2772c98b87e None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:38.178576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cb33d-f1e0-4454-968a-f2772c98b87e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:38.184946 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 221/441] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:37 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:38.185907 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cb33d-f1e0-4454-968a-f2772c98b87e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:38.240791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:38.321062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b2ee2-750c-480d-8d94-27628927f356 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:38.325459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cb33d-f1e0-4454-968a-f2772c98b87e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:38.361167 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c5445-a66d-4886-bf52-de94f0730d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:38.361829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c5445-a66d-4886-bf52-de94f0730d67 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:38.362108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c5445-a66d-4886-bf52-de94f0730d67 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:38.362381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c5445-a66d-4886-bf52-de94f0730d67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:38.363863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa07e4d-aaf1-40ec-bc73-a31cc0e918c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:38.364966 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa07e4d-aaf1-40ec-bc73-a31cc0e918c9 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:38.365409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa07e4d-aaf1-40ec-bc73-a31cc0e918c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:38.365954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa07e4d-aaf1-40ec-bc73-a31cc0e918c9 None admin] PATH_INFO: `/v3/groups/40aec1b78195450d924ce47a537a831c` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:38.367168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa07e4d-aaf1-40ec-bc73-a31cc0e918c9 None admin] RBAC: Authorizing `identity:get_group(group_id=40aec1b78195450d924ce47a537a831c)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:38.368659 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa07e4d-aaf1-40ec-bc73-a31cc0e918c9 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:38.370761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 222/442] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:38 2022] GET /identity/v3/groups/40aec1b78195450d924ce47a537a831c => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:38.376307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa07e4d-aaf1-40ec-bc73-a31cc0e918c9 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:38.424413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:38.441429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c5445-a66d-4886-bf52-de94f0730d67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:38.442924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c5445-a66d-4886-bf52-de94f0730d67 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:38.487259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa07e4d-aaf1-40ec-bc73-a31cc0e918c9 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:38.495593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:38.525181 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24059645-df37-4f56-be59-c5726f7e4da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:38.525402 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24059645-df37-4f56-be59-c5726f7e4da3 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:38.525598 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24059645-df37-4f56-be59-c5726f7e4da3 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:38.525876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24059645-df37-4f56-be59-c5726f7e4da3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:38.527633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24059645-df37-4f56-be59-c5726f7e4da3 None admin] RBAC: Adding query filter params (group.id=40aec1b78195450d924ce47a537a831c, role.id=9507ef97f4954ddc90305c9d0f1d3608, scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:38.527633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24059645-df37-4f56-be59-c5726f7e4da3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:38.530159 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24059645-df37-4f56-be59-c5726f7e4da3 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:38.536302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 223/443] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 2 13:35:38 2022] GET /identity/v3/role_assignments?group.id=40aec1b78195450d924ce47a537a831c&scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21&role.id=9507ef97f4954ddc90305c9d0f1d3608 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:38.537455 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776474b-5864-4510-82ee-338365fb84e1 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:38.537744 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776474b-5864-4510-82ee-338365fb84e1 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:38.538020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776474b-5864-4510-82ee-338365fb84e1 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:38.539299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 224/444] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:38.545469 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5e87d-67c9-4c36-8c1f-eb6f375a2654 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:38.546010 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5e87d-67c9-4c36-8c1f-eb6f375a2654 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:38.546467 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5e87d-67c9-4c36-8c1f-eb6f375a2654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:38.560457 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 221/445] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:35:38.565958 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-fec5e87d-67c9-4c36-8c1f-eb6f375a2654 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:38.566408 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c5445-a66d-4886-bf52-de94f0730d67 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:38.567701 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-fec5e87d-67c9-4c36-8c1f-eb6f375a2654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:38.661165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 225/446] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:35:38.687370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5e87d-67c9-4c36-8c1f-eb6f375a2654 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:38.693936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:38.709428 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c5445-a66d-4886-bf52-de94f0730d67 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:38.763384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf7f35-a165-4882-8a02-89b047023ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:38.763384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf7f35-a165-4882-8a02-89b047023ccf None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:38.763384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf7f35-a165-4882-8a02-89b047023ccf None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:38.763384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf7f35-a165-4882-8a02-89b047023ccf None admin] PATH_INFO: `/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:38.765272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf7f35-a165-4882-8a02-89b047023ccf None admin] RBAC: Authorizing `identity:get_project(project_id=6f7ae5221dfd4916ad28175a8e6ccf21)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:38.766731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf7f35-a165-4882-8a02-89b047023ccf None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:38.768492 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 222/447] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:38 2022] GET /identity/v3/projects/6f7ae5221dfd4916ad28175a8e6ccf21 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:38.773862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf7f35-a165-4882-8a02-89b047023ccf None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:38.818384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:38.821520 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5e87d-67c9-4c36-8c1f-eb6f375a2654 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:38.862069 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fdfad-18b6-4c6b-a13f-bf88fafb9fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:38.862871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fdfad-18b6-4c6b-a13f-bf88fafb9fc8 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:38.863151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fdfad-18b6-4c6b-a13f-bf88fafb9fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:38.863422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fdfad-18b6-4c6b-a13f-bf88fafb9fc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:38.876980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fdfad-18b6-4c6b-a13f-bf88fafb9fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-fc6fdfad-18b6-4c6b-a13f-bf88fafb9fc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:38.884918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:38.885833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:38.886899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:38.886899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:38.886899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:38.886899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:38.886899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:38.886899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:38.886899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:38.886899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:38.886899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:38.886899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:38.886899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:35:38.886899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:38.886899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 226/448] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:35:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:38.892622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fdfad-18b6-4c6b-a13f-bf88fafb9fc8 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:38.900104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf7f35-a165-4882-8a02-89b047023ccf None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:38.942488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bc0aa-ce5a-457f-badd-10bae7933b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:38.943359 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bc0aa-ce5a-457f-badd-10bae7933b4d None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:38.943687 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bc0aa-ce5a-457f-badd-10bae7933b4d None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:38.944012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bc0aa-ce5a-457f-badd-10bae7933b4d None admin] PATH_INFO: `/v3/groups/40aec1b78195450d924ce47a537a831c` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:38.945785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bc0aa-ce5a-457f-badd-10bae7933b4d None admin] RBAC: Authorizing `identity:get_group(group_id=40aec1b78195450d924ce47a537a831c)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:38.947229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bc0aa-ce5a-457f-badd-10bae7933b4d None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:38.949177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 223/449] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:38 2022] GET /identity/v3/groups/40aec1b78195450d924ce47a537a831c => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:38.956781 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bc0aa-ce5a-457f-badd-10bae7933b4d None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:38.987331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:39.020923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fdfad-18b6-4c6b-a13f-bf88fafb9fc8 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:39.059746 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f29ba8-3686-41e2-b9ea-a94102c28a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:39.060414 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f29ba8-3686-41e2-b9ea-a94102c28a4b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:39.061292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f29ba8-3686-41e2-b9ea-a94102c28a4b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:39.061563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f29ba8-3686-41e2-b9ea-a94102c28a4b None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:39.062317 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f29ba8-3686-41e2-b9ea-a94102c28a4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:39.062624 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f29ba8-3686-41e2-b9ea-a94102c28a4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:39.064076 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f29ba8-3686-41e2-b9ea-a94102c28a4b None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:39.072846 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 227/450] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:39.078436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f29ba8-3686-41e2-b9ea-a94102c28a4b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:39.079730 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bc0aa-ce5a-457f-badd-10bae7933b4d None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:39.104792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:39.115082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76db3d-529e-4be7-8a1d-9f0936c4668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:39.118589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76db3d-529e-4be7-8a1d-9f0936c4668a None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:39.118589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76db3d-529e-4be7-8a1d-9f0936c4668a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:39.118589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76db3d-529e-4be7-8a1d-9f0936c4668a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:39.118589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76db3d-529e-4be7-8a1d-9f0936c4668a None admin] RBAC: Adding query filter params (group.id=40aec1b78195450d924ce47a537a831c, role.id=e97885113c774466b7432083b511fa58, scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:39.118589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76db3d-529e-4be7-8a1d-9f0936c4668a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:39.118947 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76db3d-529e-4be7-8a1d-9f0936c4668a None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:39.127777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 224/451] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 2 13:35:38 2022] GET /identity/v3/role_assignments?group.id=40aec1b78195450d924ce47a537a831c&scope.project.id=6f7ae5221dfd4916ad28175a8e6ccf21&role.id=e97885113c774466b7432083b511fa58 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:39.187885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f29ba8-3686-41e2-b9ea-a94102c28a4b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:39.225021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34fc94-3016-4cf0-b5a3-2076fde93b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:39.225598 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34fc94-3016-4cf0-b5a3-2076fde93b6e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:39.225877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34fc94-3016-4cf0-b5a3-2076fde93b6e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:39.226152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34fc94-3016-4cf0-b5a3-2076fde93b6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:39.432001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34fc94-3016-4cf0-b5a3-2076fde93b6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:39.433525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34fc94-3016-4cf0-b5a3-2076fde93b6e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:39.459504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:39.546287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 228/452] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:35:39.552203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76db3d-529e-4be7-8a1d-9f0936c4668a None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:39.638019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:39.649231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76db3d-529e-4be7-8a1d-9f0936c4668a None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:39.682986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4edf8-db10-4e2a-a74d-d0943d29eae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:39.683856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4edf8-db10-4e2a-a74d-d0943d29eae3 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:39.684135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4edf8-db10-4e2a-a74d-d0943d29eae3 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:39.684405 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4edf8-db10-4e2a-a74d-d0943d29eae3 None admin] PATH_INFO: `/v3/projects/dbf6a4ee0a34470ea6e2b9b95f130787` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:39.685592 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4edf8-db10-4e2a-a74d-d0943d29eae3 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf6a4ee0a34470ea6e2b9b95f130787)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:39.687017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4edf8-db10-4e2a-a74d-d0943d29eae3 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:39.688719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 225/453] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:35:39 2022] GET /identity/v3/projects/dbf6a4ee0a34470ea6e2b9b95f130787 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:39.694231 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34fc94-3016-4cf0-b5a3-2076fde93b6e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:39.793133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34fc94-3016-4cf0-b5a3-2076fde93b6e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:39.814455 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:39.825366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da8e6a-d41d-4621-af66-33dadb530708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:39.828060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da8e6a-d41d-4621-af66-33dadb530708 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:39.828060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da8e6a-d41d-4621-af66-33dadb530708 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:39.828060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da8e6a-d41d-4621-af66-33dadb530708 None admin] PATH_INFO: `/v3/groups/c281fcb301af42d7859337ed102c29e6` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:39.828540 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da8e6a-d41d-4621-af66-33dadb530708 None admin] RBAC: Authorizing `identity:get_group(group_id=c281fcb301af42d7859337ed102c29e6)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:39.830056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da8e6a-d41d-4621-af66-33dadb530708 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:39.831692 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 229/454] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 2 13:35:39 2022] GET /identity/v3/groups/c281fcb301af42d7859337ed102c29e6 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:39.837517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4edf8-db10-4e2a-a74d-d0943d29eae3 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:39.934270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4edf8-db10-4e2a-a74d-d0943d29eae3 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:39.967036 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30779a2e-98f8-42bb-a6f9-208a9c9d14c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:39.967708 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30779a2e-98f8-42bb-a6f9-208a9c9d14c2 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:39.967991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30779a2e-98f8-42bb-a6f9-208a9c9d14c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:39.968270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30779a2e-98f8-42bb-a6f9-208a9c9d14c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:39.969096 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30779a2e-98f8-42bb-a6f9-208a9c9d14c2 None admin] RBAC: Adding query filter params (group.id=c281fcb301af42d7859337ed102c29e6, role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=dbf6a4ee0a34470ea6e2b9b95f130787) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:39.969409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30779a2e-98f8-42bb-a6f9-208a9c9d14c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:39.970842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30779a2e-98f8-42bb-a6f9-208a9c9d14c2 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:39.976543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 226/455] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 2 13:35:39 2022] GET /identity/v3/role_assignments?group.id=c281fcb301af42d7859337ed102c29e6&scope.project.id=dbf6a4ee0a34470ea6e2b9b95f130787&role.id=c5632345c9274d348669482f1f7414c8 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:42.750201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac8e7a-77d7-4545-b8e2-ebdefd183520 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:42.750822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac8e7a-77d7-4545-b8e2-ebdefd183520 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:42.750822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac8e7a-77d7-4545-b8e2-ebdefd183520 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:42.752420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 230/456] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:42.758081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1971075-6a11-4798-9ce6-16b71f83da11 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:42.758965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1971075-6a11-4798-9ce6-16b71f83da11 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:42.759503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1971075-6a11-4798-9ce6-16b71f83da11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:42.788755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-a1971075-6a11-4798-9ce6-16b71f83da11 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:42.790389 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a1971075-6a11-4798-9ce6-16b71f83da11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:42.814516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:42.897068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 227/457] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:42.946567 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac8e7a-77d7-4545-b8e2-ebdefd183520 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:43.097246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac8e7a-77d7-4545-b8e2-ebdefd183520 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:43.148910 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3985ee-4b5c-4d1f-9c21-ea5b697a1531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:43.149717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3985ee-4b5c-4d1f-9c21-ea5b697a1531 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:43.149994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3985ee-4b5c-4d1f-9c21-ea5b697a1531 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:43.150265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3985ee-4b5c-4d1f-9c21-ea5b697a1531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:43.164406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3985ee-4b5c-4d1f-9c21-ea5b697a1531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:43.165894 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3985ee-4b5c-4d1f-9c21-ea5b697a1531 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:43.182383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea98701-31b6-49d1-9159-0987aacae9bc None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:43.182956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea98701-31b6-49d1-9159-0987aacae9bc None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:43.183438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea98701-31b6-49d1-9159-0987aacae9bc None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:43.185292 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 228/458] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-5b3985ee-4b5c-4d1f-9c21-ea5b697a1531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:43.189770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:43.190612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:43.191470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:43.191470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:43.191470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:43.191470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:43.191470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 231/459] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:43.197618 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea98701-31b6-49d1-9159-0987aacae9bc None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:43.203800 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698597be-689d-4242-bc19-1f3cf254625a None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:43.204088 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698597be-689d-4242-bc19-1f3cf254625a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:43.204508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698597be-689d-4242-bc19-1f3cf254625a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:43.243233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-698597be-689d-4242-bc19-1f3cf254625a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:43.244477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-698597be-689d-4242-bc19-1f3cf254625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:43.313093 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:43.353361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 232/460] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:43.354724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663affa-667b-4414-9adb-44bd1d1e0749 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:43.355010 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663affa-667b-4414-9adb-44bd1d1e0749 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:43.355287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663affa-667b-4414-9adb-44bd1d1e0749 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:43.359631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 233/461] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:43.366440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea98701-31b6-49d1-9159-0987aacae9bc None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:43.369421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380133a-983f-4f0c-83b3-b07156926370 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:43.369902 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380133a-983f-4f0c-83b3-b07156926370 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:43.370643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380133a-983f-4f0c-83b3-b07156926370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:43.392981 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-5380133a-983f-4f0c-83b3-b07156926370 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:43.394433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5380133a-983f-4f0c-83b3-b07156926370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:43.416842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1af6e8-92d4-4022-9815-93e4d4af35e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:43.417803 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1af6e8-92d4-4022-9815-93e4d4af35e7 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:43.418236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1af6e8-92d4-4022-9815-93e4d4af35e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:43.419307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1af6e8-92d4-4022-9815-93e4d4af35e7 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:43.421062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1af6e8-92d4-4022-9815-93e4d4af35e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:43.421677 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1af6e8-92d4-4022-9815-93e4d4af35e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:43.424022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1af6e8-92d4-4022-9815-93e4d4af35e7 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:43.441150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 229/462] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:43.442241 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1af6e8-92d4-4022-9815-93e4d4af35e7 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:43.458732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:43.491677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 234/463] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:43.491677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380133a-983f-4f0c-83b3-b07156926370 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:43.573342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1af6e8-92d4-4022-9815-93e4d4af35e7 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:43.619809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380133a-983f-4f0c-83b3-b07156926370 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:43.621723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:43.647509 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49743a-8a93-47dd-9ed9-7c16f3103e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:43.649362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49743a-8a93-47dd-9ed9-7c16f3103e72 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:43.650132 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49743a-8a93-47dd-9ed9-7c16f3103e72 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:43.650943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49743a-8a93-47dd-9ed9-7c16f3103e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:43.661080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421a3bf-1555-4dc9-b6af-c9c6c8fd54a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:43.661751 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421a3bf-1555-4dc9-b6af-c9c6c8fd54a6 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:43.662033 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421a3bf-1555-4dc9-b6af-c9c6c8fd54a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:43.662336 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421a3bf-1555-4dc9-b6af-c9c6c8fd54a6 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:43.663012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421a3bf-1555-4dc9-b6af-c9c6c8fd54a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:43.664483 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421a3bf-1555-4dc9-b6af-c9c6c8fd54a6 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:43.670522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49743a-8a93-47dd-9ed9-7c16f3103e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:43.672418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49743a-8a93-47dd-9ed9-7c16f3103e72 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-3e49743a-8a93-47dd-9ed9-7c16f3103e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:43.692672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:43.693633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:43.694463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:43.694463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:43.694463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:43.694463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:43.694463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 230/464] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:43.694717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49743a-8a93-47dd-9ed9-7c16f3103e72 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:43.765658 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:43.795488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 235/465] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:35:43 2022] POST /identity/v3/users => generated 246 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:35:43.795488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d54e6-0754-4970-aff4-710007dfe291 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:43.795488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d54e6-0754-4970-aff4-710007dfe291 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:43.795488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d54e6-0754-4970-aff4-710007dfe291 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:43.795488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 236/466] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:43.795488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d54e6-0754-4970-aff4-710007dfe291 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:43.820784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49743a-8a93-47dd-9ed9-7c16f3103e72 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:43.881415 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435602a6-d588-47d1-911c-e682a95e0fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:43.882442 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435602a6-d588-47d1-911c-e682a95e0fcf None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:43.882738 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435602a6-d588-47d1-911c-e682a95e0fcf None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:43.883022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435602a6-d588-47d1-911c-e682a95e0fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:43.899549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435602a6-d588-47d1-911c-e682a95e0fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:43.902235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435602a6-d588-47d1-911c-e682a95e0fcf None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-435602a6-d588-47d1-911c-e682a95e0fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:43.926430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:43.927374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:43.928271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:43.928271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:43.928271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:43.928271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:43.928496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 231/467] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:43.930096 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a43c-4b12-4c73-86e3-2609f21447fd None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:43.930382 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a43c-4b12-4c73-86e3-2609f21447fd None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:43.930933 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a43c-4b12-4c73-86e3-2609f21447fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:43.933913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d54e6-0754-4970-aff4-710007dfe291 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:43.953560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ce10a43c-4b12-4c73-86e3-2609f21447fd None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:43.955256 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ce10a43c-4b12-4c73-86e3-2609f21447fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:43.980005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d35fc-506f-4800-88c3-d99072d452d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:43.980826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d35fc-506f-4800-88c3-d99072d452d6 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:43.981216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d35fc-506f-4800-88c3-d99072d452d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:43.981596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d35fc-506f-4800-88c3-d99072d452d6 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:43.983059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d35fc-506f-4800-88c3-d99072d452d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:43.983540 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d35fc-506f-4800-88c3-d99072d452d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:43.985382 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d35fc-506f-4800-88c3-d99072d452d6 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:44.004730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 237/468] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:44.005792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d35fc-506f-4800-88c3-d99072d452d6 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:44.032609 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:44.050596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 232/469] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:44.056878 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a43c-4b12-4c73-86e3-2609f21447fd None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:44.139536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:44.155404 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d35fc-506f-4800-88c3-d99072d452d6 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:44.199878 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5cdc4-8c0a-4f7d-ab0c-9f522458a0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:44.201196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5cdc4-8c0a-4f7d-ab0c-9f522458a0ec None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:44.202295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5cdc4-8c0a-4f7d-ab0c-9f522458a0ec None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:44.202760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5cdc4-8c0a-4f7d-ab0c-9f522458a0ec None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:44.204157 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5cdc4-8c0a-4f7d-ab0c-9f522458a0ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:44.204665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5cdc4-8c0a-4f7d-ab0c-9f522458a0ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:44.207186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5cdc4-8c0a-4f7d-ab0c-9f522458a0ec None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:44.219281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a43c-4b12-4c73-86e3-2609f21447fd None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:44.223682 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 238/470] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:44.224831 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5cdc4-8c0a-4f7d-ab0c-9f522458a0ec None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:44.265147 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6ab6b-3ea9-47e8-a55e-ef563414ab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:44.266064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6ab6b-3ea9-47e8-a55e-ef563414ab19 None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:44.266403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6ab6b-3ea9-47e8-a55e-ef563414ab19 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:44.266687 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6ab6b-3ea9-47e8-a55e-ef563414ab19 None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:44.267411 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6ab6b-3ea9-47e8-a55e-ef563414ab19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:44.269056 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6ab6b-3ea9-47e8-a55e-ef563414ab19 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:44.320360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:44.342618 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5cdc4-8c0a-4f7d-ab0c-9f522458a0ec None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:44.362478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 233/471] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:35:44 2022] POST /identity/v3/users => generated 248 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:35:44.363849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa324970-dc3c-4234-a178-1cdbd832c2fa None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:44.364141 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa324970-dc3c-4234-a178-1cdbd832c2fa None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:44.364424 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa324970-dc3c-4234-a178-1cdbd832c2fa None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:44.370897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 234/472] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:44.370897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa324970-dc3c-4234-a178-1cdbd832c2fa None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:44.396161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a79510-96c7-4fc3-ade2-d5a55e694e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:44.397081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79510-96c7-4fc3-ade2-d5a55e694e63 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:44.397471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79510-96c7-4fc3-ade2-d5a55e694e63 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:44.397851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79510-96c7-4fc3-ade2-d5a55e694e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:44.412008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a79510-96c7-4fc3-ade2-d5a55e694e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:44.413913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a79510-96c7-4fc3-ade2-d5a55e694e63 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-44a79510-96c7-4fc3-ade2-d5a55e694e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:44.434091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:44.435025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:44.436232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:44.436232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:44.436232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:44.436232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:44.436232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 239/473] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:44.437712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5d37-c5d3-4441-8d1d-661cdcb91ba5 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:44.438198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5d37-c5d3-4441-8d1d-661cdcb91ba5 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:44.438583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5d37-c5d3-4441-8d1d-661cdcb91ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:44.458411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f34b5d37-c5d3-4441-8d1d-661cdcb91ba5 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:44.459906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f34b5d37-c5d3-4441-8d1d-661cdcb91ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:44.501945 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:44.503202 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa324970-dc3c-4234-a178-1cdbd832c2fa None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:44.551292 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152ea3c-b9b7-4604-b285-8828175a2274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:44.552164 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152ea3c-b9b7-4604-b285-8828175a2274 None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:44.552543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152ea3c-b9b7-4604-b285-8828175a2274 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:44.552915 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152ea3c-b9b7-4604-b285-8828175a2274 None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:44.553950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152ea3c-b9b7-4604-b285-8828175a2274 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:44.557154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152ea3c-b9b7-4604-b285-8828175a2274 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:44.559969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 240/474] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:44.559969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b5d37-c5d3-4441-8d1d-661cdcb91ba5 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:44.647151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:44.702339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 235/475] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:35:44 2022] POST /identity/v3/users => generated 248 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:35:44.704033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152ea3c-b9b7-4604-b285-8828175a2274 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:44.718127 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b5d37-c5d3-4441-8d1d-661cdcb91ba5 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:44.796772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3250bc-8ab9-4e54-8f70-3cceda95d970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:44.797799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3250bc-8ab9-4e54-8f70-3cceda95d970 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:44.798256 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3250bc-8ab9-4e54-8f70-3cceda95d970 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:44.798699 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3250bc-8ab9-4e54-8f70-3cceda95d970 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:44.800077 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3250bc-8ab9-4e54-8f70-3cceda95d970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:44.800529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3250bc-8ab9-4e54-8f70-3cceda95d970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:44.803008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3250bc-8ab9-4e54-8f70-3cceda95d970 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:44.841257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 241/476] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:44.849744 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3250bc-8ab9-4e54-8f70-3cceda95d970 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:44.852182 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152ea3c-b9b7-4604-b285-8828175a2274 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:44.908314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17924c-0a62-4882-a2b0-7e439574faa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:44.908971 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17924c-0a62-4882-a2b0-7e439574faa7 None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:44.909261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17924c-0a62-4882-a2b0-7e439574faa7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:44.909544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17924c-0a62-4882-a2b0-7e439574faa7 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:44.910632 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17924c-0a62-4882-a2b0-7e439574faa7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:44.913900 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17924c-0a62-4882-a2b0-7e439574faa7 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:44.961569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.sql.core [None req-7a17924c-0a62-4882-a2b0-7e439574faa7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:35:44.961569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 13:35:44.961569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [parameters: {'id': '27c341547b0f494fa26c6179ca00ade8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 13:35:44.961569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92272) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-7a17924c-0a62-4882-a2b0-7e439574faa7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application result.read() Jun 02 13:35:44.988530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return ref.to_dict() Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:35:44.989488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application yield resource Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise self.value Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application session.commit() Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:35:44.990394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:35:44.991231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:35:44.992964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application result.read() Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:35:44.993941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [parameters: {'id': '27c341547b0f494fa26c6179ca00ade8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:44.994911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 13:35:44.996366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:44.997375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 236/477] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 2 13:35:44 2022] POST /identity/v3/roles => generated 144 bytes in 288 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:45.006428 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17924c-0a62-4882-a2b0-7e439574faa7 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:45.050547 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:45.058700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3250bc-8ab9-4e54-8f70-3cceda95d970 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:45.118848 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd52597-cf08-42ad-873f-551bbc13458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:45.119689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd52597-cf08-42ad-873f-551bbc13458c None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:45.120040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd52597-cf08-42ad-873f-551bbc13458c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:45.120644 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd52597-cf08-42ad-873f-551bbc13458c None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:45.121440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd52597-cf08-42ad-873f-551bbc13458c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:45.123027 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd52597-cf08-42ad-873f-551bbc13458c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:45.127865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:45.190731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17924c-0a62-4882-a2b0-7e439574faa7 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:45.203780 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 242/478] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:35:44 2022] POST /identity/v3/users => generated 249 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:35:45.238287 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7915d-02aa-4553-910a-d01f901e59c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:45.239130 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7915d-02aa-4553-910a-d01f901e59c8 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:45.239415 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7915d-02aa-4553-910a-d01f901e59c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:45.239726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7915d-02aa-4553-910a-d01f901e59c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:45.257742 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7915d-02aa-4553-910a-d01f901e59c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-b5c7915d-02aa-4553-910a-d01f901e59c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:45.266829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:45.267988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:45.268777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:45.268777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:45.268777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:45.268777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:45.268777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:45.268777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:45.268777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:45.268777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:45.268777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:45.268777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:45.268777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:35:45.268777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:45.272900 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 237/479] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:35:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:45.274363 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd52597-cf08-42ad-873f-551bbc13458c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:45.410164 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd52597-cf08-42ad-873f-551bbc13458c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:45.449625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab4958-4772-46e8-906b-098723ee6cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:45.450232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab4958-4772-46e8-906b-098723ee6cf5 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:45.450516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab4958-4772-46e8-906b-098723ee6cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:45.450790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab4958-4772-46e8-906b-098723ee6cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:45.452176 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab4958-4772-46e8-906b-098723ee6cf5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:45.452484 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab4958-4772-46e8-906b-098723ee6cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:45.453912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab4958-4772-46e8-906b-098723ee6cf5 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:45.470784 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 243/480] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:46.468585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2accfd6-76ec-4cf5-a0ee-a62ee7159f23 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:46.469229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2accfd6-76ec-4cf5-a0ee-a62ee7159f23 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:46.469372 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2accfd6-76ec-4cf5-a0ee-a62ee7159f23 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:46.471196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 238/481] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:46.476918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36b81b-39a3-426e-af36-b2c90531f1c6 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:46.477520 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36b81b-39a3-426e-af36-b2c90531f1c6 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:46.477520 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36b81b-39a3-426e-af36-b2c90531f1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:46.496440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-cc36b81b-39a3-426e-af36-b2c90531f1c6 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:46.497672 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-cc36b81b-39a3-426e-af36-b2c90531f1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:46.538913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:46.577638 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 244/482] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:46.601563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2accfd6-76ec-4cf5-a0ee-a62ee7159f23 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:46.698810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:46.721660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2accfd6-76ec-4cf5-a0ee-a62ee7159f23 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:46.770742 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703a9e0-c31d-43c4-b9f0-330b22243c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:46.772115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a9e0-c31d-43c4-b9f0-330b22243c1f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:46.772629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a9e0-c31d-43c4-b9f0-330b22243c1f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:46.773125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a9e0-c31d-43c4-b9f0-330b22243c1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:46.796973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703a9e0-c31d-43c4-b9f0-330b22243c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-c703a9e0-c31d-43c4-b9f0-330b22243c1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:46.813480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:46.815811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:46.817753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:46.817753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:46.817753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:46.817753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:46.817753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:46.817753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:46.817753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:46.817753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:46.817753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:46.817753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:46.817753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:46.817753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:46.817753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 239/483] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:35:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:46.823479 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36b81b-39a3-426e-af36-b2c90531f1c6 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:46.933174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36b81b-39a3-426e-af36-b2c90531f1c6 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:46.972430 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdc8e2-9eea-46f4-837c-35cd0d4cdc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:46.973112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdc8e2-9eea-46f4-837c-35cd0d4cdc09 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:46.973376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdc8e2-9eea-46f4-837c-35cd0d4cdc09 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:46.973646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdc8e2-9eea-46f4-837c-35cd0d4cdc09 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:46.974410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdc8e2-9eea-46f4-837c-35cd0d4cdc09 None admin] RBAC: Adding query filter params (name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:46.974715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdc8e2-9eea-46f4-837c-35cd0d4cdc09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:46.976156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdc8e2-9eea-46f4-837c-35cd0d4cdc09 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:46.985582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 245/484] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:35:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:46.991026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703a9e0-c31d-43c4-b9f0-330b22243c1f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:47.104683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703a9e0-c31d-43c4-b9f0-330b22243c1f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:47.145881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0de0c-640e-4478-b3f5-14f0211cb2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:47.146695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0de0c-640e-4478-b3f5-14f0211cb2ea None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:47.146963 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0de0c-640e-4478-b3f5-14f0211cb2ea None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:47.147242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0de0c-640e-4478-b3f5-14f0211cb2ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:47.158072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:47.160390 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0de0c-640e-4478-b3f5-14f0211cb2ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:47.162004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0de0c-640e-4478-b3f5-14f0211cb2ea None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-09c0de0c-640e-4478-b3f5-14f0211cb2ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:47.181709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:47.184310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:47.186229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:47.186229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:47.186229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:47.186229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:47.186229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 240/485] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:35:47.194881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdc8e2-9eea-46f4-837c-35cd0d4cdc09 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:47.195159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1a2d1-c612-401b-9d81-80363fb93c86 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:47.195159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1a2d1-c612-401b-9d81-80363fb93c86 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:47.195159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1a2d1-c612-401b-9d81-80363fb93c86 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:47.195159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 241/486] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:35:47.200600 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6704b-9a8d-4ee5-92a0-f4f74ef9111a None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:47.200889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6704b-9a8d-4ee5-92a0-f4f74ef9111a None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:47.201262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6704b-9a8d-4ee5-92a0-f4f74ef9111a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:47.220453 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-59a6704b-9a8d-4ee5-92a0-f4f74ef9111a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:47.221746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-59a6704b-9a8d-4ee5-92a0-f4f74ef9111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:47.234332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:47.325703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdc8e2-9eea-46f4-837c-35cd0d4cdc09 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:47.367311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bf851-7835-4255-be71-42a17b891b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:47.368071 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bf851-7835-4255-be71-42a17b891b9e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:47.368456 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bf851-7835-4255-be71-42a17b891b9e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:47.368838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bf851-7835-4255-be71-42a17b891b9e None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:47.369709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bf851-7835-4255-be71-42a17b891b9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:47.370136 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bf851-7835-4255-be71-42a17b891b9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:47.371914 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bf851-7835-4255-be71-42a17b891b9e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:47.386660 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 246/487] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:47.396022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 242/488] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:35:47.397479 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bf851-7835-4255-be71-42a17b891b9e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:47.437310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6704b-9a8d-4ee5-92a0-f4f74ef9111a None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:47.504510 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:47.516048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bf851-7835-4255-be71-42a17b891b9e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:47.556354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfff5cc-d3bc-408b-8103-9e108c0f7041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:47.557192 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfff5cc-d3bc-408b-8103-9e108c0f7041 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:47.557509 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfff5cc-d3bc-408b-8103-9e108c0f7041 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:47.558352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfff5cc-d3bc-408b-8103-9e108c0f7041 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:47.566674 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfff5cc-d3bc-408b-8103-9e108c0f7041 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:47.568222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfff5cc-d3bc-408b-8103-9e108c0f7041 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-8bfff5cc-d3bc-408b-8103-9e108c0f7041 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:35:47.587472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:47.590812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:47.593683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:47.593683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:47.593683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:35:47.593683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:35:47.593683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:35:47.593683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:35:47.593683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:35:47.593683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:35:47.593683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:35:47.593683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:47.593683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 247/489] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 2 13:35:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:47.597772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfff5cc-d3bc-408b-8103-9e108c0f7041 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:47.710926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6704b-9a8d-4ee5-92a0-f4f74ef9111a None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:47.748977 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfff5cc-d3bc-408b-8103-9e108c0f7041 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:47.763275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:47.787937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff343672-52d1-4fb5-862e-657e7b466846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:47.788636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff343672-52d1-4fb5-862e-657e7b466846 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:47.788954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff343672-52d1-4fb5-862e-657e7b466846 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:47.789196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff343672-52d1-4fb5-862e-657e7b466846 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:47.790049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff343672-52d1-4fb5-862e-657e7b466846 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:47.790355 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff343672-52d1-4fb5-862e-657e7b466846 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:47.791855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff343672-52d1-4fb5-862e-657e7b466846 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:47.795874 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc6780-1bed-49de-bca7-1be302faef68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:47.796687 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6780-1bed-49de-bca7-1be302faef68 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:47.796970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6780-1bed-49de-bca7-1be302faef68 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:47.797248 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6780-1bed-49de-bca7-1be302faef68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:47.818934 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc6780-1bed-49de-bca7-1be302faef68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-0bdc6780-1bed-49de-bca7-1be302faef68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:47.829257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:47.830320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:47.831092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:47.831092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:47.831092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:47.831092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:47.831092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:47.831092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:47.831092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:47.831092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:47.831092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:47.831092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:47.831092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:47.831092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:47.831092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 243/490] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:35:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:47.836275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc6780-1bed-49de-bca7-1be302faef68 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:47.882015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 248/491] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 2 13:35:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:47.887267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff343672-52d1-4fb5-862e-657e7b466846 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:47.913857 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:47.965939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc6780-1bed-49de-bca7-1be302faef68 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:48.043929 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedf32a-dcd2-4d7e-8454-dad07016e0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:48.044678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedf32a-dcd2-4d7e-8454-dad07016e0d1 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:48.045645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedf32a-dcd2-4d7e-8454-dad07016e0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:48.045929 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedf32a-dcd2-4d7e-8454-dad07016e0d1 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:48.046698 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedf32a-dcd2-4d7e-8454-dad07016e0d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:48.047000 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedf32a-dcd2-4d7e-8454-dad07016e0d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:48.048449 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedf32a-dcd2-4d7e-8454-dad07016e0d1 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:48.067569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 244/492] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:35:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:48.071162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff343672-52d1-4fb5-862e-657e7b466846 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:48.072974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedf32a-dcd2-4d7e-8454-dad07016e0d1 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:48.128039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff426a0-7259-403f-8da1-7796ddca27b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:48.128704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff426a0-7259-403f-8da1-7796ddca27b5 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:48.128990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff426a0-7259-403f-8da1-7796ddca27b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:48.129266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff426a0-7259-403f-8da1-7796ddca27b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:48.171864 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:48.243802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff426a0-7259-403f-8da1-7796ddca27b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:48.243802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff426a0-7259-403f-8da1-7796ddca27b5 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:48.258821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:48.301496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedf32a-dcd2-4d7e-8454-dad07016e0d1 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:48.345653 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ef338-261c-4de8-9aaa-65214e192402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:48.346817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef338-261c-4de8-9aaa-65214e192402 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:48.347351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef338-261c-4de8-9aaa-65214e192402 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:48.348000 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef338-261c-4de8-9aaa-65214e192402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:48.361405 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ef338-261c-4de8-9aaa-65214e192402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:48.363314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ef338-261c-4de8-9aaa-65214e192402 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:48.368981 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 249/493] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:35:48.370703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938862e-10fd-42e1-bc8d-fda8c6037659 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:48.370992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938862e-10fd-42e1-bc8d-fda8c6037659 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:48.371268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938862e-10fd-42e1-bc8d-fda8c6037659 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:48.376841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 250/494] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:48.376841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938862e-10fd-42e1-bc8d-fda8c6037659 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-613ef338-261c-4de8-9aaa-65214e192402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:48.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:48.389895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:48.390745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:48.390745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:48.390745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:48.390745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:48.397663 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 245/495] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:48.399562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a7a30-9cb1-4389-aced-b7834a63afdd None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:48.400059 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a7a30-9cb1-4389-aced-b7834a63afdd None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:48.400538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a7a30-9cb1-4389-aced-b7834a63afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:48.427677 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-278a7a30-9cb1-4389-aced-b7834a63afdd None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:48.428934 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-278a7a30-9cb1-4389-aced-b7834a63afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:48.492599 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938862e-10fd-42e1-bc8d-fda8c6037659 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:48.505238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:48.511632 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 246/496] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:48.512948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a7a30-9cb1-4389-aced-b7834a63afdd None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:48.544797 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:48.556314 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91987d34-891f-4a2d-813e-9293b9b55074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:48.556999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91987d34-891f-4a2d-813e-9293b9b55074 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:48.557280 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91987d34-891f-4a2d-813e-9293b9b55074 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:48.557554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91987d34-891f-4a2d-813e-9293b9b55074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:48.575878 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91987d34-891f-4a2d-813e-9293b9b55074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:48.577289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91987d34-891f-4a2d-813e-9293b9b55074 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-91987d34-891f-4a2d-813e-9293b9b55074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:48.597614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:48.598548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:48.604165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:48.604165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:48.604165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:48.604165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:48.604165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 251/497] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:48.604165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91987d34-891f-4a2d-813e-9293b9b55074 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:48.655164 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a7a30-9cb1-4389-aced-b7834a63afdd None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:48.689419 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e647ca0-ac80-4385-84c1-75885c1c50ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:48.689751 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e647ca0-ac80-4385-84c1-75885c1c50ba None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:48.690033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e647ca0-ac80-4385-84c1-75885c1c50ba None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:48.690300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e647ca0-ac80-4385-84c1-75885c1c50ba None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:48.691017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e647ca0-ac80-4385-84c1-75885c1c50ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:48.691318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e647ca0-ac80-4385-84c1-75885c1c50ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:48.692721 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e647ca0-ac80-4385-84c1-75885c1c50ba None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:48.708765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 247/498] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:48.708765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e647ca0-ac80-4385-84c1-75885c1c50ba None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:48.714433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91987d34-891f-4a2d-813e-9293b9b55074 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:48.757286 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcb997-450e-410e-9436-091bc79c41b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:48.758004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcb997-450e-410e-9436-091bc79c41b4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:48.758281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcb997-450e-410e-9436-091bc79c41b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:48.758552 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcb997-450e-410e-9436-091bc79c41b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:48.772027 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcb997-450e-410e-9436-091bc79c41b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-04fcb997-450e-410e-9436-091bc79c41b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:48.781816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:48.783074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:48.783883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:48.783883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:48.783883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:48.783883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:48.783883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:48.783883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:48.783883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:48.783883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:48.783883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:48.783883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:48.783883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:48.783883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:48.783883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 252/499] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:35:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:48.785348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf4250-8be3-4417-a45d-e9173e256a4d None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:48.785470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf4250-8be3-4417-a45d-e9173e256a4d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:48.785763 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf4250-8be3-4417-a45d-e9173e256a4d None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:48.787409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 253/500] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:48.788979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c063-7933-46aa-af9b-c0ecb5cd9e2d None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:48.788979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c063-7933-46aa-af9b-c0ecb5cd9e2d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:48.789349 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c063-7933-46aa-af9b-c0ecb5cd9e2d None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:48.791860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 254/501] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:48.791860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9c063-7933-46aa-af9b-c0ecb5cd9e2d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:48.814768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:48.830531 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:48.847602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e647ca0-ac80-4385-84c1-75885c1c50ba None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:48.885315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f2314-5867-4bae-82f5-7d97dcea846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:48.885982 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f2314-5867-4bae-82f5-7d97dcea846c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:48.886263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f2314-5867-4bae-82f5-7d97dcea846c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:48.886534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f2314-5867-4bae-82f5-7d97dcea846c None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:48.887257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f2314-5867-4bae-82f5-7d97dcea846c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:48.887618 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f2314-5867-4bae-82f5-7d97dcea846c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:48.889590 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f2314-5867-4bae-82f5-7d97dcea846c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:48.902563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 248/502] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:48.904985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f2314-5867-4bae-82f5-7d97dcea846c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:48.924810 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9c063-7933-46aa-af9b-c0ecb5cd9e2d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:48.959857 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae685f0-845c-4fce-aaeb-b45534ff2542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:48.960649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae685f0-845c-4fce-aaeb-b45534ff2542 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:48.960935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae685f0-845c-4fce-aaeb-b45534ff2542 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:48.961210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae685f0-845c-4fce-aaeb-b45534ff2542 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:48.969314 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae685f0-845c-4fce-aaeb-b45534ff2542 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:48.970776 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae685f0-845c-4fce-aaeb-b45534ff2542 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-1ae685f0-845c-4fce-aaeb-b45534ff2542 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:35:48.985647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:48.986730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:48.987690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:48.987690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:48.987690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:35:48.987690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:35:48.987690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:35:48.987690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:35:48.987690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:35:48.987690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:35:48.987690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:35:48.987690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:48.987690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 255/503] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:48.988242 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81871b59-1192-4742-87af-2e23dd952d79 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:48.988457 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81871b59-1192-4742-87af-2e23dd952d79 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:48.988727 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81871b59-1192-4742-87af-2e23dd952d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:49.005920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-81871b59-1192-4742-87af-2e23dd952d79 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:49.007639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-81871b59-1192-4742-87af-2e23dd952d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:49.027150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f2314-5867-4bae-82f5-7d97dcea846c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:49.072791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d544c4-d7a7-4a58-8c84-e531c05632f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:49.073462 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d544c4-d7a7-4a58-8c84-e531c05632f4 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:49.073763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d544c4-d7a7-4a58-8c84-e531c05632f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:49.074097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d544c4-d7a7-4a58-8c84-e531c05632f4 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:49.074739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 256/504] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:49.075009 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d544c4-d7a7-4a58-8c84-e531c05632f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:49.075320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d544c4-d7a7-4a58-8c84-e531c05632f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:49.076608 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73847b4-dab7-4bcb-b723-3314562d65fd None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:49.076884 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73847b4-dab7-4bcb-b723-3314562d65fd None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:49.077158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73847b4-dab7-4bcb-b723-3314562d65fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:49.077359 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d544c4-d7a7-4a58-8c84-e531c05632f4 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:49.086612 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 249/505] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:35:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:49.087430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d544c4-d7a7-4a58-8c84-e531c05632f4 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:49.102605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:49.103601 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-a73847b4-dab7-4bcb-b723-3314562d65fd None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:49.104824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a73847b4-dab7-4bcb-b723-3314562d65fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:49.107883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:49.196825 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d544c4-d7a7-4a58-8c84-e531c05632f4 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:49.200654 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 257/506] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:49.201571 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73847b4-dab7-4bcb-b723-3314562d65fd None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:49.234187 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba84957-c661-4a14-ab59-82a533f5e834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:49.235061 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84957-c661-4a14-ab59-82a533f5e834 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:49.235256 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84957-c661-4a14-ab59-82a533f5e834 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:49.235562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84957-c661-4a14-ab59-82a533f5e834 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:49.242549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba84957-c661-4a14-ab59-82a533f5e834 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:49.244056 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba84957-c661-4a14-ab59-82a533f5e834 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-9ba84957-c661-4a14-ab59-82a533f5e834 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:35:49.260964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:49.261991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:49.262985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:35:49.262985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:35:49.262985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:35:49.262985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:35:49.262985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:35:49.262985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:35:49.262985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:49.262985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:49.262985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 250/507] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:49.263569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba84957-c661-4a14-ab59-82a533f5e834 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:49.313816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73847b4-dab7-4bcb-b723-3314562d65fd None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:49.344087 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:49.350246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2adcc-258c-4a0f-a43a-c57ab7cff365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:49.350920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2adcc-258c-4a0f-a43a-c57ab7cff365 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:49.351193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2adcc-258c-4a0f-a43a-c57ab7cff365 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:49.351491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2adcc-258c-4a0f-a43a-c57ab7cff365 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:49.352413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2adcc-258c-4a0f-a43a-c57ab7cff365 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:49.358352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2adcc-258c-4a0f-a43a-c57ab7cff365 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:49.358352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2adcc-258c-4a0f-a43a-c57ab7cff365 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:49.364206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:49.374090 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 258/508] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 2 13:35:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:49.374940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2adcc-258c-4a0f-a43a-c57ab7cff365 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:49.386702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba84957-c661-4a14-ab59-82a533f5e834 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:49.428842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32117aaa-74bd-4ea9-8856-8b33c3e57691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:49.429638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117aaa-74bd-4ea9-8856-8b33c3e57691 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:49.429911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117aaa-74bd-4ea9-8856-8b33c3e57691 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:49.430178 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117aaa-74bd-4ea9-8856-8b33c3e57691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:49.441817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117aaa-74bd-4ea9-8856-8b33c3e57691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:49.443296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117aaa-74bd-4ea9-8856-8b33c3e57691 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-32117aaa-74bd-4ea9-8856-8b33c3e57691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:49.462226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:49.463249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:49.464718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:49.464718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:49.464718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:49.464718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:49.464718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 251/509] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:49.464718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32117aaa-74bd-4ea9-8856-8b33c3e57691 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:49.490705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2adcc-258c-4a0f-a43a-c57ab7cff365 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:49.527159 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23298a-fc36-4732-99d4-2989f1029783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:49.528071 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23298a-fc36-4732-99d4-2989f1029783 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:49.528538 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23298a-fc36-4732-99d4-2989f1029783 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:49.529011 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23298a-fc36-4732-99d4-2989f1029783 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:49.544441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23298a-fc36-4732-99d4-2989f1029783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-8a23298a-fc36-4732-99d4-2989f1029783 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:49.552451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:49.553582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:49.554580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:49.554580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:49.554580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:49.554580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:49.554580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:49.554580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:49.554580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:49.554580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:49.554580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:49.554580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:49.554580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:49.554580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:49.554580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 259/510] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:35:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:49.554580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23298a-fc36-4732-99d4-2989f1029783 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:49.579165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32117aaa-74bd-4ea9-8856-8b33c3e57691 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:49.600922 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:49.615794 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:49.616015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc7d28-a9d3-4fae-90f1-2e46c2d03832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:49.616779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc7d28-a9d3-4fae-90f1-2e46c2d03832 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:49.617058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc7d28-a9d3-4fae-90f1-2e46c2d03832 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:49.617329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc7d28-a9d3-4fae-90f1-2e46c2d03832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:49.628640 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc7d28-a9d3-4fae-90f1-2e46c2d03832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:49.630128 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc7d28-a9d3-4fae-90f1-2e46c2d03832 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-b0fc7d28-a9d3-4fae-90f1-2e46c2d03832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:49.649165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:49.650110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:49.651311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:49.651311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:49.651311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:49.651311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:49.651311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 252/511] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:49.651664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc7d28-a9d3-4fae-90f1-2e46c2d03832 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:49.663955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23298a-fc36-4732-99d4-2989f1029783 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:49.704465 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7097ebe-a165-408a-bab6-550a199b367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:49.705169 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7097ebe-a165-408a-bab6-550a199b367c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:49.705452 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7097ebe-a165-408a-bab6-550a199b367c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:49.705732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7097ebe-a165-408a-bab6-550a199b367c None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:49.706531 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7097ebe-a165-408a-bab6-550a199b367c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:49.706841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7097ebe-a165-408a-bab6-550a199b367c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:49.708335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7097ebe-a165-408a-bab6-550a199b367c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:49.727946 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 260/512] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:35:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:49.729253 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7097ebe-a165-408a-bab6-550a199b367c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:49.769640 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc7d28-a9d3-4fae-90f1-2e46c2d03832 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:49.816219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d1e3b-b8d5-41ef-a6c3-42ce1ada4251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:49.816787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d1e3b-b8d5-41ef-a6c3-42ce1ada4251 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:49.817072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d1e3b-b8d5-41ef-a6c3-42ce1ada4251 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:49.817639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d1e3b-b8d5-41ef-a6c3-42ce1ada4251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:49.844498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7097ebe-a165-408a-bab6-550a199b367c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:49.862705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:49.866938 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:49.881635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de931048-3b33-4541-8f59-4e8fdf98cc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:49.882304 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931048-3b33-4541-8f59-4e8fdf98cc58 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:49.882591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931048-3b33-4541-8f59-4e8fdf98cc58 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:49.882869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931048-3b33-4541-8f59-4e8fdf98cc58 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:49.883644 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de931048-3b33-4541-8f59-4e8fdf98cc58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:49.883946 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de931048-3b33-4541-8f59-4e8fdf98cc58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:49.885343 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de931048-3b33-4541-8f59-4e8fdf98cc58 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:49.899632 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d1e3b-b8d5-41ef-a6c3-42ce1ada4251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:49.900295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 261/513] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:49.901305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d1e3b-b8d5-41ef-a6c3-42ce1ada4251 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:49.901502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de931048-3b33-4541-8f59-4e8fdf98cc58 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:50.011550 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 253/514] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:50.012815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d1e3b-b8d5-41ef-a6c3-42ce1ada4251 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:50.020620 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de931048-3b33-4541-8f59-4e8fdf98cc58 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:50.058086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b54c3-1233-4a24-8587-455ab92babd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:50.058766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b54c3-1233-4a24-8587-455ab92babd5 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:50.059047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b54c3-1233-4a24-8587-455ab92babd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:50.059326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b54c3-1233-4a24-8587-455ab92babd5 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:50.060123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b54c3-1233-4a24-8587-455ab92babd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:50.060435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b54c3-1233-4a24-8587-455ab92babd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:50.062444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b54c3-1233-4a24-8587-455ab92babd5 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:50.071576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 262/515] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:35:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:50.072265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b54c3-1233-4a24-8587-455ab92babd5 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:50.095951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:50.126890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:50.127679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d1e3b-b8d5-41ef-a6c3-42ce1ada4251 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:50.166273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b33b5-a199-44ca-becd-53b0274c8963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:50.166936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b33b5-a199-44ca-becd-53b0274c8963 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:50.167214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b33b5-a199-44ca-becd-53b0274c8963 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:50.167515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b33b5-a199-44ca-becd-53b0274c8963 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:50.168274 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b33b5-a199-44ca-becd-53b0274c8963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:50.168575 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b33b5-a199-44ca-becd-53b0274c8963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:50.169996 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b33b5-a199-44ca-becd-53b0274c8963 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:50.181940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 254/516] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:50.182784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b33b5-a199-44ca-becd-53b0274c8963 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:50.193162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b54c3-1233-4a24-8587-455ab92babd5 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:50.228646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23899e00-6caa-4e5c-a759-89aa32e47f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:50.229295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23899e00-6caa-4e5c-a759-89aa32e47f85 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:50.229575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23899e00-6caa-4e5c-a759-89aa32e47f85 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:50.229848 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23899e00-6caa-4e5c-a759-89aa32e47f85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:50.230670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23899e00-6caa-4e5c-a759-89aa32e47f85 None admin] RBAC: Adding query filter params (role.id=a9712a3506694519b4e4945b54539d79, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=b9971f2bf0f2400b90168f6032a0e226) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:50.230984 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23899e00-6caa-4e5c-a759-89aa32e47f85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:50.233005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23899e00-6caa-4e5c-a759-89aa32e47f85 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:50.238580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 263/517] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:50 2022] GET /identity/v3/role_assignments?user.id=b9971f2bf0f2400b90168f6032a0e226&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=a9712a3506694519b4e4945b54539d79 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:50.239378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23899e00-6caa-4e5c-a759-89aa32e47f85 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:50.301056 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b33b5-a199-44ca-becd-53b0274c8963 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:50.339756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:50.345253 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05119ab-2220-45d7-bddf-3bed4a0730fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:50.346070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05119ab-2220-45d7-bddf-3bed4a0730fa None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:50.346353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05119ab-2220-45d7-bddf-3bed4a0730fa None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:50.346627 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05119ab-2220-45d7-bddf-3bed4a0730fa None admin] PATH_INFO: `/v3/users/glance` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:50.356590 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05119ab-2220-45d7-bddf-3bed4a0730fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:50.360362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05119ab-2220-45d7-bddf-3bed4a0730fa None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-f05119ab-2220-45d7-bddf-3bed4a0730fa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:35:50.379635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:50.380624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:50.381523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:50.381523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:50.381523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:35:50.381523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:35:50.381523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:35:50.381523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:35:50.381523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:35:50.381523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:35:50.381523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:35:50.381523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:50.381523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 255/518] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:50.382545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05119ab-2220-45d7-bddf-3bed4a0730fa None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:50.384957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23899e00-6caa-4e5c-a759-89aa32e47f85 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:50.389505 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:50.445656 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3eaf9-ad93-4b26-b755-8cb4e468ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:50.446826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3eaf9-ad93-4b26-b755-8cb4e468ab36 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:50.447114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3eaf9-ad93-4b26-b755-8cb4e468ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:50.447394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3eaf9-ad93-4b26-b755-8cb4e468ab36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:50.459184 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3eaf9-ad93-4b26-b755-8cb4e468ab36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:50.461588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3eaf9-ad93-4b26-b755-8cb4e468ab36 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-35f3eaf9-ad93-4b26-b755-8cb4e468ab36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:50.481760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:50.483290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:50.484162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:50.484162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:50.484162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:50.484162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:50.484162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 264/519] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:50.484439 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3eaf9-ad93-4b26-b755-8cb4e468ab36 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:50.533856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05119ab-2220-45d7-bddf-3bed4a0730fa None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:50.573347 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c034ce-7f8b-410a-b86e-eda7309d6ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:50.574160 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c034ce-7f8b-410a-b86e-eda7309d6ad4 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:50.574444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c034ce-7f8b-410a-b86e-eda7309d6ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:50.574722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c034ce-7f8b-410a-b86e-eda7309d6ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:50.592569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c034ce-7f8b-410a-b86e-eda7309d6ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:50.595547 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c034ce-7f8b-410a-b86e-eda7309d6ad4 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-34c034ce-7f8b-410a-b86e-eda7309d6ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:50.616598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:50.618018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:50.619331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:50.619331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:50.619331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:50.619331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:50.619331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 256/520] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:50.619331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c034ce-7f8b-410a-b86e-eda7309d6ad4 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:50.644631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3eaf9-ad93-4b26-b755-8cb4e468ab36 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:50.676726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:50.703882 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032eacc-75a7-43ae-857e-2c14ad21d6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:50.705127 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032eacc-75a7-43ae-857e-2c14ad21d6ea None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:50.705619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032eacc-75a7-43ae-857e-2c14ad21d6ea None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:50.706055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032eacc-75a7-43ae-857e-2c14ad21d6ea None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:50.707360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032eacc-75a7-43ae-857e-2c14ad21d6ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:50.710202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032eacc-75a7-43ae-857e-2c14ad21d6ea None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:50.739965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c034ce-7f8b-410a-b86e-eda7309d6ad4 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:50.778417 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ec0d9-83c6-4315-a7b0-a51077b31fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:50.779104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ec0d9-83c6-4315-a7b0-a51077b31fdd None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:50.779434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ec0d9-83c6-4315-a7b0-a51077b31fdd None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:50.779745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ec0d9-83c6-4315-a7b0-a51077b31fdd None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:50.780601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ec0d9-83c6-4315-a7b0-a51077b31fdd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:50.780910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ec0d9-83c6-4315-a7b0-a51077b31fdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:50.782367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ec0d9-83c6-4315-a7b0-a51077b31fdd None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:50.831478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 265/521] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:35:50 2022] POST /identity/v3/users => generated 247 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:35:50.831478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032eacc-75a7-43ae-857e-2c14ad21d6ea None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:50.835818 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 257/522] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 2 13:35:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:50.836887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ec0d9-83c6-4315-a7b0-a51077b31fdd None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:50.859411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:50.997407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ec0d9-83c6-4315-a7b0-a51077b31fdd None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:51.000008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:51.046375 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032eacc-75a7-43ae-857e-2c14ad21d6ea None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:51.075947 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b2134-959d-4658-81f6-be8607c90fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:51.077025 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b2134-959d-4658-81f6-be8607c90fd9 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:51.077512 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b2134-959d-4658-81f6-be8607c90fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:51.078084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b2134-959d-4658-81f6-be8607c90fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:51.079240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b2134-959d-4658-81f6-be8607c90fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:51.082269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b2134-959d-4658-81f6-be8607c90fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:51.084351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b2134-959d-4658-81f6-be8607c90fd9 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:51.099724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9447e9-60c9-4a55-9ff0-8d0d0fdd5660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:51.100879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9447e9-60c9-4a55-9ff0-8d0d0fdd5660 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:51.101219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9447e9-60c9-4a55-9ff0-8d0d0fdd5660 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:51.101722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9447e9-60c9-4a55-9ff0-8d0d0fdd5660 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:51.103145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9447e9-60c9-4a55-9ff0-8d0d0fdd5660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:51.103756 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9447e9-60c9-4a55-9ff0-8d0d0fdd5660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:51.104609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 258/523] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:51.105213 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b2134-959d-4658-81f6-be8607c90fd9 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:51.106437 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9447e9-60c9-4a55-9ff0-8d0d0fdd5660 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:51.132906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 266/524] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:51.134581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9447e9-60c9-4a55-9ff0-8d0d0fdd5660 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:51.238191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b2134-959d-4658-81f6-be8607c90fd9 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:51.252511 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:51.286154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77c835-2620-49fb-9662-f60bc8f64e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:51.287382 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77c835-2620-49fb-9662-f60bc8f64e39 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:51.288229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77c835-2620-49fb-9662-f60bc8f64e39 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:51.289013 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77c835-2620-49fb-9662-f60bc8f64e39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:51.293383 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9447e9-60c9-4a55-9ff0-8d0d0fdd5660 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:51.333715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd439da6-9c51-41ed-9237-b84c430049d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:51.334494 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd439da6-9c51-41ed-9237-b84c430049d6 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:51.334781 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd439da6-9c51-41ed-9237-b84c430049d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:51.335058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd439da6-9c51-41ed-9237-b84c430049d6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:51.344584 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd439da6-9c51-41ed-9237-b84c430049d6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:51.346200 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd439da6-9c51-41ed-9237-b84c430049d6 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:51.355914 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-cd439da6-9c51-41ed-9237-b84c430049d6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:35:51.363047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:51.364109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:51.364989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:51.364989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:51.364989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:35:51.364989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:35:51.364989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:35:51.364989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:35:51.364989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:35:51.364989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:35:51.364989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:35:51.364989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:51.369362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 267/525] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:35:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:51.370588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd439da6-9c51-41ed-9237-b84c430049d6 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:51.389882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77c835-2620-49fb-9662-f60bc8f64e39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:51.392140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77c835-2620-49fb-9662-f60bc8f64e39 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:51.526868 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd439da6-9c51-41ed-9237-b84c430049d6 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:51.545797 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 259/526] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:51.546731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77c835-2620-49fb-9662-f60bc8f64e39 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:51.563179 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:51.569686 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120280f-f167-4809-a79c-517351731f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:51.570772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120280f-f167-4809-a79c-517351731f74 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:51.571053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120280f-f167-4809-a79c-517351731f74 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:51.571332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120280f-f167-4809-a79c-517351731f74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:51.580430 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120280f-f167-4809-a79c-517351731f74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:51.582600 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120280f-f167-4809-a79c-517351731f74 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-1120280f-f167-4809-a79c-517351731f74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:35:51.599822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:51.600675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:51.601811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:35:51.601811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:35:51.601811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:35:51.601811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:35:51.601811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:35:51.601811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:35:51.601811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:51.601811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:51.601811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 268/527] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:51.603386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120280f-f167-4809-a79c-517351731f74 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:51.613672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:51.653465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77c835-2620-49fb-9662-f60bc8f64e39 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:51.691745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3089f65-71aa-4ec5-8313-f65b0b8c4c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:51.692536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3089f65-71aa-4ec5-8313-f65b0b8c4c62 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:51.692884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3089f65-71aa-4ec5-8313-f65b0b8c4c62 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:51.693222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3089f65-71aa-4ec5-8313-f65b0b8c4c62 None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:51.694126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3089f65-71aa-4ec5-8313-f65b0b8c4c62 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:51.694503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3089f65-71aa-4ec5-8313-f65b0b8c4c62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:51.696123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3089f65-71aa-4ec5-8313-f65b0b8c4c62 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:51.714249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 260/528] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jun 2 13:35:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:51.715214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3089f65-71aa-4ec5-8313-f65b0b8c4c62 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:51.746331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120280f-f167-4809-a79c-517351731f74 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:51.786066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba077cc9-d453-4493-8b0f-aa7066827d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:51.786958 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba077cc9-d453-4493-8b0f-aa7066827d71 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:51.787288 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba077cc9-d453-4493-8b0f-aa7066827d71 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:51.787660 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba077cc9-d453-4493-8b0f-aa7066827d71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:51.806983 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba077cc9-d453-4493-8b0f-aa7066827d71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:51.808702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba077cc9-d453-4493-8b0f-aa7066827d71 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:51.827406 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3089f65-71aa-4ec5-8313-f65b0b8c4c62 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-ba077cc9-d453-4493-8b0f-aa7066827d71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:51.830020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:51.832059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:51.834235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:51.834235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:51.834235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:51.834235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:51.834235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 269/529] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:51.834235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba077cc9-d453-4493-8b0f-aa7066827d71 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:51.848907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:51.863939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6164fa5-3f55-4499-b447-ab6a272429c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:51.864600 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6164fa5-3f55-4499-b447-ab6a272429c5 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:51.864881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6164fa5-3f55-4499-b447-ab6a272429c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:51.865154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6164fa5-3f55-4499-b447-ab6a272429c5 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:51.866042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6164fa5-3f55-4499-b447-ab6a272429c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:51.866350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6164fa5-3f55-4499-b447-ab6a272429c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:51.867949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6164fa5-3f55-4499-b447-ab6a272429c5 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:51.885254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:51.887797 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 261/530] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:51.889262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6164fa5-3f55-4499-b447-ab6a272429c5 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:51.948643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba077cc9-d453-4493-8b0f-aa7066827d71 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:51.988052 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9eecb-38f7-4077-917b-b4f44862caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:51.989028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9eecb-38f7-4077-917b-b4f44862caa6 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:51.989541 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9eecb-38f7-4077-917b-b4f44862caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:51.990129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9eecb-38f7-4077-917b-b4f44862caa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:51.996246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6164fa5-3f55-4499-b447-ab6a272429c5 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:52.038853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0261790-33df-4a1d-becc-b2947e89fcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:52.039927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0261790-33df-4a1d-becc-b2947e89fcc7 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:52.039927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0261790-33df-4a1d-becc-b2947e89fcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:52.040175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0261790-33df-4a1d-becc-b2947e89fcc7 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:52.040805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0261790-33df-4a1d-becc-b2947e89fcc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:52.041113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0261790-33df-4a1d-becc-b2947e89fcc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:52.042531 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0261790-33df-4a1d-becc-b2947e89fcc7 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:52.060597 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 262/531] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:52.061892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0261790-33df-4a1d-becc-b2947e89fcc7 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:52.076884 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9eecb-38f7-4077-917b-b4f44862caa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:52.078758 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9eecb-38f7-4077-917b-b4f44862caa6 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:52.108838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:52.145319 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:52.174750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0261790-33df-4a1d-becc-b2947e89fcc7 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:52.205999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 270/532] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:52.207270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9eecb-38f7-4077-917b-b4f44862caa6 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:52.216875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dded59-4020-468f-975a-0442c659dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:52.218152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dded59-4020-468f-975a-0442c659dd5f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:52.218536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dded59-4020-468f-975a-0442c659dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:52.218835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dded59-4020-468f-975a-0442c659dd5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:52.219813 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dded59-4020-468f-975a-0442c659dd5f None admin] RBAC: Adding query filter params (role.id=a9712a3506694519b4e4945b54539d79, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=7e91db8d261d4d458b695abc4e0ab28e) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:52.220162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dded59-4020-468f-975a-0442c659dd5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:52.222260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dded59-4020-468f-975a-0442c659dd5f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:52.239617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 263/533] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:52 2022] GET /identity/v3/role_assignments?user.id=7e91db8d261d4d458b695abc4e0ab28e&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=a9712a3506694519b4e4945b54539d79 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:52.240996 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dded59-4020-468f-975a-0442c659dd5f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:52.350973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9eecb-38f7-4077-917b-b4f44862caa6 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:52.425646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106f579-27e4-48ff-8c8c-f748afd5ea87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:52.426464 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f579-27e4-48ff-8c8c-f748afd5ea87 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:52.426743 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f579-27e4-48ff-8c8c-f748afd5ea87 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:52.427017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f579-27e4-48ff-8c8c-f748afd5ea87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:52.448838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106f579-27e4-48ff-8c8c-f748afd5ea87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:52.450835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106f579-27e4-48ff-8c8c-f748afd5ea87 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-d106f579-27e4-48ff-8c8c-f748afd5ea87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:35:52.481462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:52.482318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:52.485268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:35:52.485268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:35:52.485268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:35:52.485268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:35:52.485268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:35:52.485268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:35:52.485268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:52.485268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:52.485268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 271/534] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:52.491490 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dded59-4020-468f-975a-0442c659dd5f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:52.493742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106f579-27e4-48ff-8c8c-f748afd5ea87 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:52.496720 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:52.507233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:52.533420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506e303-8886-4315-b11d-3f7dac1178d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:52.534216 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506e303-8886-4315-b11d-3f7dac1178d6 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:52.534495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506e303-8886-4315-b11d-3f7dac1178d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:52.534769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506e303-8886-4315-b11d-3f7dac1178d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:52.547873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506e303-8886-4315-b11d-3f7dac1178d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:52.550650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506e303-8886-4315-b11d-3f7dac1178d6 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-7506e303-8886-4315-b11d-3f7dac1178d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:52.583205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:52.584189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:52.585019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:52.585019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:52.585019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:52.585019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:52.600525 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 264/535] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:52.603667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506e303-8886-4315-b11d-3f7dac1178d6 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:52.692130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106f579-27e4-48ff-8c8c-f748afd5ea87 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:52.750354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683002d-28f5-4b9d-a28c-b46886240a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:52.751444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683002d-28f5-4b9d-a28c-b46886240a51 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:52.751807 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683002d-28f5-4b9d-a28c-b46886240a51 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:52.752094 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683002d-28f5-4b9d-a28c-b46886240a51 None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:52.753181 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683002d-28f5-4b9d-a28c-b46886240a51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:52.753496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683002d-28f5-4b9d-a28c-b46886240a51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:52.755808 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683002d-28f5-4b9d-a28c-b46886240a51 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:52.763720 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506e303-8886-4315-b11d-3f7dac1178d6 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:52.775976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 272/536] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:35:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:52.777748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d3e0f-44ea-4b2a-a923-eef7aa6f0279 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:52.778038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d3e0f-44ea-4b2a-a923-eef7aa6f0279 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:52.778321 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d3e0f-44ea-4b2a-a923-eef7aa6f0279 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:52.783755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 273/537] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:52.784772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d3e0f-44ea-4b2a-a923-eef7aa6f0279 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:52.811966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c240f5-f296-4e40-a85b-1ed20fa32982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:52.812652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c240f5-f296-4e40-a85b-1ed20fa32982 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:52.812937 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c240f5-f296-4e40-a85b-1ed20fa32982 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:52.813214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c240f5-f296-4e40-a85b-1ed20fa32982 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:52.813951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c240f5-f296-4e40-a85b-1ed20fa32982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:52.814543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c240f5-f296-4e40-a85b-1ed20fa32982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:52.816156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c240f5-f296-4e40-a85b-1ed20fa32982 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:52.829559 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 265/538] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:52.830596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f6b51-1a36-4187-a6a6-60fcfca75820 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:52.830888 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f6b51-1a36-4187-a6a6-60fcfca75820 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:52.831166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f6b51-1a36-4187-a6a6-60fcfca75820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:52.848927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-a29f6b51-1a36-4187-a6a6-60fcfca75820 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:52.850147 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a29f6b51-1a36-4187-a6a6-60fcfca75820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:52.862700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:52.863438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:52.912611 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d3e0f-44ea-4b2a-a923-eef7aa6f0279 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:52.924311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 266/539] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:52.925641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f6b51-1a36-4187-a6a6-60fcfca75820 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:52.955954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356fefe-3fd2-48e2-bd85-8ce783ce0732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:52.956621 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356fefe-3fd2-48e2-bd85-8ce783ce0732 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:52.956902 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356fefe-3fd2-48e2-bd85-8ce783ce0732 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:52.957175 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356fefe-3fd2-48e2-bd85-8ce783ce0732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:52.958302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356fefe-3fd2-48e2-bd85-8ce783ce0732 None admin] RBAC: Adding query filter params (role.id=a9712a3506694519b4e4945b54539d79, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=be4de0fa80784de1acfcd47a2b77d9ac) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:52.958613 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356fefe-3fd2-48e2-bd85-8ce783ce0732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:52.960296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356fefe-3fd2-48e2-bd85-8ce783ce0732 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:52.968870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 274/540] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:52 2022] GET /identity/v3/role_assignments?user.id=be4de0fa80784de1acfcd47a2b77d9ac&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=a9712a3506694519b4e4945b54539d79 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:52.975194 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356fefe-3fd2-48e2-bd85-8ce783ce0732 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:53.072898 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f6b51-1a36-4187-a6a6-60fcfca75820 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:53.120614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d286b3-0d63-44e0-abda-1e67ce14c18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:53.121479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d286b3-0d63-44e0-abda-1e67ce14c18f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:53.121766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d286b3-0d63-44e0-abda-1e67ce14c18f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:53.122120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d286b3-0d63-44e0-abda-1e67ce14c18f None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:53.131322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d286b3-0d63-44e0-abda-1e67ce14c18f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:53.132950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d286b3-0d63-44e0-abda-1e67ce14c18f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:53.150918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356fefe-3fd2-48e2-bd85-8ce783ce0732 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-a3d286b3-0d63-44e0-abda-1e67ce14c18f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:35:53.156636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:53.157532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:53.158451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:35:53.158451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:35:53.158451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:35:53.158451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:35:53.158451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:35:53.158451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:35:53.158451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:53.158451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:53.158451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 267/541] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:53.166560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d286b3-0d63-44e0-abda-1e67ce14c18f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:53.195853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:53.223232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:53.248851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9ad73-fe56-4544-97aa-4065facf7fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:53.249997 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9ad73-fe56-4544-97aa-4065facf7fdb None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:53.250456 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9ad73-fe56-4544-97aa-4065facf7fdb None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:53.251715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9ad73-fe56-4544-97aa-4065facf7fdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:53.277289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9ad73-fe56-4544-97aa-4065facf7fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-1ce9ad73-fe56-4544-97aa-4065facf7fdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:53.297039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:53.298084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:53.298854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:53.298854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:53.298854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:53.298854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:53.298854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:53.298854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:53.298854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:53.298854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:53.298854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:53.298854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:53.298854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:53.298854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:53.301400 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 275/542] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:35:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:53.306742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9ad73-fe56-4544-97aa-4065facf7fdb None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:53.309672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d286b3-0d63-44e0-abda-1e67ce14c18f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:53.354547 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea673f3-0b3a-44d2-8210-0a7d54843206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:53.355317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea673f3-0b3a-44d2-8210-0a7d54843206 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:53.355719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea673f3-0b3a-44d2-8210-0a7d54843206 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:53.356098 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea673f3-0b3a-44d2-8210-0a7d54843206 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:53.357179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea673f3-0b3a-44d2-8210-0a7d54843206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:53.357758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea673f3-0b3a-44d2-8210-0a7d54843206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:53.363481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea673f3-0b3a-44d2-8210-0a7d54843206 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:53.375191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 268/543] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:35:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:53.381492 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea673f3-0b3a-44d2-8210-0a7d54843206 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:53.464478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:53.504153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9ad73-fe56-4544-97aa-4065facf7fdb None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:53.517051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea673f3-0b3a-44d2-8210-0a7d54843206 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:53.558952 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2950270-2281-4ce6-a12d-b47b41bda2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:53.560144 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2950270-2281-4ce6-a12d-b47b41bda2c8 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:53.560814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2950270-2281-4ce6-a12d-b47b41bda2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:53.561332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2950270-2281-4ce6-a12d-b47b41bda2c8 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:53.562793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2950270-2281-4ce6-a12d-b47b41bda2c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:53.562984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecef200-94d2-4fa2-a62c-988d3815a973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:53.563358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2950270-2281-4ce6-a12d-b47b41bda2c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:53.563685 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecef200-94d2-4fa2-a62c-988d3815a973 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:53.563970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecef200-94d2-4fa2-a62c-988d3815a973 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:53.564246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecef200-94d2-4fa2-a62c-988d3815a973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:53.565083 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecef200-94d2-4fa2-a62c-988d3815a973 None admin] RBAC: Adding query filter params (role.id=a9712a3506694519b4e4945b54539d79, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=d95c75980e114aa488424fb115add647) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:53.565395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecef200-94d2-4fa2-a62c-988d3815a973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:53.566058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2950270-2281-4ce6-a12d-b47b41bda2c8 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:53.566896 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecef200-94d2-4fa2-a62c-988d3815a973 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:53.579744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 269/544] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:53 2022] GET /identity/v3/role_assignments?user.id=d95c75980e114aa488424fb115add647&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=a9712a3506694519b4e4945b54539d79 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:53.583165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f85d1d-20ed-4815-afff-5b8dc7ec101d None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:53.583165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f85d1d-20ed-4815-afff-5b8dc7ec101d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:53.583165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f85d1d-20ed-4815-afff-5b8dc7ec101d None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:53.592452 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 276/546] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:35:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:53.592657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 270/546] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:53.598795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55190f-00ec-4aec-a870-09a572303c91 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:53.599109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55190f-00ec-4aec-a870-09a572303c91 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:53.599359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55190f-00ec-4aec-a870-09a572303c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:53.600584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f85d1d-20ed-4815-afff-5b8dc7ec101d None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:53.632889 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-1d55190f-00ec-4aec-a870-09a572303c91 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:53.634046 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1d55190f-00ec-4aec-a870-09a572303c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:53.760674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f85d1d-20ed-4815-afff-5b8dc7ec101d None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:53.771432 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:53.801409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:53.808803 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1774bf8-9da1-4484-835c-afda970ea456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:53.809828 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1774bf8-9da1-4484-835c-afda970ea456 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:53.810122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1774bf8-9da1-4484-835c-afda970ea456 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:53.810402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1774bf8-9da1-4484-835c-afda970ea456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:53.826176 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1774bf8-9da1-4484-835c-afda970ea456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:53.829983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1774bf8-9da1-4484-835c-afda970ea456 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:53.834220 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 277/547] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-b1774bf8-9da1-4484-835c-afda970ea456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:53.855313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:53.856328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:53.857758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:53.857758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:53.857758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:53.857758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:53.857758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 271/548] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:53.862674 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55190f-00ec-4aec-a870-09a572303c91 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:53.866338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1774bf8-9da1-4484-835c-afda970ea456 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:53.988447 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1774bf8-9da1-4484-835c-afda970ea456 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:54.027030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db577c21-b7c5-48a6-8b99-305defe99ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:54.027870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db577c21-b7c5-48a6-8b99-305defe99ab7 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:54.028154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db577c21-b7c5-48a6-8b99-305defe99ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:54.028434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db577c21-b7c5-48a6-8b99-305defe99ab7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:54.042047 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db577c21-b7c5-48a6-8b99-305defe99ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-db577c21-b7c5-48a6-8b99-305defe99ab7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:54.050939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:54.052961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:54.053970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:54.053970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:54.053970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:54.053970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:54.053970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:54.053970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:54.053970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:54.053970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:54.053970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:54.053970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:54.053970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:54.053970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:54.053970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 272/549] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:35:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:35:54.063702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55190f-00ec-4aec-a870-09a572303c91 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:54.064547 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db577c21-b7c5-48a6-8b99-305defe99ab7 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:54.102533 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de065c9-ec39-46a1-baec-c91bd11f55ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:54.103210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de065c9-ec39-46a1-baec-c91bd11f55ba None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:54.103522 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de065c9-ec39-46a1-baec-c91bd11f55ba None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:54.103803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de065c9-ec39-46a1-baec-c91bd11f55ba None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:54.104838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de065c9-ec39-46a1-baec-c91bd11f55ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:54.105151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de065c9-ec39-46a1-baec-c91bd11f55ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:54.106877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de065c9-ec39-46a1-baec-c91bd11f55ba None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:54.121349 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 278/550] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:54.128187 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de065c9-ec39-46a1-baec-c91bd11f55ba None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:54.161242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:54.183957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:54.247541 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de065c9-ec39-46a1-baec-c91bd11f55ba None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:54.287235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255ea15-64aa-49c7-a3d5-8b35655b329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:54.288103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255ea15-64aa-49c7-a3d5-8b35655b329b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:54.288381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255ea15-64aa-49c7-a3d5-8b35655b329b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:54.288658 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255ea15-64aa-49c7-a3d5-8b35655b329b None admin] PATH_INFO: `/v3/users/nova` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:54.298150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255ea15-64aa-49c7-a3d5-8b35655b329b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:54.299330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255ea15-64aa-49c7-a3d5-8b35655b329b None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-3255ea15-64aa-49c7-a3d5-8b35655b329b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:35:54.315723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:54.316722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:54.317629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:54.317629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:54.317629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:35:54.317629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:35:54.317629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:35:54.317629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:35:54.317629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:35:54.317629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:35:54.317629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:35:54.317629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:54.317629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 279/551] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 2 13:35:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:54.324009 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255ea15-64aa-49c7-a3d5-8b35655b329b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:54.394378 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db577c21-b7c5-48a6-8b99-305defe99ab7 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:54.445089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255ea15-64aa-49c7-a3d5-8b35655b329b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:54.486407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5883757-6b30-4406-b00b-a1cd0006989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:54.487279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5883757-6b30-4406-b00b-a1cd0006989a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:54.487710 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5883757-6b30-4406-b00b-a1cd0006989a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:54.488089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5883757-6b30-4406-b00b-a1cd0006989a None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:54.489057 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5883757-6b30-4406-b00b-a1cd0006989a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:54.489711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5883757-6b30-4406-b00b-a1cd0006989a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:54.491398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5883757-6b30-4406-b00b-a1cd0006989a None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:54.495974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:54.521885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 280/552] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 2 13:35:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:35:54.521885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5883757-6b30-4406-b00b-a1cd0006989a None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:54.546822 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ffa3a-ebbf-4e49-b07a-7537d79a72cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:54.547638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ffa3a-ebbf-4e49-b07a-7537d79a72cb None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:54.547925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ffa3a-ebbf-4e49-b07a-7537d79a72cb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:54.548203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ffa3a-ebbf-4e49-b07a-7537d79a72cb None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:54.549066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ffa3a-ebbf-4e49-b07a-7537d79a72cb None admin] RBAC: Adding query filter params (name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:54.549377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ffa3a-ebbf-4e49-b07a-7537d79a72cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:54.553077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ffa3a-ebbf-4e49-b07a-7537d79a72cb None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:54.576882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 273/553] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:35:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:54.583796 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ffa3a-ebbf-4e49-b07a-7537d79a72cb None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:54.736994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5883757-6b30-4406-b00b-a1cd0006989a None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:54.785921 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ffa3a-ebbf-4e49-b07a-7537d79a72cb None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:54.799633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19619f32-2148-4226-8541-c793378c63c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:54.801408 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:54.801544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619f32-2148-4226-8541-c793378c63c8 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:54.801544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619f32-2148-4226-8541-c793378c63c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:54.801701 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619f32-2148-4226-8541-c793378c63c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:54.820956 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19619f32-2148-4226-8541-c793378c63c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:54.822453 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19619f32-2148-4226-8541-c793378c63c8 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-19619f32-2148-4226-8541-c793378c63c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:54.853912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:54.854865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:54.855851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:54.855851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:54.855851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:54.855851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:54.860336 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 281/554] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:54.865501 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a302e02-c62a-4af9-a831-6e79979e7630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:54.866310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a302e02-c62a-4af9-a831-6e79979e7630 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:54.866595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a302e02-c62a-4af9-a831-6e79979e7630 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:54.866875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a302e02-c62a-4af9-a831-6e79979e7630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:54.869664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19619f32-2148-4226-8541-c793378c63c8 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:54.885722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a302e02-c62a-4af9-a831-6e79979e7630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:54.887196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a302e02-c62a-4af9-a831-6e79979e7630 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:54.895838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-4a302e02-c62a-4af9-a831-6e79979e7630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:54.919218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:54.920224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:54.921948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:54.921948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:54.921948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:54.921948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:54.921948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 274/555] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:35:54.926992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a302e02-c62a-4af9-a831-6e79979e7630 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:55.021895 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19619f32-2148-4226-8541-c793378c63c8 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:55.056552 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a302e02-c62a-4af9-a831-6e79979e7630 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:55.059121 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf3de9-57c5-4801-a9f5-eac34fc04f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:55.059814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf3de9-57c5-4801-a9f5-eac34fc04f67 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:55.060097 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf3de9-57c5-4801-a9f5-eac34fc04f67 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:55.060369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf3de9-57c5-4801-a9f5-eac34fc04f67 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:55.061116 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf3de9-57c5-4801-a9f5-eac34fc04f67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:55.061422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf3de9-57c5-4801-a9f5-eac34fc04f67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:55.062797 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf3de9-57c5-4801-a9f5-eac34fc04f67 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:55.074996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 282/556] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:55.079920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2ff39-b20c-4635-9dbd-cdfa464d0fc2 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:55.079920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2ff39-b20c-4635-9dbd-cdfa464d0fc2 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:55.079920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2ff39-b20c-4635-9dbd-cdfa464d0fc2 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:55.082708 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 283/557] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:55.083605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2ff39-b20c-4635-9dbd-cdfa464d0fc2 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:55.110982 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706aea6-bb4d-4909-842e-429c8d32febd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:55.112824 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706aea6-bb4d-4909-842e-429c8d32febd None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:55.113331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706aea6-bb4d-4909-842e-429c8d32febd None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:55.114066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706aea6-bb4d-4909-842e-429c8d32febd None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:55.115654 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706aea6-bb4d-4909-842e-429c8d32febd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:55.116280 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706aea6-bb4d-4909-842e-429c8d32febd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:55.118973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706aea6-bb4d-4909-842e-429c8d32febd None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:55.137513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 275/558] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:55.139800 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725779-0dc1-4727-b75a-8db17629618d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:55.140218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725779-0dc1-4727-b75a-8db17629618d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:55.140504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725779-0dc1-4727-b75a-8db17629618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:55.160946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-fe725779-0dc1-4727-b75a-8db17629618d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:55.162634 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-fe725779-0dc1-4727-b75a-8db17629618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:55.170993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:55.177101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:55.215613 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2ff39-b20c-4635-9dbd-cdfa464d0fc2 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:55.255474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 276/559] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:55.255474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725779-0dc1-4727-b75a-8db17629618d None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:55.277114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce120e2a-3bd9-4a6c-a6bf-40168a303ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:55.277931 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce120e2a-3bd9-4a6c-a6bf-40168a303ff3 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:55.278208 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce120e2a-3bd9-4a6c-a6bf-40168a303ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:55.278473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce120e2a-3bd9-4a6c-a6bf-40168a303ff3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:55.289487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce120e2a-3bd9-4a6c-a6bf-40168a303ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:55.290924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce120e2a-3bd9-4a6c-a6bf-40168a303ff3 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-ce120e2a-3bd9-4a6c-a6bf-40168a303ff3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:35:55.312224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:55.313145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:55.314028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:35:55.314028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:35:55.314028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:35:55.314028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:35:55.314028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:35:55.314028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:35:55.314028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:55.314028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:55.321547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 284/560] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:55.322273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce120e2a-3bd9-4a6c-a6bf-40168a303ff3 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:55.385353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725779-0dc1-4727-b75a-8db17629618d None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:55.421460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d351173-8921-42fc-80c5-31f942324cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:55.422266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d351173-8921-42fc-80c5-31f942324cfc None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:55.422542 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d351173-8921-42fc-80c5-31f942324cfc None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:55.422814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d351173-8921-42fc-80c5-31f942324cfc None admin] PATH_INFO: `/v3/users/swift` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:55.430813 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d351173-8921-42fc-80c5-31f942324cfc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:55.432380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d351173-8921-42fc-80c5-31f942324cfc None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:55.448741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce120e2a-3bd9-4a6c-a6bf-40168a303ff3 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-4d351173-8921-42fc-80c5-31f942324cfc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:35:55.449290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:55.450323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:55.451889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:55.451889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:55.451889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:35:55.451889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:35:55.451889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:35:55.451889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:35:55.451889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:35:55.451889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:35:55.451889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:35:55.451889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:55.451889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 277/561] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:35:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:55.456701 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d351173-8921-42fc-80c5-31f942324cfc None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:55.468020 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:55.488274 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:55.500403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf791c-48a3-4fb4-a79e-852a469f1930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:55.502374 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf791c-48a3-4fb4-a79e-852a469f1930 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:55.502919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf791c-48a3-4fb4-a79e-852a469f1930 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:55.503409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf791c-48a3-4fb4-a79e-852a469f1930 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:55.518850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf791c-48a3-4fb4-a79e-852a469f1930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-1dcf791c-48a3-4fb4-a79e-852a469f1930 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:55.530103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:55.531113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:55.532017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:55.532017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:55.532017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:55.532017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:55.532017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:55.532017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:55.532017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:55.532017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:55.532017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:55.532017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:55.532017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:55.532017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:55.538221 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 285/562] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:35:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:55.538221 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf791c-48a3-4fb4-a79e-852a469f1930 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:55.586833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d351173-8921-42fc-80c5-31f942324cfc None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:55.624666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfbc84-3f56-48c1-8871-de8aa8947437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:55.625556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbc84-3f56-48c1-8871-de8aa8947437 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:55.625838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbc84-3f56-48c1-8871-de8aa8947437 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:55.626199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbc84-3f56-48c1-8871-de8aa8947437 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:55.626993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfbc84-3f56-48c1-8871-de8aa8947437 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:55.627296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfbc84-3f56-48c1-8871-de8aa8947437 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:55.628880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfbc84-3f56-48c1-8871-de8aa8947437 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:55.646086 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 278/563] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:35:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:55.646086 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfbc84-3f56-48c1-8871-de8aa8947437 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:55.658864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf791c-48a3-4fb4-a79e-852a469f1930 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:55.696601 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c368e-abe4-43a6-b55e-dae9a6d4e08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:55.697663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c368e-abe4-43a6-b55e-dae9a6d4e08c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:55.698152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c368e-abe4-43a6-b55e-dae9a6d4e08c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:55.698629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c368e-abe4-43a6-b55e-dae9a6d4e08c None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:55.699696 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c368e-abe4-43a6-b55e-dae9a6d4e08c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:55.700214 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c368e-abe4-43a6-b55e-dae9a6d4e08c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:55.702003 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c368e-abe4-43a6-b55e-dae9a6d4e08c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:55.717601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:55.726291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 286/564] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 2 13:35:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:55.726291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c368e-abe4-43a6-b55e-dae9a6d4e08c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:55.760152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfbc84-3f56-48c1-8871-de8aa8947437 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:55.777379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:55.795753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653e318-a8af-40be-80de-6cf8ce33a486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:55.796770 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653e318-a8af-40be-80de-6cf8ce33a486 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:55.797250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653e318-a8af-40be-80de-6cf8ce33a486 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:55.797717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653e318-a8af-40be-80de-6cf8ce33a486 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:55.798666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653e318-a8af-40be-80de-6cf8ce33a486 None admin] RBAC: Adding query filter params (name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:55.799205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653e318-a8af-40be-80de-6cf8ce33a486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:55.800804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653e318-a8af-40be-80de-6cf8ce33a486 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:55.814934 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 279/565] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:35:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:55.816191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653e318-a8af-40be-80de-6cf8ce33a486 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:55.833258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c368e-abe4-43a6-b55e-dae9a6d4e08c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:55.873267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097dcda-b51b-460f-aca6-49e9a083644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:55.874090 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097dcda-b51b-460f-aca6-49e9a083644d None admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:55.874371 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097dcda-b51b-460f-aca6-49e9a083644d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:55.874644 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097dcda-b51b-460f-aca6-49e9a083644d None admin] PATH_INFO: `/v3/projects/8deff8fec8614da6997a32993c033fd8/users/b9971f2bf0f2400b90168f6032a0e226/roles/a9712a3506694519b4e4945b54539d79` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:55.890652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097dcda-b51b-460f-aca6-49e9a083644d None admin] RBAC: Authorizing `identity:create_grant(project_id=8deff8fec8614da6997a32993c033fd8, user_id=b9971f2bf0f2400b90168f6032a0e226, role_id=a9712a3506694519b4e4945b54539d79)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:55.892136 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097dcda-b51b-460f-aca6-49e9a083644d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:55.929092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653e318-a8af-40be-80de-6cf8ce33a486 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:55.963485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 287/566] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:35:55 2022] PUT /identity/v3/projects/8deff8fec8614da6997a32993c033fd8/users/b9971f2bf0f2400b90168f6032a0e226/roles/a9712a3506694519b4e4945b54539d79 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:35:55.963691 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:55.963775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097dcda-b51b-460f-aca6-49e9a083644d None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:55.972023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f849a-9781-4c0f-a3fa-1e17ccf237c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:55.972695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f849a-9781-4c0f-a3fa-1e17ccf237c1 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:55.972978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f849a-9781-4c0f-a3fa-1e17ccf237c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:55.973524 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f849a-9781-4c0f-a3fa-1e17ccf237c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:56.073545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f849a-9781-4c0f-a3fa-1e17ccf237c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:56.075776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f849a-9781-4c0f-a3fa-1e17ccf237c1 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:56.088596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:56.093358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097dcda-b51b-460f-aca6-49e9a083644d None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:56.136700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c65c3e-2233-4ce1-b7b6-bba731b3f0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:56.137669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65c3e-2233-4ce1-b7b6-bba731b3f0e3 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:56.138065 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65c3e-2233-4ce1-b7b6-bba731b3f0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:56.138436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65c3e-2233-4ce1-b7b6-bba731b3f0e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:56.150732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c65c3e-2233-4ce1-b7b6-bba731b3f0e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:56.152519 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c65c3e-2233-4ce1-b7b6-bba731b3f0e3 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-74c65c3e-2233-4ce1-b7b6-bba731b3f0e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:56.175068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:56.176259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:56.177391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:56.177391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:56.177391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:56.177391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:56.179279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 288/567] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:56.180855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5f45e-fa2c-48a2-bbab-b66ca4a69a2e None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:56.181299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5f45e-fa2c-48a2-bbab-b66ca4a69a2e None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:56.181747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5f45e-fa2c-48a2-bbab-b66ca4a69a2e None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:56.183521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 289/568] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:56.188336 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5f45e-fa2c-48a2-bbab-b66ca4a69a2e None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:56.206362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 280/569] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:35:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:35:56.208274 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b0973-39b5-414b-bab0-fec3aa8b39e7 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:56.208274 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b0973-39b5-414b-bab0-fec3aa8b39e7 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:56.208274 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b0973-39b5-414b-bab0-fec3aa8b39e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:56.227698 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-f27b0973-39b5-414b-bab0-fec3aa8b39e7 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:56.228894 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f27b0973-39b5-414b-bab0-fec3aa8b39e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:56.259188 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:56.307507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5f45e-fa2c-48a2-bbab-b66ca4a69a2e None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:56.308165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 281/570] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:56.317075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610703c-f845-4888-becf-d06661d52630 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:56.318084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610703c-f845-4888-becf-d06661d52630 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:56.318604 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610703c-f845-4888-becf-d06661d52630 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:56.321083 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 282/571] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:56 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:56.322009 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610703c-f845-4888-becf-d06661d52630 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:56.352652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fe47b-6bab-48d2-aa1a-9af6b9735a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:56.353678 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fe47b-6bab-48d2-aa1a-9af6b9735a6d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:56.354173 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fe47b-6bab-48d2-aa1a-9af6b9735a6d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:56.354638 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fe47b-6bab-48d2-aa1a-9af6b9735a6d None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:56.355568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fe47b-6bab-48d2-aa1a-9af6b9735a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:56.356045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fe47b-6bab-48d2-aa1a-9af6b9735a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:56.357615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fe47b-6bab-48d2-aa1a-9af6b9735a6d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:56.369120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 290/572] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:56.370720 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279db97-1f5c-4fa5-beb0-206ac55493ab None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:56.371001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279db97-1f5c-4fa5-beb0-206ac55493ab None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:56.371272 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279db97-1f5c-4fa5-beb0-206ac55493ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:56.388302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-8279db97-1f5c-4fa5-beb0-206ac55493ab None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:56.389935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8279db97-1f5c-4fa5-beb0-206ac55493ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:56.393029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:56.440794 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610703c-f845-4888-becf-d06661d52630 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:56.467993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 291/573] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:56.467993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279db97-1f5c-4fa5-beb0-206ac55493ab None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:56.483099 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bebe13-098a-4fd5-8475-45494e9209c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:56.484018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bebe13-098a-4fd5-8475-45494e9209c1 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:56.484304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bebe13-098a-4fd5-8475-45494e9209c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:56.484603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bebe13-098a-4fd5-8475-45494e9209c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:56.496191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bebe13-098a-4fd5-8475-45494e9209c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:56.497671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bebe13-098a-4fd5-8475-45494e9209c1 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-a1bebe13-098a-4fd5-8475-45494e9209c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:56.520146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:56.521262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:56.522169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:56.522169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:56.522169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:56.522169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:56.522169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 283/574] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:56.522169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bebe13-098a-4fd5-8475-45494e9209c1 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:56.537307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:56.585960 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279db97-1f5c-4fa5-beb0-206ac55493ab None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:56.622361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77e5ef-f008-4e8b-a2ea-8f8678065234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:56.623936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77e5ef-f008-4e8b-a2ea-8f8678065234 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:56.624371 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77e5ef-f008-4e8b-a2ea-8f8678065234 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:56.624639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77e5ef-f008-4e8b-a2ea-8f8678065234 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:56.632749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:56.633751 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bebe13-098a-4fd5-8475-45494e9209c1 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:56.635711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77e5ef-f008-4e8b-a2ea-8f8678065234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-eb77e5ef-f008-4e8b-a2ea-8f8678065234 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:56.644160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:56.645089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:56.646583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:56.646583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:56.646583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:56.646583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:56.646583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:56.646583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:56.646583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:56.646583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:56.646583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:56.646583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:56.646583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:56.646583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:56.646583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 292/575] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:35:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:56.646583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77e5ef-f008-4e8b-a2ea-8f8678065234 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:56.672611 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deaefe8-2723-44de-91a1-c34043d9a6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:56.673417 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaefe8-2723-44de-91a1-c34043d9a6fa None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:56.673703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaefe8-2723-44de-91a1-c34043d9a6fa None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:56.673981 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaefe8-2723-44de-91a1-c34043d9a6fa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:56.682237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deaefe8-2723-44de-91a1-c34043d9a6fa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:56.683920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deaefe8-2723-44de-91a1-c34043d9a6fa None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-2deaefe8-2723-44de-91a1-c34043d9a6fa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:35:56.700674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:56.702435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:56.703386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:56.703386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:56.703386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:35:56.703386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:35:56.703386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:35:56.703386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:35:56.703386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:35:56.703386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:35:56.703386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:35:56.703386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:56.703386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 284/576] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:56.703386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deaefe8-2723-44de-91a1-c34043d9a6fa None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:56.760572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77e5ef-f008-4e8b-a2ea-8f8678065234 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:56.777497 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:56.798266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d0e5f-85ba-4177-9975-4f4728e29c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:56.799073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d0e5f-85ba-4177-9975-4f4728e29c3a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:56.799357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d0e5f-85ba-4177-9975-4f4728e29c3a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:56.799658 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d0e5f-85ba-4177-9975-4f4728e29c3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:56.811202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d0e5f-85ba-4177-9975-4f4728e29c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:56.812027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deaefe8-2723-44de-91a1-c34043d9a6fa None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-5c0d0e5f-85ba-4177-9975-4f4728e29c3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:56.819478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:56.820646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:56.821516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:56.821516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:56.821516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:56.821516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:56.821516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:56.821516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:56.821516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:56.821516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:56.821516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:56.821516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:56.821516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:56.821516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:56.821516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 293/577] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:35:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:56.822214 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d0e5f-85ba-4177-9975-4f4728e29c3a None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:56.856080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1651b-68c7-45f7-927d-8905ef22cf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:56.856743 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1651b-68c7-45f7-927d-8905ef22cf76 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:56.857027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1651b-68c7-45f7-927d-8905ef22cf76 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:56.857300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1651b-68c7-45f7-927d-8905ef22cf76 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:56.858597 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1651b-68c7-45f7-927d-8905ef22cf76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:56.858902 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1651b-68c7-45f7-927d-8905ef22cf76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:56.860309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1651b-68c7-45f7-927d-8905ef22cf76 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:56.872199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 285/578] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:56.872878 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1651b-68c7-45f7-927d-8905ef22cf76 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:56.892957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:56.936971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d0e5f-85ba-4177-9975-4f4728e29c3a None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:56.973282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be09d7-7378-40cd-927b-55fe4584ed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:56.973946 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be09d7-7378-40cd-927b-55fe4584ed4f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:56.974231 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be09d7-7378-40cd-927b-55fe4584ed4f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:56.974507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be09d7-7378-40cd-927b-55fe4584ed4f None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:56.975255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be09d7-7378-40cd-927b-55fe4584ed4f None admin] RBAC: Adding query filter params (name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:56.975665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be09d7-7378-40cd-927b-55fe4584ed4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:56.976967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be09d7-7378-40cd-927b-55fe4584ed4f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:56.977700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1651b-68c7-45f7-927d-8905ef22cf76 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:56.991038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 294/579] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:35:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:56.992021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be09d7-7378-40cd-927b-55fe4584ed4f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:57.008525 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:57.014932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce5565-5280-42e4-86e1-1cc3dfdfb63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:57.015660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce5565-5280-42e4-86e1-1cc3dfdfb63c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:57.015949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce5565-5280-42e4-86e1-1cc3dfdfb63c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:57.016229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce5565-5280-42e4-86e1-1cc3dfdfb63c None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:57.017142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce5565-5280-42e4-86e1-1cc3dfdfb63c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:57.017449 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce5565-5280-42e4-86e1-1cc3dfdfb63c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:57.018889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce5565-5280-42e4-86e1-1cc3dfdfb63c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:57.036941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 286/580] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 2 13:35:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:57.037817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce5565-5280-42e4-86e1-1cc3dfdfb63c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:57.108240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be09d7-7378-40cd-927b-55fe4584ed4f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:57.136637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:57.148063 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37e9c-e27a-405b-83e1-f3bf501144ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:57.166789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37e9c-e27a-405b-83e1-f3bf501144ad None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:57.166789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37e9c-e27a-405b-83e1-f3bf501144ad None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:57.166789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37e9c-e27a-405b-83e1-f3bf501144ad None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:57.166789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e37e9c-e27a-405b-83e1-f3bf501144ad None admin] RBAC: Adding query filter params (name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:57.166789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e37e9c-e27a-405b-83e1-f3bf501144ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:57.166789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e37e9c-e27a-405b-83e1-f3bf501144ad None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:57.167223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce5565-5280-42e4-86e1-1cc3dfdfb63c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:57.167300 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 295/581] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:35:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:57.167300 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37e9c-e27a-405b-83e1-f3bf501144ad None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:57.199771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d042134-66a0-4f43-a335-54d26b429a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:57.200941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d042134-66a0-4f43-a335-54d26b429a62 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:57.200941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d042134-66a0-4f43-a335-54d26b429a62 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:57.202048 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d042134-66a0-4f43-a335-54d26b429a62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:57.211201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d042134-66a0-4f43-a335-54d26b429a62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:57.213000 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d042134-66a0-4f43-a335-54d26b429a62 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-5d042134-66a0-4f43-a335-54d26b429a62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:35:57.232667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:57.233571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:57.234473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:35:57.234473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:35:57.234473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:35:57.234473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:35:57.234473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:35:57.234473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:35:57.234473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:57.234473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:57.234473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 287/582] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:57.235430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d042134-66a0-4f43-a335-54d26b429a62 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:57.267363 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37e9c-e27a-405b-83e1-f3bf501144ad None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:57.296401 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:57.306681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdd05b-5de9-4293-9724-71b0774c1797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:57.307564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdd05b-5de9-4293-9724-71b0774c1797 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:57.307850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdd05b-5de9-4293-9724-71b0774c1797 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:57.308132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdd05b-5de9-4293-9724-71b0774c1797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:57.324001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdd05b-5de9-4293-9724-71b0774c1797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:57.324187 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdd05b-5de9-4293-9724-71b0774c1797 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-74cdd05b-5de9-4293-9724-71b0774c1797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:57.343949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:57.344976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:57.345856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:57.345856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:57.345856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:57.345856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:57.345856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 296/583] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:57.346567 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdd05b-5de9-4293-9724-71b0774c1797 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:57.358508 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d042134-66a0-4f43-a335-54d26b429a62 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:57.385563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:57.397516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262406f-f031-4581-98e3-1725616aa8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:57.398420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262406f-f031-4581-98e3-1725616aa8e3 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:57.398717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262406f-f031-4581-98e3-1725616aa8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:57.398964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262406f-f031-4581-98e3-1725616aa8e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:57.410446 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262406f-f031-4581-98e3-1725616aa8e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:57.411966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262406f-f031-4581-98e3-1725616aa8e3 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-0262406f-f031-4581-98e3-1725616aa8e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:57.429022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:57.429997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:57.430886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:57.430886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:57.430886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:57.430886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:57.430886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 288/584] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:57.431702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262406f-f031-4581-98e3-1725616aa8e3 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:57.463140 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdd05b-5de9-4293-9724-71b0774c1797 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:57.497539 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae52f86-2440-4379-b329-073e82c858ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:57.499002 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae52f86-2440-4379-b329-073e82c858ab None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:57.499347 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae52f86-2440-4379-b329-073e82c858ab None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:57.499655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae52f86-2440-4379-b329-073e82c858ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:57.510232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae52f86-2440-4379-b329-073e82c858ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:57.511708 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae52f86-2440-4379-b329-073e82c858ab None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-2ae52f86-2440-4379-b329-073e82c858ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:57.531760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:57.532719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:57.533615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:57.533615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:57.533615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:57.533615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:57.533615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 297/585] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:57.533908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae52f86-2440-4379-b329-073e82c858ab None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:57.546112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:57.549797 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262406f-f031-4581-98e3-1725616aa8e3 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:57.584580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6371c-64f9-46d5-9289-4e8f7351fba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:57.585222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6371c-64f9-46d5-9289-4e8f7351fba9 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:57.585504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6371c-64f9-46d5-9289-4e8f7351fba9 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:57.585780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6371c-64f9-46d5-9289-4e8f7351fba9 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:57.586564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6371c-64f9-46d5-9289-4e8f7351fba9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:57.586871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6371c-64f9-46d5-9289-4e8f7351fba9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:57.588345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6371c-64f9-46d5-9289-4e8f7351fba9 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:57.600308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 289/586] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:35:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:57.601181 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6371c-64f9-46d5-9289-4e8f7351fba9 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:57.673510 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:57.687737 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae52f86-2440-4379-b329-073e82c858ab None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:57.717556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6371c-64f9-46d5-9289-4e8f7351fba9 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:57.729047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebccc0-9547-443e-8fb0-5cd936c5f211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:57.729707 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebccc0-9547-443e-8fb0-5cd936c5f211 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:57.729983 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebccc0-9547-443e-8fb0-5cd936c5f211 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:57.730263 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebccc0-9547-443e-8fb0-5cd936c5f211 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:57.730981 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebccc0-9547-443e-8fb0-5cd936c5f211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:57.731289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebccc0-9547-443e-8fb0-5cd936c5f211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:57.733282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebccc0-9547-443e-8fb0-5cd936c5f211 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:57.750367 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 298/587] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:57.750367 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebccc0-9547-443e-8fb0-5cd936c5f211 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:57.764677 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df312517-7d16-407e-aec4-6082f729332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:57.765580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df312517-7d16-407e-aec4-6082f729332f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:57.765875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df312517-7d16-407e-aec4-6082f729332f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:57.766147 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df312517-7d16-407e-aec4-6082f729332f None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:57.767264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df312517-7d16-407e-aec4-6082f729332f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:57.767604 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df312517-7d16-407e-aec4-6082f729332f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:57.769625 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df312517-7d16-407e-aec4-6082f729332f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:57.783324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 290/588] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:57.784103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df312517-7d16-407e-aec4-6082f729332f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:57.808632 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:57.857196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebccc0-9547-443e-8fb0-5cd936c5f211 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:57.892191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df312517-7d16-407e-aec4-6082f729332f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:57.893618 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf5988-a6c1-40f3-aefd-1c7ad0e9f6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:57.894277 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf5988-a6c1-40f3-aefd-1c7ad0e9f6f7 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:57.894555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf5988-a6c1-40f3-aefd-1c7ad0e9f6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:57.894822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf5988-a6c1-40f3-aefd-1c7ad0e9f6f7 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:57.896144 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf5988-a6c1-40f3-aefd-1c7ad0e9f6f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:57.896144 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf5988-a6c1-40f3-aefd-1c7ad0e9f6f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:57.897210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf5988-a6c1-40f3-aefd-1c7ad0e9f6f7 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:57.914703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 299/589] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:57.914703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf5988-a6c1-40f3-aefd-1c7ad0e9f6f7 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:57.927420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:57.939155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fc4f4-f9a1-4d79-9a1f-aedef8990d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:57.939961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fc4f4-f9a1-4d79-9a1f-aedef8990d45 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:57.940310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fc4f4-f9a1-4d79-9a1f-aedef8990d45 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:57.940714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fc4f4-f9a1-4d79-9a1f-aedef8990d45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:57.941751 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fc4f4-f9a1-4d79-9a1f-aedef8990d45 None admin] RBAC: Adding query filter params (role.id=a9712a3506694519b4e4945b54539d79, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=00f3424dc2ee4f828638b3a8f5c9fc5d) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:57.942149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fc4f4-f9a1-4d79-9a1f-aedef8990d45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:57.943772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fc4f4-f9a1-4d79-9a1f-aedef8990d45 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:57.959714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 291/590] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:35:57 2022] GET /identity/v3/role_assignments?user.id=00f3424dc2ee4f828638b3a8f5c9fc5d&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=a9712a3506694519b4e4945b54539d79 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:57.959714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fc4f4-f9a1-4d79-9a1f-aedef8990d45 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:58.052745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:58.069343 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf5988-a6c1-40f3-aefd-1c7ad0e9f6f7 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:58.070894 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fc4f4-f9a1-4d79-9a1f-aedef8990d45 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:58.111135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bc51f-3928-4674-a128-22c0c47652ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:58.112175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bc51f-3928-4674-a128-22c0c47652ce None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:58.112564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bc51f-3928-4674-a128-22c0c47652ce None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:58.112946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bc51f-3928-4674-a128-22c0c47652ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:58.118686 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ea2a5-2d73-453f-ae01-101ee27f9518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:58.119536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea2a5-2d73-453f-ae01-101ee27f9518 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:58.119818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea2a5-2d73-453f-ae01-101ee27f9518 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:58.120291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea2a5-2d73-453f-ae01-101ee27f9518 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:58.121483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bc51f-3928-4674-a128-22c0c47652ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:58.123280 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bc51f-3928-4674-a128-22c0c47652ce None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:58.130168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ea2a5-2d73-453f-ae01-101ee27f9518 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:58.131971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ea2a5-2d73-453f-ae01-101ee27f9518 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-ef1bc51f-3928-4674-a128-22c0c47652ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:35:58.140373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:58.141567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:58.142962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:35:58.142962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:35:58.142962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:35:58.142962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:35:58.142962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:35:58.142962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:35:58.142962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:58.142962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:58.148628 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 292/591] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:58.148628 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bc51f-3928-4674-a128-22c0c47652ce None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-206ea2a5-2d73-453f-ae01-101ee27f9518 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:35:58.151818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:58.153916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:58.156739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:58.156739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:58.156739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:35:58.156739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:35:58.156739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:35:58.156739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:35:58.156739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:35:58.156739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:35:58.156739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:35:58.156739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:58.156739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 300/592] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:35:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:58.156739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ea2a5-2d73-453f-ae01-101ee27f9518 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:58.236409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:58.283590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ea2a5-2d73-453f-ae01-101ee27f9518 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:58.287049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bc51f-3928-4674-a128-22c0c47652ce None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:58.324022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73c12a-20e8-49b7-b3d9-528006bc2cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:58.324717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73c12a-20e8-49b7-b3d9-528006bc2cf6 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:58.325064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73c12a-20e8-49b7-b3d9-528006bc2cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:58.325347 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73c12a-20e8-49b7-b3d9-528006bc2cf6 None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:58.326150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73c12a-20e8-49b7-b3d9-528006bc2cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:58.326466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73c12a-20e8-49b7-b3d9-528006bc2cf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:58.327959 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73c12a-20e8-49b7-b3d9-528006bc2cf6 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:58.332327 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ad070-1050-4acd-99a6-1e7f268921e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:58.333119 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ad070-1050-4acd-99a6-1e7f268921e9 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:58.333396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ad070-1050-4acd-99a6-1e7f268921e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:58.333664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ad070-1050-4acd-99a6-1e7f268921e9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:58.345666 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 301/593] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:35:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:58.345842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ad070-1050-4acd-99a6-1e7f268921e9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:58.345936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73c12a-20e8-49b7-b3d9-528006bc2cf6 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:58.346020 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ad070-1050-4acd-99a6-1e7f268921e9 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-c32ad070-1050-4acd-99a6-1e7f268921e9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:35:58.362821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:58.364076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:58.365218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:58.365218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:58.365218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:35:58.365218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:35:58.365218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:35:58.365218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:35:58.365218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:35:58.365218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:35:58.365218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:35:58.365218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:58.366246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 293/594] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:35:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:58.367319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63c444-a049-4faf-ac8c-ce71d180d45b None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:58.367630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63c444-a049-4faf-ac8c-ce71d180d45b None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:58.367970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63c444-a049-4faf-ac8c-ce71d180d45b None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:58.369436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 294/595] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:35:58.374307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63c444-a049-4faf-ac8c-ce71d180d45b None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:58.378198 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:58.466725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73c12a-20e8-49b7-b3d9-528006bc2cf6 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:58.491220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63c444-a049-4faf-ac8c-ce71d180d45b None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:58.495952 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:58.503931 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aee8de-b314-46fd-8e26-0b0d54b71928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:58.514775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee8de-b314-46fd-8e26-0b0d54b71928 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:58.514775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee8de-b314-46fd-8e26-0b0d54b71928 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:58.514775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee8de-b314-46fd-8e26-0b0d54b71928 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:58.514775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aee8de-b314-46fd-8e26-0b0d54b71928 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:58.514775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aee8de-b314-46fd-8e26-0b0d54b71928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:58.514775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aee8de-b314-46fd-8e26-0b0d54b71928 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:58.526976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 302/596] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 2 13:35:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:58.527657 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aee8de-b314-46fd-8e26-0b0d54b71928 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:58.535862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc977b-b5d3-47dc-ba4d-c6910dd3befb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:58.536764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc977b-b5d3-47dc-ba4d-c6910dd3befb None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:58.537047 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc977b-b5d3-47dc-ba4d-c6910dd3befb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:58.537321 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc977b-b5d3-47dc-ba4d-c6910dd3befb None admin] PATH_INFO: `/v3/projects/8deff8fec8614da6997a32993c033fd8/users/7e91db8d261d4d458b695abc4e0ab28e/roles/a9712a3506694519b4e4945b54539d79` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:58.554475 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc977b-b5d3-47dc-ba4d-c6910dd3befb None admin] RBAC: Authorizing `identity:create_grant(project_id=8deff8fec8614da6997a32993c033fd8, user_id=7e91db8d261d4d458b695abc4e0ab28e, role_id=a9712a3506694519b4e4945b54539d79)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:58.556939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc977b-b5d3-47dc-ba4d-c6910dd3befb None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:58.630692 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aee8de-b314-46fd-8e26-0b0d54b71928 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:58.665212 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed1d25-07be-4c4c-9da4-dc10fe5a52b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:58.665888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed1d25-07be-4c4c-9da4-dc10fe5a52b6 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:58.666171 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed1d25-07be-4c4c-9da4-dc10fe5a52b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:58.666445 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed1d25-07be-4c4c-9da4-dc10fe5a52b6 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:58.669866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed1d25-07be-4c4c-9da4-dc10fe5a52b6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:58.669866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed1d25-07be-4c4c-9da4-dc10fe5a52b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:58.669866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed1d25-07be-4c4c-9da4-dc10fe5a52b6 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:58.687005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 303/597] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jun 2 13:35:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:58.688386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67c88f-05f3-4fbb-b360-4b8f9303ce35 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:58.688681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67c88f-05f3-4fbb-b360-4b8f9303ce35 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:58.688960 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67c88f-05f3-4fbb-b360-4b8f9303ce35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:58.705712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-8a67c88f-05f3-4fbb-b360-4b8f9303ce35 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:35:58.706918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8a67c88f-05f3-4fbb-b360-4b8f9303ce35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:58.723285 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 295/598] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:35:58 2022] PUT /identity/v3/projects/8deff8fec8614da6997a32993c033fd8/users/7e91db8d261d4d458b695abc4e0ab28e/roles/a9712a3506694519b4e4945b54539d79 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:35:58.724511 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc977b-b5d3-47dc-ba4d-c6910dd3befb None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:58.780332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:58.800814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 304/599] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:35:58.802134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67c88f-05f3-4fbb-b360-4b8f9303ce35 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:58.828051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:58.884135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc977b-b5d3-47dc-ba4d-c6910dd3befb None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:58.923298 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b39a7c-049c-40ea-b5c6-bac7c719695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:58.924569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b39a7c-049c-40ea-b5c6-bac7c719695f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:58.925246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b39a7c-049c-40ea-b5c6-bac7c719695f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:58.925743 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b39a7c-049c-40ea-b5c6-bac7c719695f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:58.938931 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b39a7c-049c-40ea-b5c6-bac7c719695f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:58.949972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b39a7c-049c-40ea-b5c6-bac7c719695f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:58.956022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67c88f-05f3-4fbb-b360-4b8f9303ce35 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-99b39a7c-049c-40ea-b5c6-bac7c719695f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:58.960479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:58.961433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:58.962307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:58.962307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:58.962307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:58.962307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:58.963128 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 296/600] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:58.967596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b39a7c-049c-40ea-b5c6-bac7c719695f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:58.999964 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce17a33-04dd-4648-9b5d-d98c1a1b59d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:59.001551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce17a33-04dd-4648-9b5d-d98c1a1b59d7 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:59.002299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce17a33-04dd-4648-9b5d-d98c1a1b59d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:59.002798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce17a33-04dd-4648-9b5d-d98c1a1b59d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:59.017742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce17a33-04dd-4648-9b5d-d98c1a1b59d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:59.020178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce17a33-04dd-4648-9b5d-d98c1a1b59d7 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-2ce17a33-04dd-4648-9b5d-d98c1a1b59d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:59.043948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:59.044921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:59.045796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:59.045796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:59.045796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:59.045796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:59.048426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 305/601] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:59.053496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce17a33-04dd-4648-9b5d-d98c1a1b59d7 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:59.084360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:59.099694 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b39a7c-049c-40ea-b5c6-bac7c719695f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:59.112205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:59.150846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e904e-e1fb-484b-97cc-a72f3f862209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:59.152449 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e904e-e1fb-484b-97cc-a72f3f862209 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:59.152940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e904e-e1fb-484b-97cc-a72f3f862209 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:59.153654 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e904e-e1fb-484b-97cc-a72f3f862209 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:59.172577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e904e-e1fb-484b-97cc-a72f3f862209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:35:59.178670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce17a33-04dd-4648-9b5d-d98c1a1b59d7 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-948e904e-e1fb-484b-97cc-a72f3f862209 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:35:59.181272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:59.182200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:59.183023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:59.183023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:59.183023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:59.183023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:59.183023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:35:59.183023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:35:59.183023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:35:59.183023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:35:59.183023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:35:59.183023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:35:59.183023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:35:59.183023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:59.190862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 297/602] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:35:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:59.192025 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e904e-e1fb-484b-97cc-a72f3f862209 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:59.224059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27cd44-b740-423a-9a0d-170cb48ab4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:59.224870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27cd44-b740-423a-9a0d-170cb48ab4e4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:59.225281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27cd44-b740-423a-9a0d-170cb48ab4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:59.225623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27cd44-b740-423a-9a0d-170cb48ab4e4 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:59.226744 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27cd44-b740-423a-9a0d-170cb48ab4e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:59.227487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27cd44-b740-423a-9a0d-170cb48ab4e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:59.229242 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27cd44-b740-423a-9a0d-170cb48ab4e4 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:59.247527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 306/603] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:59.249259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27cd44-b740-423a-9a0d-170cb48ab4e4 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:59.316453 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e904e-e1fb-484b-97cc-a72f3f862209 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:59.359569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260df9d4-5340-407a-8209-0e6db52544a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:59.360348 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df9d4-5340-407a-8209-0e6db52544a8 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:59.360695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df9d4-5340-407a-8209-0e6db52544a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:59.361039 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df9d4-5340-407a-8209-0e6db52544a8 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:59.362090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260df9d4-5340-407a-8209-0e6db52544a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:59.362460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260df9d4-5340-407a-8209-0e6db52544a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:59.364707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260df9d4-5340-407a-8209-0e6db52544a8 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:59.367116 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:59.382891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27cd44-b740-423a-9a0d-170cb48ab4e4 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:59.387273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 298/604] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:59.389098 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260df9d4-5340-407a-8209-0e6db52544a8 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:59.423127 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b4a1d-88b5-4b42-9596-79ea37dba96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:59.424175 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b4a1d-88b5-4b42-9596-79ea37dba96b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:59.424724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b4a1d-88b5-4b42-9596-79ea37dba96b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:59.424986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:59.425949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b4a1d-88b5-4b42-9596-79ea37dba96b None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:59.426887 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b4a1d-88b5-4b42-9596-79ea37dba96b None admin] RBAC: Adding query filter params (name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:59.427288 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b4a1d-88b5-4b42-9596-79ea37dba96b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:59.428834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b4a1d-88b5-4b42-9596-79ea37dba96b None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:59.442046 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 307/605] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:35:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:59.443205 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b4a1d-88b5-4b42-9596-79ea37dba96b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:59.512008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260df9d4-5340-407a-8209-0e6db52544a8 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:59.554266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c98db-eec3-4a3a-bd2c-c87f4e2b9840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:59.555224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c98db-eec3-4a3a-bd2c-c87f4e2b9840 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:59.555750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c98db-eec3-4a3a-bd2c-c87f4e2b9840 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:59.556082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c98db-eec3-4a3a-bd2c-c87f4e2b9840 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:59.563935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c98db-eec3-4a3a-bd2c-c87f4e2b9840 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:59.565584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c98db-eec3-4a3a-bd2c-c87f4e2b9840 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:59.578631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b4a1d-88b5-4b42-9596-79ea37dba96b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-ea1c98db-eec3-4a3a-bd2c-c87f4e2b9840 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:35:59.585278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:59.593297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:59.594165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:35:59.594165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:35:59.594165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:35:59.594165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:35:59.594165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:35:59.594165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:35:59.594165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:59.594165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:59.594165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 299/606] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:59.594165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c98db-eec3-4a3a-bd2c-c87f4e2b9840 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:59.626242 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d299860-11c2-48ff-8900-1f318ef9ff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:59.628151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d299860-11c2-48ff-8900-1f318ef9ff5f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:59.628636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d299860-11c2-48ff-8900-1f318ef9ff5f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:59.629325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d299860-11c2-48ff-8900-1f318ef9ff5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:59.639426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d299860-11c2-48ff-8900-1f318ef9ff5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:59.641384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d299860-11c2-48ff-8900-1f318ef9ff5f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-8d299860-11c2-48ff-8900-1f318ef9ff5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:35:59.661886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:59.662817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:59.664257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:35:59.664257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:35:59.664257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:35:59.664257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:35:59.664257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:35:59.664257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:35:59.664257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:35:59.664257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:35:59.667574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 308/607] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:59.667574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d299860-11c2-48ff-8900-1f318ef9ff5f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:59.688303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:59.706848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:59.725918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c98db-eec3-4a3a-bd2c-c87f4e2b9840 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:59.769399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9543e1-5855-4c52-9389-fb83d61e41f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:59.770313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9543e1-5855-4c52-9389-fb83d61e41f1 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:59.770659 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9543e1-5855-4c52-9389-fb83d61e41f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:59.771017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9543e1-5855-4c52-9389-fb83d61e41f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:59.786616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9543e1-5855-4c52-9389-fb83d61e41f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:59.788782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9543e1-5855-4c52-9389-fb83d61e41f1 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:59.802961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d299860-11c2-48ff-8900-1f318ef9ff5f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-0d9543e1-5855-4c52-9389-fb83d61e41f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:35:59.812152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:35:59.813104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:35:59.813962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:35:59.813962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:35:59.813962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:35:59.813962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:35:59.818567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 300/608] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:35:59.819530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9543e1-5855-4c52-9389-fb83d61e41f1 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:59.849937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89475f8-3c03-4b5a-8715-e4a7073e4c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:59.851209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89475f8-3c03-4b5a-8715-e4a7073e4c96 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:59.851698 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89475f8-3c03-4b5a-8715-e4a7073e4c96 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:59.852337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89475f8-3c03-4b5a-8715-e4a7073e4c96 None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:59.853647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89475f8-3c03-4b5a-8715-e4a7073e4c96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:35:59.854365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89475f8-3c03-4b5a-8715-e4a7073e4c96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:59.856496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89475f8-3c03-4b5a-8715-e4a7073e4c96 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:59.872647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 309/609] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:35:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:35:59.873801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89475f8-3c03-4b5a-8715-e4a7073e4c96 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:59.967593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:59.971062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9543e1-5855-4c52-9389-fb83d61e41f1 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:00.010322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89475f8-3c03-4b5a-8715-e4a7073e4c96 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:00.017141 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6de7ab-6816-4bc7-b2d7-16038764f1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:00.018037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6de7ab-6816-4bc7-b2d7-16038764f1b9 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:00.018461 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6de7ab-6816-4bc7-b2d7-16038764f1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:00.018955 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6de7ab-6816-4bc7-b2d7-16038764f1b9 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:00.020136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6de7ab-6816-4bc7-b2d7-16038764f1b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:00.020457 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6de7ab-6816-4bc7-b2d7-16038764f1b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:00.021914 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6de7ab-6816-4bc7-b2d7-16038764f1b9 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:00.034964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:00.048488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 301/610] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:35:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:00.048488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6de7ab-6816-4bc7-b2d7-16038764f1b9 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:00.059898 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a1806-0bee-4e50-8f7b-5c08e7162a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:00.061049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a1806-0bee-4e50-8f7b-5c08e7162a4d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:00.061346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a1806-0bee-4e50-8f7b-5c08e7162a4d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:00.061626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a1806-0bee-4e50-8f7b-5c08e7162a4d None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:00.062362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a1806-0bee-4e50-8f7b-5c08e7162a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:00.062659 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a1806-0bee-4e50-8f7b-5c08e7162a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:00.064471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a1806-0bee-4e50-8f7b-5c08e7162a4d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:00.085540 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 310/611] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:00.085540 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a1806-0bee-4e50-8f7b-5c08e7162a4d None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:00.194771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a1806-0bee-4e50-8f7b-5c08e7162a4d None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:00.202345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6de7ab-6816-4bc7-b2d7-16038764f1b9 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:00.226213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:00.235078 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f648e2c-6879-4052-8cb9-645a8685fb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:00.236034 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f648e2c-6879-4052-8cb9-645a8685fb1d None admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:00.236318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f648e2c-6879-4052-8cb9-645a8685fb1d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:00.236594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f648e2c-6879-4052-8cb9-645a8685fb1d None admin] PATH_INFO: `/v3/projects/8deff8fec8614da6997a32993c033fd8/users/d95c75980e114aa488424fb115add647/roles/a9712a3506694519b4e4945b54539d79` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:00.251297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1759b-b1c6-4b69-b63f-05cbe2fccacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:00.252147 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f648e2c-6879-4052-8cb9-645a8685fb1d None admin] RBAC: Authorizing `identity:create_grant(project_id=8deff8fec8614da6997a32993c033fd8, user_id=d95c75980e114aa488424fb115add647, role_id=a9712a3506694519b4e4945b54539d79)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:00.253670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f648e2c-6879-4052-8cb9-645a8685fb1d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:00.255326 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1759b-b1c6-4b69-b63f-05cbe2fccacd None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:00.255733 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1759b-b1c6-4b69-b63f-05cbe2fccacd None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:00.256310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1759b-b1c6-4b69-b63f-05cbe2fccacd None admin] PATH_INFO: `/v3/projects/8deff8fec8614da6997a32993c033fd8/users/be4de0fa80784de1acfcd47a2b77d9ac/roles/a9712a3506694519b4e4945b54539d79` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:00.274004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1759b-b1c6-4b69-b63f-05cbe2fccacd None admin] RBAC: Authorizing `identity:create_grant(project_id=8deff8fec8614da6997a32993c033fd8, user_id=be4de0fa80784de1acfcd47a2b77d9ac, role_id=a9712a3506694519b4e4945b54539d79)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:00.275484 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1759b-b1c6-4b69-b63f-05cbe2fccacd None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:00.367971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 311/612] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:36:00 2022] PUT /identity/v3/projects/8deff8fec8614da6997a32993c033fd8/users/d95c75980e114aa488424fb115add647/roles/a9712a3506694519b4e4945b54539d79 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:00.368806 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f648e2c-6879-4052-8cb9-645a8685fb1d None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:00.418768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 302/613] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:36:00 2022] PUT /identity/v3/projects/8deff8fec8614da6997a32993c033fd8/users/be4de0fa80784de1acfcd47a2b77d9ac/roles/a9712a3506694519b4e4945b54539d79 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:00.422489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03e476-ee30-42ac-84f6-f9515e44e2f9 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:00.422801 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03e476-ee30-42ac-84f6-f9515e44e2f9 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:00.424600 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03e476-ee30-42ac-84f6-f9515e44e2f9 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:00.427880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 303/614] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:00.432496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb9265-fd55-4488-8656-1762031fa4ee None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:00.432887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb9265-fd55-4488-8656-1762031fa4ee None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:00.433238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb9265-fd55-4488-8656-1762031fa4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:00.465986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-2cfb9265-fd55-4488-8656-1762031fa4ee None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:00.467656 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2cfb9265-fd55-4488-8656-1762031fa4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:00.569892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:00.593926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f648e2c-6879-4052-8cb9-645a8685fb1d None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:00.603663 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 304/615] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:36:00.622783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb9265-fd55-4488-8656-1762031fa4ee None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:00.647865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc226580-4e99-48eb-8a5e-0f0f2597896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:00.648685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc226580-4e99-48eb-8a5e-0f0f2597896a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:00.649532 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc226580-4e99-48eb-8a5e-0f0f2597896a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:00.649820 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc226580-4e99-48eb-8a5e-0f0f2597896a None admin] PATH_INFO: `/v3/users/nova` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:00.660490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc226580-4e99-48eb-8a5e-0f0f2597896a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:00.662624 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc226580-4e99-48eb-8a5e-0f0f2597896a None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-dc226580-4e99-48eb-8a5e-0f0f2597896a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:00.686284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:00.687297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:00.688320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:00.688320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:00.688320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:00.688320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:00.688320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:00.688320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:00.688320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:00.688320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:00.688320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:36:00.688320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:00.688320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 312/616] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 2 13:36:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:00.694896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc226580-4e99-48eb-8a5e-0f0f2597896a None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:00.740352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:00.750111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb9265-fd55-4488-8656-1762031fa4ee None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:00.798342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d67c6-621c-436d-8347-bf3e03d30a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:00.799997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d67c6-621c-436d-8347-bf3e03d30a47 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:00.800584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d67c6-621c-436d-8347-bf3e03d30a47 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:00.801138 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d67c6-621c-436d-8347-bf3e03d30a47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:00.814358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc226580-4e99-48eb-8a5e-0f0f2597896a None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:00.824444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d67c6-621c-436d-8347-bf3e03d30a47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-933d67c6-621c-436d-8347-bf3e03d30a47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:00.833920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:00.835063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:00.836113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:00.836113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:00.836113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:00.836113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:00.836113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:00.836113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:00.836113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:00.836113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:00.836113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:00.836113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:00.836113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:00.836113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:00.836113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 305/617] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:36:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:00.844726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d67c6-621c-436d-8347-bf3e03d30a47 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:00.881676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a2ccc-8371-4962-b05e-299ba581ce4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:00.884123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a2ccc-8371-4962-b05e-299ba581ce4d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:00.884410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a2ccc-8371-4962-b05e-299ba581ce4d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:00.884681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a2ccc-8371-4962-b05e-299ba581ce4d None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:00.885527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a2ccc-8371-4962-b05e-299ba581ce4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:00.885837 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a2ccc-8371-4962-b05e-299ba581ce4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:00.887283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a2ccc-8371-4962-b05e-299ba581ce4d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:00.926871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:00.927241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 313/618] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 2 13:36:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:00.932513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a2ccc-8371-4962-b05e-299ba581ce4d None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:00.998737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d67c6-621c-436d-8347-bf3e03d30a47 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:01.045656 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb20df5-7971-465f-9dc4-f29bc7af71b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:01.046335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb20df5-7971-465f-9dc4-f29bc7af71b4 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:01.046617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb20df5-7971-465f-9dc4-f29bc7af71b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:01.046893 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb20df5-7971-465f-9dc4-f29bc7af71b4 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:01.047683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb20df5-7971-465f-9dc4-f29bc7af71b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:01.047988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb20df5-7971-465f-9dc4-f29bc7af71b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:01.049375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb20df5-7971-465f-9dc4-f29bc7af71b4 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:01.067125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 306/619] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:36:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:01.072988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb20df5-7971-465f-9dc4-f29bc7af71b4 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:01.101668 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:01.115559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a2ccc-8371-4962-b05e-299ba581ce4d None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:01.175820 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b8632-c957-4edf-9144-07308f56657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:01.177459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8632-c957-4edf-9144-07308f56657a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:01.177998 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8632-c957-4edf-9144-07308f56657a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:01.178931 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8632-c957-4edf-9144-07308f56657a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:01.201063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:01.204979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb20df5-7971-465f-9dc4-f29bc7af71b4 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:01.243931 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469977d5-2384-46d5-8ec5-91ad96a6fbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:01.244721 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469977d5-2384-46d5-8ec5-91ad96a6fbcc None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:01.245000 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469977d5-2384-46d5-8ec5-91ad96a6fbcc None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:01.245273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469977d5-2384-46d5-8ec5-91ad96a6fbcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:01.260628 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469977d5-2384-46d5-8ec5-91ad96a6fbcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:01.262274 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469977d5-2384-46d5-8ec5-91ad96a6fbcc None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:01.275166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b8632-c957-4edf-9144-07308f56657a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:01.276974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b8632-c957-4edf-9144-07308f56657a None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-469977d5-2384-46d5-8ec5-91ad96a6fbcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:01.281956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:01.282881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:01.283823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:01.283823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:01.283823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:01.283823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:01.287845 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 307/620] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:01.289463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef617889-20d9-41b1-ae69-44dee1d3e63a None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:01.289580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef617889-20d9-41b1-ae69-44dee1d3e63a None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:01.289854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef617889-20d9-41b1-ae69-44dee1d3e63a None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:01.291422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 308/621] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:01.292453 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef617889-20d9-41b1-ae69-44dee1d3e63a None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:01.392158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:01.401022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 314/622] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:01.402002 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6926dd-36d0-4633-945c-30dd1c676498 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:01.407593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6926dd-36d0-4633-945c-30dd1c676498 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:01.407593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6926dd-36d0-4633-945c-30dd1c676498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:01.420038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-0f6926dd-36d0-4633-945c-30dd1c676498 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:01.421895 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0f6926dd-36d0-4633-945c-30dd1c676498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:01.443493 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef617889-20d9-41b1-ae69-44dee1d3e63a None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:01.490844 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c206a-7b6d-484f-aa6f-d1546fbc4592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:01.491939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c206a-7b6d-484f-aa6f-d1546fbc4592 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:01.492432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c206a-7b6d-484f-aa6f-d1546fbc4592 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:01.492910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c206a-7b6d-484f-aa6f-d1546fbc4592 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:01.493838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c206a-7b6d-484f-aa6f-d1546fbc4592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:01.494363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c206a-7b6d-484f-aa6f-d1546fbc4592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:01.496348 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c206a-7b6d-484f-aa6f-d1546fbc4592 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:01.499723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 315/623] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:36:01.500610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6926dd-36d0-4633-945c-30dd1c676498 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:01.511066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 309/624] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:01.517421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c206a-7b6d-484f-aa6f-d1546fbc4592 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:01.533267 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:01.624120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6926dd-36d0-4633-945c-30dd1c676498 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:01.624328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c206a-7b6d-484f-aa6f-d1546fbc4592 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:01.652762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:01.662324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872d342-543e-4b89-98ac-00106ce5b666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:01.662491 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5537207-2e35-4c16-9307-b8df5cefc7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:01.668256 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d342-543e-4b89-98ac-00106ce5b666 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:01.668256 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d342-543e-4b89-98ac-00106ce5b666 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:01.668443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5537207-2e35-4c16-9307-b8df5cefc7af None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:01.668551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d342-543e-4b89-98ac-00106ce5b666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:01.668627 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5537207-2e35-4c16-9307-b8df5cefc7af None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:01.668627 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5537207-2e35-4c16-9307-b8df5cefc7af None admin] PATH_INFO: `/v3/users/swift` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:01.672778 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5537207-2e35-4c16-9307-b8df5cefc7af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:01.674506 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5537207-2e35-4c16-9307-b8df5cefc7af None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:01.674618 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872d342-543e-4b89-98ac-00106ce5b666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:01.675990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872d342-543e-4b89-98ac-00106ce5b666 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-f5537207-2e35-4c16-9307-b8df5cefc7af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:01.690758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:01.691806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:01.692788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:01.692788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:01.692788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:01.692788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:01.692788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:01.692788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:01.692788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:01.692788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:01.692788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:36:01.692788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-9872d342-543e-4b89-98ac-00106ce5b666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:01.695165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:01.696041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:01.702559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:01.702559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:01.702559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:01.702559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:01.702559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 316/625] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:01.702559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872d342-543e-4b89-98ac-00106ce5b666 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:01.702924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 310/626] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:01.704439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5537207-2e35-4c16-9307-b8df5cefc7af None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:01.787231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:01.810008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872d342-543e-4b89-98ac-00106ce5b666 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:01.822210 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5537207-2e35-4c16-9307-b8df5cefc7af None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:01.847547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bad06-c285-4642-a41a-cccb4d5e1313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:01.848258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bad06-c285-4642-a41a-cccb4d5e1313 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:01.848550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bad06-c285-4642-a41a-cccb4d5e1313 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:01.848826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bad06-c285-4642-a41a-cccb4d5e1313 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:01.861162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bad06-c285-4642-a41a-cccb4d5e1313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:01.865143 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf27c5e-a005-4e32-85a0-5618a2a28b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:01.866077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf27c5e-a005-4e32-85a0-5618a2a28b52 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:01.866555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf27c5e-a005-4e32-85a0-5618a2a28b52 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:01.867047 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf27c5e-a005-4e32-85a0-5618a2a28b52 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:01.868013 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf27c5e-a005-4e32-85a0-5618a2a28b52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:01.868514 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf27c5e-a005-4e32-85a0-5618a2a28b52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-138bad06-c285-4642-a41a-cccb4d5e1313 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:01.869529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:01.870713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:01.872064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:01.872064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:01.872064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:01.872064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:01.872064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:01.872064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:01.872064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:01.872064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:01.872064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:01.872064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:01.872064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:01.872064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:01.872064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 317/627] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:36:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:01.874332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf27c5e-a005-4e32-85a0-5618a2a28b52 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:01.876841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bad06-c285-4642-a41a-cccb4d5e1313 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:01.889462 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 311/628] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:01.890798 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf27c5e-a005-4e32-85a0-5618a2a28b52 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:01.919733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:01.982795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bad06-c285-4642-a41a-cccb4d5e1313 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.002733 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf27c5e-a005-4e32-85a0-5618a2a28b52 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.018426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a8361-8e64-4870-a6b2-603f5ee7b8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.019096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a8361-8e64-4870-a6b2-603f5ee7b8a1 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.019370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a8361-8e64-4870-a6b2-603f5ee7b8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.019663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a8361-8e64-4870-a6b2-603f5ee7b8a1 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.020503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a8361-8e64-4870-a6b2-603f5ee7b8a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:02.020869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a8361-8e64-4870-a6b2-603f5ee7b8a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.022404 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a8361-8e64-4870-a6b2-603f5ee7b8a1 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.037312 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:02.044750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 318/629] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 2 13:36:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:02.044750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a8361-8e64-4870-a6b2-603f5ee7b8a1 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.049703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556d941-5912-46fc-9739-8cca30f5c1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.050602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556d941-5912-46fc-9739-8cca30f5c1e4 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.051044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556d941-5912-46fc-9739-8cca30f5c1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.052294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556d941-5912-46fc-9739-8cca30f5c1e4 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.052712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556d941-5912-46fc-9739-8cca30f5c1e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:02.053238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556d941-5912-46fc-9739-8cca30f5c1e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.054966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556d941-5912-46fc-9739-8cca30f5c1e4 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.065762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 312/630] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:36:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:02.066802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556d941-5912-46fc-9739-8cca30f5c1e4 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.149480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:02.155384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a8361-8e64-4870-a6b2-603f5ee7b8a1 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.184651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556d941-5912-46fc-9739-8cca30f5c1e4 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.190520 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e33c27-3b7d-4ed4-9787-63d329f5a86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.191318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e33c27-3b7d-4ed4-9787-63d329f5a86d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.191642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e33c27-3b7d-4ed4-9787-63d329f5a86d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.191916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e33c27-3b7d-4ed4-9787-63d329f5a86d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.199378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e33c27-3b7d-4ed4-9787-63d329f5a86d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.200666 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e33c27-3b7d-4ed4-9787-63d329f5a86d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-21e33c27-3b7d-4ed4-9787-63d329f5a86d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:02.214872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:02.215845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:02.217871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:02.217871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:02.217871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:02.217871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:02.217871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:02.217871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:02.217871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:02.217871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:02.217871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 319/631] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:02.217871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e33c27-3b7d-4ed4-9787-63d329f5a86d None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.229056 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29d897-edee-4b0d-b1c1-85d6731c79d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.230375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29d897-edee-4b0d-b1c1-85d6731c79d6 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.230851 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29d897-edee-4b0d-b1c1-85d6731c79d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.231320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29d897-edee-4b0d-b1c1-85d6731c79d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.244118 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29d897-edee-4b0d-b1c1-85d6731c79d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.246340 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29d897-edee-4b0d-b1c1-85d6731c79d6 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-ef29d897-edee-4b0d-b1c1-85d6731c79d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:02.266719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:02.267810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:02.268700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:02.268700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:02.268700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:02.268700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:02.273038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 313/632] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:02.274580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29d897-edee-4b0d-b1c1-85d6731c79d6 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.327380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:02.331296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e33c27-3b7d-4ed4-9787-63d329f5a86d None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.376243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80892454-0f76-4c31-b9d8-fc07ab789ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.377341 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80892454-0f76-4c31-b9d8-fc07ab789ef8 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.377761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80892454-0f76-4c31-b9d8-fc07ab789ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.378592 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80892454-0f76-4c31-b9d8-fc07ab789ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.389775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80892454-0f76-4c31-b9d8-fc07ab789ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.391405 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80892454-0f76-4c31-b9d8-fc07ab789ef8 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.392279 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29d897-edee-4b0d-b1c1-85d6731c79d6 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-80892454-0f76-4c31-b9d8-fc07ab789ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:02.409459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:02.410518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:02.411420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:02.411420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:02.411420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:02.411420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:02.415635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 320/633] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:02.417489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80892454-0f76-4c31-b9d8-fc07ab789ef8 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.429930 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:02.437736 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64044e1-7c3d-46c1-bb19-5a11df17fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.438774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64044e1-7c3d-46c1-bb19-5a11df17fa92 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.439280 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64044e1-7c3d-46c1-bb19-5a11df17fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.439780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64044e1-7c3d-46c1-bb19-5a11df17fa92 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.440873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64044e1-7c3d-46c1-bb19-5a11df17fa92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:02.441385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64044e1-7c3d-46c1-bb19-5a11df17fa92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.447018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64044e1-7c3d-46c1-bb19-5a11df17fa92 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.457477 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 314/634] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:02.458740 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64044e1-7c3d-46c1-bb19-5a11df17fa92 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.526161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80892454-0f76-4c31-b9d8-fc07ab789ef8 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.566908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae3248-5fb3-463f-bd82-5f16dc432b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.567652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae3248-5fb3-463f-bd82-5f16dc432b62 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.567935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae3248-5fb3-463f-bd82-5f16dc432b62 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.568213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae3248-5fb3-463f-bd82-5f16dc432b62 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.568955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae3248-5fb3-463f-bd82-5f16dc432b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:02.569261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae3248-5fb3-463f-bd82-5f16dc432b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.570681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae3248-5fb3-463f-bd82-5f16dc432b62 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.578032 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64044e1-7c3d-46c1-bb19-5a11df17fa92 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.589128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 321/635] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:02.589128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae3248-5fb3-463f-bd82-5f16dc432b62 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.590546 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:02.634923 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c7391-84ed-40d4-8fef-1c13db7b7531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.636076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c7391-84ed-40d4-8fef-1c13db7b7531 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.636557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c7391-84ed-40d4-8fef-1c13db7b7531 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.637101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c7391-84ed-40d4-8fef-1c13db7b7531 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.638172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c7391-84ed-40d4-8fef-1c13db7b7531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:02.639295 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c7391-84ed-40d4-8fef-1c13db7b7531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.641640 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c7391-84ed-40d4-8fef-1c13db7b7531 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.659355 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 315/636] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:02.660631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c7391-84ed-40d4-8fef-1c13db7b7531 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.675733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:02.722148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae3248-5fb3-463f-bd82-5f16dc432b62 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.767520 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f22f3-148c-44b1-8b0b-ec468d31f92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.768805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f22f3-148c-44b1-8b0b-ec468d31f92c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.769709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f22f3-148c-44b1-8b0b-ec468d31f92c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.770443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f22f3-148c-44b1-8b0b-ec468d31f92c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.771858 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f22f3-148c-44b1-8b0b-ec468d31f92c None admin] RBAC: Adding query filter params (role.id=a9712a3506694519b4e4945b54539d79, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=b9971f2bf0f2400b90168f6032a0e226) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:02.772826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f22f3-148c-44b1-8b0b-ec468d31f92c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.775022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f22f3-148c-44b1-8b0b-ec468d31f92c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.778351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c7391-84ed-40d4-8fef-1c13db7b7531 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.784558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 322/637] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/role_assignments?user.id=b9971f2bf0f2400b90168f6032a0e226&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=a9712a3506694519b4e4945b54539d79 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:02.785718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f22f3-148c-44b1-8b0b-ec468d31f92c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.829187 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ffa84-d1c7-440c-a07f-182cfe7fee90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.830405 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ffa84-d1c7-440c-a07f-182cfe7fee90 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.830997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ffa84-d1c7-440c-a07f-182cfe7fee90 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.831523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ffa84-d1c7-440c-a07f-182cfe7fee90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.842556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ffa84-d1c7-440c-a07f-182cfe7fee90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.845061 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ffa84-d1c7-440c-a07f-182cfe7fee90 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-ae5ffa84-d1c7-440c-a07f-182cfe7fee90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:02.865001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:02.865969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:02.866847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:02.866847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:02.866847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:02.866847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:02.866847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:02.866847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:02.866847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:02.866847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:02.869779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 316/638] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:02.875572 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ffa84-d1c7-440c-a07f-182cfe7fee90 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.907000 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f22f3-148c-44b1-8b0b-ec468d31f92c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.911535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:02.941877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:02.947209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a67af0-0123-483c-a338-03bff4ac93a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.948422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a67af0-0123-483c-a338-03bff4ac93a1 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.948939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a67af0-0123-483c-a338-03bff4ac93a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.949431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a67af0-0123-483c-a338-03bff4ac93a1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.959403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a67af0-0123-483c-a338-03bff4ac93a1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.961254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a67af0-0123-483c-a338-03bff4ac93a1 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-74a67af0-0123-483c-a338-03bff4ac93a1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:02.978053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:02.979073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:02.980068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:02.980068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:02.980068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:02.980068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:02.980068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:02.980068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:02.980068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:02.980068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:02.980068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:36:02.980068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:02.983040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 323/639] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:02.984825 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b0f46-8126-44a3-88e6-b874bd18b31f None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.985322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b0f46-8126-44a3-88e6-b874bd18b31f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.985793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b0f46-8126-44a3-88e6-b874bd18b31f None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.988038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 324/640] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:02.989202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b0f46-8126-44a3-88e6-b874bd18b31f None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:03.005156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ffa84-d1c7-440c-a07f-182cfe7fee90 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:03.045111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b603ac0-2bae-4e07-9b3a-dc91d44626d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:03.045777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b603ac0-2bae-4e07-9b3a-dc91d44626d3 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.046058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b603ac0-2bae-4e07-9b3a-dc91d44626d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.046331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b603ac0-2bae-4e07-9b3a-dc91d44626d3 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.047123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b603ac0-2bae-4e07-9b3a-dc91d44626d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:03.047423 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b603ac0-2bae-4e07-9b3a-dc91d44626d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:03.048909 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b603ac0-2bae-4e07-9b3a-dc91d44626d3 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:03.063335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 317/641] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:03.068994 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82dcb1-defe-4798-9f32-c3864f2d7c8e None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.069342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82dcb1-defe-4798-9f32-c3864f2d7c8e None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.069625 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82dcb1-defe-4798-9f32-c3864f2d7c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.089230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-1d82dcb1-defe-4798-9f32-c3864f2d7c8e None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:03.090435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1d82dcb1-defe-4798-9f32-c3864f2d7c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:03.111739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b0f46-8126-44a3-88e6-b874bd18b31f None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:03.150870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458570e-749e-4c58-89cf-bf48fa27d08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:03.151581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458570e-749e-4c58-89cf-bf48fa27d08a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.151863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458570e-749e-4c58-89cf-bf48fa27d08a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.152136 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458570e-749e-4c58-89cf-bf48fa27d08a None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.152993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458570e-749e-4c58-89cf-bf48fa27d08a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:03.153299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458570e-749e-4c58-89cf-bf48fa27d08a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:03.155284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458570e-749e-4c58-89cf-bf48fa27d08a None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:03.166946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 318/642] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:36:03.168639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108c207-03bb-4ab0-a339-cb1e76e78c95 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.169256 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108c207-03bb-4ab0-a339-cb1e76e78c95 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.169592 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108c207-03bb-4ab0-a339-cb1e76e78c95 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.175107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 319/643] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:03.175107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108c207-03bb-4ab0-a339-cb1e76e78c95 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:03.177669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 325/644] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:03.179262 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b75f46-74de-4505-ba39-639608b81ef1 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.179824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b75f46-74de-4505-ba39-639608b81ef1 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.180341 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b75f46-74de-4505-ba39-639608b81ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.197935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:03.198536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-90b75f46-74de-4505-ba39-639608b81ef1 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:03.199920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-90b75f46-74de-4505-ba39-639608b81ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:03.250394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:03.274861 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 326/645] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:36:03.276268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b75f46-74de-4505-ba39-639608b81ef1 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:03.298875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108c207-03bb-4ab0-a339-cb1e76e78c95 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:03.334462 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e375b6e-5eed-4022-8bb8-794e29b8835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:03.335351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e375b6e-5eed-4022-8bb8-794e29b8835d None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.335683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e375b6e-5eed-4022-8bb8-794e29b8835d None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.335958 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e375b6e-5eed-4022-8bb8-794e29b8835d None admin] PATH_INFO: `/v3/projects/8deff8fec8614da6997a32993c033fd8/users/00f3424dc2ee4f828638b3a8f5c9fc5d/roles/a9712a3506694519b4e4945b54539d79` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.351118 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e375b6e-5eed-4022-8bb8-794e29b8835d None admin] RBAC: Authorizing `identity:create_grant(project_id=8deff8fec8614da6997a32993c033fd8, user_id=00f3424dc2ee4f828638b3a8f5c9fc5d, role_id=a9712a3506694519b4e4945b54539d79)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:03.352774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e375b6e-5eed-4022-8bb8-794e29b8835d None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:03.389839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b75f46-74de-4505-ba39-639608b81ef1 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:03.425256 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 320/646] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:36:03 2022] PUT /identity/v3/projects/8deff8fec8614da6997a32993c033fd8/users/00f3424dc2ee4f828638b3a8f5c9fc5d/roles/a9712a3506694519b4e4945b54539d79 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:03.426082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e375b6e-5eed-4022-8bb8-794e29b8835d None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:03.441049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064a96a-b95d-42d4-ae88-7b5bd0db1df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:03.442091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064a96a-b95d-42d4-ae88-7b5bd0db1df4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.442607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064a96a-b95d-42d4-ae88-7b5bd0db1df4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.443029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064a96a-b95d-42d4-ae88-7b5bd0db1df4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.515206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:03.517146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:03.550305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064a96a-b95d-42d4-ae88-7b5bd0db1df4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:03.552986 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064a96a-b95d-42d4-ae88-7b5bd0db1df4 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:03.561776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e375b6e-5eed-4022-8bb8-794e29b8835d None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:03.604114 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bade3-dbe8-448b-86da-879bcad9bbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:03.605090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bade3-dbe8-448b-86da-879bcad9bbed None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.605483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bade3-dbe8-448b-86da-879bcad9bbed None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.605865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bade3-dbe8-448b-86da-879bcad9bbed None admin] PATH_INFO: `/v3/roles/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.620132 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bade3-dbe8-448b-86da-879bcad9bbed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-889bade3-dbe8-448b-86da-879bcad9bbed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:03.630444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:03.631688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:03.632773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:03.632773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:03.632773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:03.632773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:03.632773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:03.632773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:03.632773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:03.632773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:03.632773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:03.632773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:03.632773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:03.632773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:03.639861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 321/647] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:36:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:03.640805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bade3-dbe8-448b-86da-879bcad9bbed None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:03.699900 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 327/648] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:03.700765 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064a96a-b95d-42d4-ae88-7b5bd0db1df4 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:03.760017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bade3-dbe8-448b-86da-879bcad9bbed None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:03.788367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:03.798291 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ac28-9154-4775-94e1-ea122d84e5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:03.799187 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ac28-9154-4775-94e1-ea122d84e5aa None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.799490 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ac28-9154-4775-94e1-ea122d84e5aa None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.799777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ac28-9154-4775-94e1-ea122d84e5aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.801244 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:03.812291 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691ac28-9154-4775-94e1-ea122d84e5aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-2691ac28-9154-4775-94e1-ea122d84e5aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:03.820126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:03.821068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:03.821882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:03.821882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:03.821882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:03.821882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:03.821882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:03.821882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:03.821882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:03.821882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:03.821882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:03.821882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:03.821882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:03.821882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:03.825056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064a96a-b95d-42d4-ae88-7b5bd0db1df4 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:03.826444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 322/649] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:36:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:03.827202 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ac28-9154-4775-94e1-ea122d84e5aa None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:03.862166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d42cf-d6f4-4ceb-b9d3-d11d780045d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:03.863199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d42cf-d6f4-4ceb-b9d3-d11d780045d7 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.863977 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d42cf-d6f4-4ceb-b9d3-d11d780045d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.864497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d42cf-d6f4-4ceb-b9d3-d11d780045d7 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.865444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d42cf-d6f4-4ceb-b9d3-d11d780045d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:03.865943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d42cf-d6f4-4ceb-b9d3-d11d780045d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:03.867588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d42cf-d6f4-4ceb-b9d3-d11d780045d7 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:03.876874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 328/650] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:36:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:03.884499 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d42cf-d6f4-4ceb-b9d3-d11d780045d7 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:03.938741 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ac28-9154-4775-94e1-ea122d84e5aa None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:03.981421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba163d-3579-446e-9f9d-c4da6beed79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:03.983316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba163d-3579-446e-9f9d-c4da6beed79b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.983643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba163d-3579-446e-9f9d-c4da6beed79b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.983921 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba163d-3579-446e-9f9d-c4da6beed79b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.996513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba163d-3579-446e-9f9d-c4da6beed79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:03.999247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba163d-3579-446e-9f9d-c4da6beed79b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:04.018087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d42cf-d6f4-4ceb-b9d3-d11d780045d7 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-7bba163d-3579-446e-9f9d-c4da6beed79b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:04.023042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:04.023952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:04.024821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:04.024821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:04.024821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:04.024821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:04.024821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 323/651] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:04.025505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba163d-3579-446e-9f9d-c4da6beed79b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:04.058524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19bcde-bcb2-40f7-88f2-d07e0a0a1aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:04.059402 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19bcde-bcb2-40f7-88f2-d07e0a0a1aad None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.059741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19bcde-bcb2-40f7-88f2-d07e0a0a1aad None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.060017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19bcde-bcb2-40f7-88f2-d07e0a0a1aad None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.061008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19bcde-bcb2-40f7-88f2-d07e0a0a1aad None admin] RBAC: Adding query filter params (name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:04.062161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19bcde-bcb2-40f7-88f2-d07e0a0a1aad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:04.063840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19bcde-bcb2-40f7-88f2-d07e0a0a1aad None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:04.075090 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 329/652] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:36:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:04.075962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19bcde-bcb2-40f7-88f2-d07e0a0a1aad None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:04.079877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:04.083723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:04.153860 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba163d-3579-446e-9f9d-c4da6beed79b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:04.195509 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19bcde-bcb2-40f7-88f2-d07e0a0a1aad None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:04.202316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23259854-7635-4201-885c-6c7b8d0a3fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:04.203125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259854-7635-4201-885c-6c7b8d0a3fbe None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.203546 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259854-7635-4201-885c-6c7b8d0a3fbe None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.203790 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259854-7635-4201-885c-6c7b8d0a3fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.217961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23259854-7635-4201-885c-6c7b8d0a3fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:04.220104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23259854-7635-4201-885c-6c7b8d0a3fbe None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:04.234622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dea43b-9bcd-42ed-b758-a4ec0b432401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:04.235668 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dea43b-9bcd-42ed-b758-a4ec0b432401 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.236099 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dea43b-9bcd-42ed-b758-a4ec0b432401 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.236550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dea43b-9bcd-42ed-b758-a4ec0b432401 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.237428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dea43b-9bcd-42ed-b758-a4ec0b432401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:04.237882 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dea43b-9bcd-42ed-b758-a4ec0b432401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:04.239387 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dea43b-9bcd-42ed-b758-a4ec0b432401 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-23259854-7635-4201-885c-6c7b8d0a3fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:04.241768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:04.242912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:04.244004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:04.244004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:04.244004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:04.244004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:04.247521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 324/653] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:04.252158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23259854-7635-4201-885c-6c7b8d0a3fbe None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:04.264516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 330/654] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:04.265691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dea43b-9bcd-42ed-b758-a4ec0b432401 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:04.341664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:04.371265 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:04.384288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23259854-7635-4201-885c-6c7b8d0a3fbe None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:04.389626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dea43b-9bcd-42ed-b758-a4ec0b432401 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:04.419903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b037eeb-8188-41d2-8b09-6573b283c895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:04.421405 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b037eeb-8188-41d2-8b09-6573b283c895 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.421694 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b037eeb-8188-41d2-8b09-6573b283c895 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.421972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b037eeb-8188-41d2-8b09-6573b283c895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.434883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf80c82-0cfa-4816-a8c1-3e34fa6ecdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:04.436188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf80c82-0cfa-4816-a8c1-3e34fa6ecdd2 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.436764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf80c82-0cfa-4816-a8c1-3e34fa6ecdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.437225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf80c82-0cfa-4816-a8c1-3e34fa6ecdd2 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.437380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b037eeb-8188-41d2-8b09-6573b283c895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:04.438281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf80c82-0cfa-4816-a8c1-3e34fa6ecdd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:04.438794 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf80c82-0cfa-4816-a8c1-3e34fa6ecdd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:04.439158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b037eeb-8188-41d2-8b09-6573b283c895 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:04.440620 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf80c82-0cfa-4816-a8c1-3e34fa6ecdd2 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:04.459007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 331/655] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-2b037eeb-8188-41d2-8b09-6573b283c895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:04.459185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:04.460062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:04.460953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:04.460953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:04.460953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:04.460953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:04.462826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf80c82-0cfa-4816-a8c1-3e34fa6ecdd2 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:04.464991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 325/656] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:04.465941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b037eeb-8188-41d2-8b09-6573b283c895 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:04.585496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b037eeb-8188-41d2-8b09-6573b283c895 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:04.586112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf80c82-0cfa-4816-a8c1-3e34fa6ecdd2 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:04.611533 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:04.622938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd106cc8-fcb3-47fd-a077-73517f495f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:04.623864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106cc8-fcb3-47fd-a077-73517f495f4e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.624187 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106cc8-fcb3-47fd-a077-73517f495f4e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.624553 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106cc8-fcb3-47fd-a077-73517f495f4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.632467 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd106cc8-fcb3-47fd-a077-73517f495f4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:04.634153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd106cc8-fcb3-47fd-a077-73517f495f4e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:04.634658 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd1879-8186-4813-bfe3-b64814718009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:04.635814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd1879-8186-4813-bfe3-b64814718009 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.636555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd1879-8186-4813-bfe3-b64814718009 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.637027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd1879-8186-4813-bfe3-b64814718009 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.647178 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd1879-8186-4813-bfe3-b64814718009 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:04.649024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd1879-8186-4813-bfe3-b64814718009 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-fd106cc8-fcb3-47fd-a077-73517f495f4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:04.653075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:04.653937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:04.655471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:04.655471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:04.655471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:04.655471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:04.655471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:04.655471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:04.655471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:04.655471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:04.663703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 332/657] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:04.663703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd106cc8-fcb3-47fd-a077-73517f495f4e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-eebd1879-8186-4813-bfe3-b64814718009 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:04.672615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:04.673607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:04.675199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:04.675199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:04.675199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:04.675199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:04.675199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:04.675199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:04.675199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:04.675199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:04.675199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:36:04.675199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:04.678675 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 326/658] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:36:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:04.679581 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd1879-8186-4813-bfe3-b64814718009 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:04.682648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:04.793374 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd106cc8-fcb3-47fd-a077-73517f495f4e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:04.805341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd1879-8186-4813-bfe3-b64814718009 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:04.828548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67669-70d3-496f-bfab-56e78ad609b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:04.829606 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67669-70d3-496f-bfab-56e78ad609b2 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.829606 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67669-70d3-496f-bfab-56e78ad609b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.829812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67669-70d3-496f-bfab-56e78ad609b2 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.830438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67669-70d3-496f-bfab-56e78ad609b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:04.830738 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67669-70d3-496f-bfab-56e78ad609b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:04.832162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67669-70d3-496f-bfab-56e78ad609b2 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:04.849261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 333/659] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:04.849261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67669-70d3-496f-bfab-56e78ad609b2 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:04.852098 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de253f3c-c2cc-4064-9e48-68e1546e21c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:04.853138 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de253f3c-c2cc-4064-9e48-68e1546e21c6 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.853663 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de253f3c-c2cc-4064-9e48-68e1546e21c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.854167 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de253f3c-c2cc-4064-9e48-68e1546e21c6 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.855231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de253f3c-c2cc-4064-9e48-68e1546e21c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:04.855811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de253f3c-c2cc-4064-9e48-68e1546e21c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:04.857810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de253f3c-c2cc-4064-9e48-68e1546e21c6 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:04.878395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 327/660] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:04.879888 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de253f3c-c2cc-4064-9e48-68e1546e21c6 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:04.897328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:04.951366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:04.953747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67669-70d3-496f-bfab-56e78ad609b2 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:04.988193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86efa28-27cc-47a3-ad24-7bcd48773b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:04.988867 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86efa28-27cc-47a3-ad24-7bcd48773b4c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.989148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86efa28-27cc-47a3-ad24-7bcd48773b4c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.989423 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86efa28-27cc-47a3-ad24-7bcd48773b4c None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.990250 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86efa28-27cc-47a3-ad24-7bcd48773b4c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:04.990558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86efa28-27cc-47a3-ad24-7bcd48773b4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:04.992008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86efa28-27cc-47a3-ad24-7bcd48773b4c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:04.996272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de253f3c-c2cc-4064-9e48-68e1546e21c6 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.012474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 334/661] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jun 2 13:36:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:05.013384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86efa28-27cc-47a3-ad24-7bcd48773b4c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.035243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81d2ff-72bf-4951-9224-bad0a7462de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.036467 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81d2ff-72bf-4951-9224-bad0a7462de2 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.036986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81d2ff-72bf-4951-9224-bad0a7462de2 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.037442 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81d2ff-72bf-4951-9224-bad0a7462de2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.047037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81d2ff-72bf-4951-9224-bad0a7462de2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.048771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81d2ff-72bf-4951-9224-bad0a7462de2 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-cf81d2ff-72bf-4951-9224-bad0a7462de2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:05.064777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:05.066112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:05.067306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:05.067306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:05.067306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:05.067306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:05.067306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:05.067306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:05.067306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:05.067306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:05.067306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:36:05.067306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:05.073961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 328/662] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:36:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:05.075260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81d2ff-72bf-4951-9224-bad0a7462de2 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.121360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86efa28-27cc-47a3-ad24-7bcd48773b4c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.122920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:05.159689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff877a-1fdc-48b2-8a2c-f9b1989f7530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.160264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff877a-1fdc-48b2-8a2c-f9b1989f7530 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.160544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff877a-1fdc-48b2-8a2c-f9b1989f7530 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.160816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff877a-1fdc-48b2-8a2c-f9b1989f7530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.161755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff877a-1fdc-48b2-8a2c-f9b1989f7530 None admin] RBAC: Adding query filter params (role.id=a9712a3506694519b4e4945b54539d79, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=7e91db8d261d4d458b695abc4e0ab28e) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:05.162072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff877a-1fdc-48b2-8a2c-f9b1989f7530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.163545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff877a-1fdc-48b2-8a2c-f9b1989f7530 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.175941 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 335/663] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/role_assignments?user.id=7e91db8d261d4d458b695abc4e0ab28e&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=a9712a3506694519b4e4945b54539d79 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:05.175941 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff877a-1fdc-48b2-8a2c-f9b1989f7530 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.205831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81d2ff-72bf-4951-9224-bad0a7462de2 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.234793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:05.248643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca524eab-7745-4f25-bba9-52969bb30814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.249369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca524eab-7745-4f25-bba9-52969bb30814 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.249639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca524eab-7745-4f25-bba9-52969bb30814 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.249924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca524eab-7745-4f25-bba9-52969bb30814 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.288574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff877a-1fdc-48b2-8a2c-f9b1989f7530 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.325915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a991a9-6f32-4bc5-abff-3f5b01c6dc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.327135 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a991a9-6f32-4bc5-abff-3f5b01c6dc4e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.327414 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a991a9-6f32-4bc5-abff-3f5b01c6dc4e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.327707 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a991a9-6f32-4bc5-abff-3f5b01c6dc4e None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.328550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a991a9-6f32-4bc5-abff-3f5b01c6dc4e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:05.328854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a991a9-6f32-4bc5-abff-3f5b01c6dc4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.330319 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a991a9-6f32-4bc5-abff-3f5b01c6dc4e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.333361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca524eab-7745-4f25-bba9-52969bb30814 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.334910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca524eab-7745-4f25-bba9-52969bb30814 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.349802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 336/664] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:05.351256 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c24d1f-5b94-4566-a5ae-b36f92327722 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.351590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c24d1f-5b94-4566-a5ae-b36f92327722 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.351868 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c24d1f-5b94-4566-a5ae-b36f92327722 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.353386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 337/665] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:05.356213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c24d1f-5b94-4566-a5ae-b36f92327722 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.390846 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:05.473577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 329/666] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:05.475169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ef71-ef09-4be2-9cb7-bf12f4122092 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.475652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ef71-ef09-4be2-9cb7-bf12f4122092 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.476041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ef71-ef09-4be2-9cb7-bf12f4122092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.495868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-2935ef71-ef09-4be2-9cb7-bf12f4122092 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:05.497490 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2935ef71-ef09-4be2-9cb7-bf12f4122092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:05.506060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c24d1f-5b94-4566-a5ae-b36f92327722 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.518488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:05.546877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e0839-004f-4c3f-ac38-9ea1c79dd5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.547931 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e0839-004f-4c3f-ac38-9ea1c79dd5cc None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.548421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e0839-004f-4c3f-ac38-9ea1c79dd5cc None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.548877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e0839-004f-4c3f-ac38-9ea1c79dd5cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.591474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 330/667] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:36:05.591474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935ef71-ef09-4be2-9cb7-bf12f4122092 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.643384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e0839-004f-4c3f-ac38-9ea1c79dd5cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.645243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e0839-004f-4c3f-ac38-9ea1c79dd5cc None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.716053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935ef71-ef09-4be2-9cb7-bf12f4122092 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.754905 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:05.755225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 338/668] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:05.756341 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e0839-004f-4c3f-ac38-9ea1c79dd5cc None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.758487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d442f-7adf-4b11-8ef8-99cdf4155372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.759284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d442f-7adf-4b11-8ef8-99cdf4155372 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.759597 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d442f-7adf-4b11-8ef8-99cdf4155372 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.759872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d442f-7adf-4b11-8ef8-99cdf4155372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.774641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d442f-7adf-4b11-8ef8-99cdf4155372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.776456 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d442f-7adf-4b11-8ef8-99cdf4155372 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-7a2d442f-7adf-4b11-8ef8-99cdf4155372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:05.800666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:05.802042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:05.802930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:05.802930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:05.802930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:05.802930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:05.802930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 331/669] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:05.802930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d442f-7adf-4b11-8ef8-99cdf4155372 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.806879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:05.875060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e0839-004f-4c3f-ac38-9ea1c79dd5cc None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.899755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:05.910331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd05436-4e0d-4e89-9d71-bb7ef5aa7224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.911125 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd05436-4e0d-4e89-9d71-bb7ef5aa7224 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.911415 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd05436-4e0d-4e89-9d71-bb7ef5aa7224 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.911707 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd05436-4e0d-4e89-9d71-bb7ef5aa7224 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.916336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d442f-7adf-4b11-8ef8-99cdf4155372 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.922050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd05436-4e0d-4e89-9d71-bb7ef5aa7224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-bfd05436-4e0d-4e89-9d71-bb7ef5aa7224 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:05.931768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:05.932740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:05.933572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:05.933572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:05.933572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:05.933572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:05.933572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:05.933572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:05.933572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:05.933572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:05.933572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:05.933572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:05.933572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:05.933572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:05.939724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 339/670] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:05.940740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd05436-4e0d-4e89-9d71-bb7ef5aa7224 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.955533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553ae16-6f0a-4b94-b72c-fb2a6df0c83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.956331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553ae16-6f0a-4b94-b72c-fb2a6df0c83e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.956608 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553ae16-6f0a-4b94-b72c-fb2a6df0c83e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.956885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553ae16-6f0a-4b94-b72c-fb2a6df0c83e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.967636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553ae16-6f0a-4b94-b72c-fb2a6df0c83e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.969122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553ae16-6f0a-4b94-b72c-fb2a6df0c83e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-a553ae16-6f0a-4b94-b72c-fb2a6df0c83e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:05.988041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:05.988984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:05.989854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:05.989854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:05.989854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:05.989854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:05.989854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 332/671] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:05.990570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0897-cfdf-44c4-95e1-28d4fb091231 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.990740 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0897-cfdf-44c4-95e1-28d4fb091231 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.991048 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0897-cfdf-44c4-95e1-28d4fb091231 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.996800 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 333/672] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:05.997429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd0897-cfdf-44c4-95e1-28d4fb091231 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.049431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd05436-4e0d-4e89-9d71-bb7ef5aa7224 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.061912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.086240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886666ac-d962-4d12-94c3-239fcf5c66ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.086918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886666ac-d962-4d12-94c3-239fcf5c66ef None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.087188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886666ac-d962-4d12-94c3-239fcf5c66ef None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.087482 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886666ac-d962-4d12-94c3-239fcf5c66ef None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.088209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886666ac-d962-4d12-94c3-239fcf5c66ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:06.088535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886666ac-d962-4d12-94c3-239fcf5c66ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.089876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886666ac-d962-4d12-94c3-239fcf5c66ef None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.101775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 340/673] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:06.102601 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886666ac-d962-4d12-94c3-239fcf5c66ef None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.116058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd0897-cfdf-44c4-95e1-28d4fb091231 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.148746 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.159745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9d476-e94a-4128-8bbd-2f00c04055a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.160695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9d476-e94a-4128-8bbd-2f00c04055a1 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.160988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9d476-e94a-4128-8bbd-2f00c04055a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.161266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9d476-e94a-4128-8bbd-2f00c04055a1 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.162499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9d476-e94a-4128-8bbd-2f00c04055a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:06.162817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9d476-e94a-4128-8bbd-2f00c04055a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.164648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9d476-e94a-4128-8bbd-2f00c04055a1 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.180470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 334/674] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:06.180470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e768b-ba5c-41b7-b567-0bb5e39a0a29 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.180470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e768b-ba5c-41b7-b567-0bb5e39a0a29 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.180470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e768b-ba5c-41b7-b567-0bb5e39a0a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.196693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-943e768b-ba5c-41b7-b567-0bb5e39a0a29 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:06.197890 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-943e768b-ba5c-41b7-b567-0bb5e39a0a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:06.204084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886666ac-d962-4d12-94c3-239fcf5c66ef None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.247549 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72390b-0513-4d31-9092-9288fd360df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.249821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72390b-0513-4d31-9092-9288fd360df4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.249821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72390b-0513-4d31-9092-9288fd360df4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.249821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72390b-0513-4d31-9092-9288fd360df4 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.250466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72390b-0513-4d31-9092-9288fd360df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:06.251163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72390b-0513-4d31-9092-9288fd360df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.254689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72390b-0513-4d31-9092-9288fd360df4 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.275500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 335/675] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:36:06.275500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e768b-ba5c-41b7-b567-0bb5e39a0a29 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.275773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 341/676] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:06.275773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72390b-0513-4d31-9092-9288fd360df4 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.323560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.377458 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e768b-ba5c-41b7-b567-0bb5e39a0a29 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.397263 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72390b-0513-4d31-9092-9288fd360df4 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.399730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.416072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd7646-71e6-4e66-9428-6ef443eda219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.417158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd7646-71e6-4e66-9428-6ef443eda219 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.417158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd7646-71e6-4e66-9428-6ef443eda219 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.417471 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd7646-71e6-4e66-9428-6ef443eda219 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.427214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd7646-71e6-4e66-9428-6ef443eda219 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.428759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd7646-71e6-4e66-9428-6ef443eda219 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.442767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e96ce2-d3af-4843-836d-60ec9b7eeaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.443619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e96ce2-d3af-4843-836d-60ec9b7eeaaf None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.443908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e96ce2-d3af-4843-836d-60ec9b7eeaaf None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.444181 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e96ce2-d3af-4843-836d-60ec9b7eeaaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-4edd7646-71e6-4e66-9428-6ef443eda219 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:06.444470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:06.445314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:06.446185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:06.446185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:06.446185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:06.446185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:06.446185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:06.446185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:06.446185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:06.446185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:06.446185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 336/677] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:06.447211 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd7646-71e6-4e66-9428-6ef443eda219 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.462803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e96ce2-d3af-4843-836d-60ec9b7eeaaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.464314 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e96ce2-d3af-4843-836d-60ec9b7eeaaf None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-09e96ce2-d3af-4843-836d-60ec9b7eeaaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:06.486040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:06.487048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:06.488633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:06.488633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:06.488633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:06.488633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:06.491954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 342/678] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:06.492791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e96ce2-d3af-4843-836d-60ec9b7eeaaf None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.569161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd7646-71e6-4e66-9428-6ef443eda219 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.579943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.607538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c8a3-4b21-4f46-a6cb-80cb506dcf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.608843 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c8a3-4b21-4f46-a6cb-80cb506dcf6d None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.609124 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c8a3-4b21-4f46-a6cb-80cb506dcf6d None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.609397 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c8a3-4b21-4f46-a6cb-80cb506dcf6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.614528 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e96ce2-d3af-4843-836d-60ec9b7eeaaf None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.616633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0c8a3-4b21-4f46-a6cb-80cb506dcf6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.618190 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0c8a3-4b21-4f46-a6cb-80cb506dcf6d None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-91a0c8a3-4b21-4f46-a6cb-80cb506dcf6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:06.635307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:06.636413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:06.637684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:06.637684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:06.637684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:06.637684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:06.637684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:06.637684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:06.637684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:06.637684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:06.641269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 337/679] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:06.642186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c8a3-4b21-4f46-a6cb-80cb506dcf6d None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.657542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88136bb3-e788-4a95-b96c-86c766fe6e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.658575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88136bb3-e788-4a95-b96c-86c766fe6e23 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.659000 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88136bb3-e788-4a95-b96c-86c766fe6e23 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.659413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88136bb3-e788-4a95-b96c-86c766fe6e23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.672048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88136bb3-e788-4a95-b96c-86c766fe6e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-88136bb3-e788-4a95-b96c-86c766fe6e23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:06.680210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:06.681180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:06.682025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:06.682025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:06.682025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:06.682025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:06.682025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:06.682025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:06.682025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:06.682025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:06.682025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:06.682025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:06.682025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:06.682025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:06.684012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 343/680] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:06.684947 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88136bb3-e788-4a95-b96c-86c766fe6e23 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.707626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.759046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c8a3-4b21-4f46-a6cb-80cb506dcf6d None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.795972 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88136bb3-e788-4a95-b96c-86c766fe6e23 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.796309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13163588-3cbc-4d97-83bc-0f971c760fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.796873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13163588-3cbc-4d97-83bc-0f971c760fad None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.797152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13163588-3cbc-4d97-83bc-0f971c760fad None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.797427 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13163588-3cbc-4d97-83bc-0f971c760fad None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.798211 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13163588-3cbc-4d97-83bc-0f971c760fad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:06.798526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13163588-3cbc-4d97-83bc-0f971c760fad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.800014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13163588-3cbc-4d97-83bc-0f971c760fad None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.817746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 338/681] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:06.817746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13163588-3cbc-4d97-83bc-0f971c760fad None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.840021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c05a4-875f-481c-98fe-3d0f4dcb0600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.840635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c05a4-875f-481c-98fe-3d0f4dcb0600 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.841050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c05a4-875f-481c-98fe-3d0f4dcb0600 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.841178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c05a4-875f-481c-98fe-3d0f4dcb0600 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.842450 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c05a4-875f-481c-98fe-3d0f4dcb0600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:06.842764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c05a4-875f-481c-98fe-3d0f4dcb0600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.844207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c05a4-875f-481c-98fe-3d0f4dcb0600 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.844716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.856593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 344/682] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:06.862501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c05a4-875f-481c-98fe-3d0f4dcb0600 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.934065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13163588-3cbc-4d97-83bc-0f971c760fad None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.945612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.970849 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c05a4-875f-481c-98fe-3d0f4dcb0600 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.976890 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43272fd-ea72-4feb-af90-1fae3d964c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.977677 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43272fd-ea72-4feb-af90-1fae3d964c0d None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.978088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43272fd-ea72-4feb-af90-1fae3d964c0d None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.978088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43272fd-ea72-4feb-af90-1fae3d964c0d None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.978883 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43272fd-ea72-4feb-af90-1fae3d964c0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:06.979199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43272fd-ea72-4feb-af90-1fae3d964c0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.980747 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43272fd-ea72-4feb-af90-1fae3d964c0d None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.994595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 339/683] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:06.995813 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43272fd-ea72-4feb-af90-1fae3d964c0d None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.031860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee98a72-8a6d-40fa-bcd4-6fe5502d58f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.032499 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee98a72-8a6d-40fa-bcd4-6fe5502d58f1 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.032778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee98a72-8a6d-40fa-bcd4-6fe5502d58f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.033050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee98a72-8a6d-40fa-bcd4-6fe5502d58f1 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.033795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee98a72-8a6d-40fa-bcd4-6fe5502d58f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:07.034104 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee98a72-8a6d-40fa-bcd4-6fe5502d58f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.035554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee98a72-8a6d-40fa-bcd4-6fe5502d58f1 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.049018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 345/684] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:07.049018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee98a72-8a6d-40fa-bcd4-6fe5502d58f1 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.101687 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.114887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43272fd-ea72-4feb-af90-1fae3d964c0d None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.165791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e805-5ae8-4fac-82b0-5df0d9bfaefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.166451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e805-5ae8-4fac-82b0-5df0d9bfaefb None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.166730 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e805-5ae8-4fac-82b0-5df0d9bfaefb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.167004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e805-5ae8-4fac-82b0-5df0d9bfaefb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.167866 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e805-5ae8-4fac-82b0-5df0d9bfaefb None admin] RBAC: Adding query filter params (role.id=a9712a3506694519b4e4945b54539d79, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=d95c75980e114aa488424fb115add647) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:07.168175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e805-5ae8-4fac-82b0-5df0d9bfaefb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.169605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e805-5ae8-4fac-82b0-5df0d9bfaefb None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.173022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee98a72-8a6d-40fa-bcd4-6fe5502d58f1 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.183884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 340/685] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/role_assignments?user.id=d95c75980e114aa488424fb115add647&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=a9712a3506694519b4e4945b54539d79 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:07.185406 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e805-5ae8-4fac-82b0-5df0d9bfaefb None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.214160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce9c51-f443-4f21-9264-167f8e340b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.215433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce9c51-f443-4f21-9264-167f8e340b52 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.216007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce9c51-f443-4f21-9264-167f8e340b52 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.216513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce9c51-f443-4f21-9264-167f8e340b52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.226243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce9c51-f443-4f21-9264-167f8e340b52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.228103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce9c51-f443-4f21-9264-167f8e340b52 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.230542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-9bce9c51-f443-4f21-9264-167f8e340b52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:07.244961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:07.246266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:07.247233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:07.247233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:07.247233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:07.247233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:07.247233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:07.247233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:07.247233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:07.247233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:07.247233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:36:07.247233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:07.261811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 346/686] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:07.263041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce9c51-f443-4f21-9264-167f8e340b52 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.312194 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e805-5ae8-4fac-82b0-5df0d9bfaefb None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.353235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aebf5-c45c-4936-b484-3cd14950b533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.353833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aebf5-c45c-4936-b484-3cd14950b533 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.354114 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aebf5-c45c-4936-b484-3cd14950b533 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.354387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aebf5-c45c-4936-b484-3cd14950b533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.355385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aebf5-c45c-4936-b484-3cd14950b533 None admin] RBAC: Adding query filter params (role.id=a9712a3506694519b4e4945b54539d79, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=be4de0fa80784de1acfcd47a2b77d9ac) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:07.355752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aebf5-c45c-4936-b484-3cd14950b533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.358286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aebf5-c45c-4936-b484-3cd14950b533 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.371907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 341/687] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/role_assignments?user.id=be4de0fa80784de1acfcd47a2b77d9ac&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=a9712a3506694519b4e4945b54539d79 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:07.372902 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aebf5-c45c-4936-b484-3cd14950b533 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.388125 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce9c51-f443-4f21-9264-167f8e340b52 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.399794 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.436579 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476987aa-c6a5-4b25-9854-bc0578d41728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.438816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476987aa-c6a5-4b25-9854-bc0578d41728 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.439629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476987aa-c6a5-4b25-9854-bc0578d41728 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.440151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476987aa-c6a5-4b25-9854-bc0578d41728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.456824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476987aa-c6a5-4b25-9854-bc0578d41728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.459622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476987aa-c6a5-4b25-9854-bc0578d41728 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-476987aa-c6a5-4b25-9854-bc0578d41728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:07.485307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:07.486282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:07.487155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:07.487155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:07.487155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:07.487155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:07.489758 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 347/688] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:07.496832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476987aa-c6a5-4b25-9854-bc0578d41728 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.514612 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aebf5-c45c-4936-b484-3cd14950b533 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.554477 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91631b-f3bd-45f9-932d-44c69797aed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.555316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91631b-f3bd-45f9-932d-44c69797aed0 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.555728 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91631b-f3bd-45f9-932d-44c69797aed0 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.556129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91631b-f3bd-45f9-932d-44c69797aed0 None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.557104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91631b-f3bd-45f9-932d-44c69797aed0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:07.557525 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91631b-f3bd-45f9-932d-44c69797aed0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.558679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.559343 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91631b-f3bd-45f9-932d-44c69797aed0 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.581748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 342/689] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:07.587296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91631b-f3bd-45f9-932d-44c69797aed0 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.617712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476987aa-c6a5-4b25-9854-bc0578d41728 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.666356 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040cd89-d5ed-4ffd-831e-44bfe4b9b75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.667057 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040cd89-d5ed-4ffd-831e-44bfe4b9b75e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.667344 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040cd89-d5ed-4ffd-831e-44bfe4b9b75e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.667708 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040cd89-d5ed-4ffd-831e-44bfe4b9b75e None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.668424 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040cd89-d5ed-4ffd-831e-44bfe4b9b75e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:07.668734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040cd89-d5ed-4ffd-831e-44bfe4b9b75e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.670152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040cd89-d5ed-4ffd-831e-44bfe4b9b75e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.684731 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 348/690] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:07.686220 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4df86-6689-40d4-89a4-c78f13380d9b None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.687873 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4df86-6689-40d4-89a4-c78f13380d9b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.687873 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4df86-6689-40d4-89a4-c78f13380d9b None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.689070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.695096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 349/691] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:07.695268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4df86-6689-40d4-89a4-c78f13380d9b None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.725319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91631b-f3bd-45f9-932d-44c69797aed0 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.774260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee926b7f-595a-4e99-ae1f-532ceaf7563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.775073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee926b7f-595a-4e99-ae1f-532ceaf7563e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.775369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee926b7f-595a-4e99-ae1f-532ceaf7563e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.775976 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee926b7f-595a-4e99-ae1f-532ceaf7563e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.828227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4df86-6689-40d4-89a4-c78f13380d9b None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.844198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.863826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee926b7f-595a-4e99-ae1f-532ceaf7563e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.865287 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee926b7f-595a-4e99-ae1f-532ceaf7563e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.877873 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca1f4e-e94b-4a1c-af0b-9c9482adbc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.879654 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca1f4e-e94b-4a1c-af0b-9c9482adbc4d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.880152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca1f4e-e94b-4a1c-af0b-9c9482adbc4d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.880737 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca1f4e-e94b-4a1c-af0b-9c9482adbc4d None admin] PATH_INFO: `/v3/users/swift` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.892061 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca1f4e-e94b-4a1c-af0b-9c9482adbc4d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.894544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca1f4e-e94b-4a1c-af0b-9c9482adbc4d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-daca1f4e-e94b-4a1c-af0b-9c9482adbc4d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:07.917295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:07.918298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:07.919228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:07.919228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:07.919228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:07.919228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:07.919228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:07.919228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:07.919228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:07.919228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:07.919228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:36:07.919228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:07.925538 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 350/692] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:07.926979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0370-601b-4707-a4b5-39bce3d7a7d7 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.927271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0370-601b-4707-a4b5-39bce3d7a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.927588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0370-601b-4707-a4b5-39bce3d7a7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.949066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-8efd0370-601b-4707-a4b5-39bce3d7a7d7 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:07.950245 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8efd0370-601b-4707-a4b5-39bce3d7a7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:07.953827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.991311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 343/693] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:07.992643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee926b7f-595a-4e99-ae1f-532ceaf7563e None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:08.043474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 351/694] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:36:08.043474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd0370-601b-4707-a4b5-39bce3d7a7d7 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:08.128566 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee926b7f-595a-4e99-ae1f-532ceaf7563e None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:08.164102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:08.164513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff7b35-88e8-424d-8571-3e70ef08de86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:08.165269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff7b35-88e8-424d-8571-3e70ef08de86 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.165474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff7b35-88e8-424d-8571-3e70ef08de86 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.166050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff7b35-88e8-424d-8571-3e70ef08de86 None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.166591 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff7b35-88e8-424d-8571-3e70ef08de86 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:08.166895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff7b35-88e8-424d-8571-3e70ef08de86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:08.168643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff7b35-88e8-424d-8571-3e70ef08de86 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:08.169802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd0370-601b-4707-a4b5-39bce3d7a7d7 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:08.189101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 344/695] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:08.190332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff7b35-88e8-424d-8571-3e70ef08de86 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:08.211168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2899b-de88-4e58-93e5-be1cdb590a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:08.212363 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2899b-de88-4e58-93e5-be1cdb590a8b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.212854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2899b-de88-4e58-93e5-be1cdb590a8b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.213428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2899b-de88-4e58-93e5-be1cdb590a8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.223289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:08.227108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2899b-de88-4e58-93e5-be1cdb590a8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:08.228881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2899b-de88-4e58-93e5-be1cdb590a8b None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-36c2899b-de88-4e58-93e5-be1cdb590a8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:08.250937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:08.252222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:08.253103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:08.253103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:08.253103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:08.253103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:08.266035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 352/696] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:08.267325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2899b-de88-4e58-93e5-be1cdb590a8b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:08.308069 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff7b35-88e8-424d-8571-3e70ef08de86 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:08.347503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5d27b-a4ea-44c3-8935-e3a7d6a75371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:08.348328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5d27b-a4ea-44c3-8935-e3a7d6a75371 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.348603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5d27b-a4ea-44c3-8935-e3a7d6a75371 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.348875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5d27b-a4ea-44c3-8935-e3a7d6a75371 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.349683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5d27b-a4ea-44c3-8935-e3a7d6a75371 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:08.351596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5d27b-a4ea-44c3-8935-e3a7d6a75371 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-9fc5d27b-a4ea-44c3-8935-e3a7d6a75371 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:08.369944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:08.371237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:36:08.372142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:08.376946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 345/697] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jun 2 13:36:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:08.377928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5d27b-a4ea-44c3-8935-e3a7d6a75371 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:08.390544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2899b-de88-4e58-93e5-be1cdb590a8b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:08.439679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574f6df-4381-4e97-9aa5-f0e96593419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:08.440343 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574f6df-4381-4e97-9aa5-f0e96593419f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.440603 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574f6df-4381-4e97-9aa5-f0e96593419f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.440878 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574f6df-4381-4e97-9aa5-f0e96593419f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.477971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:08.510700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:08.519246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5d27b-a4ea-44c3-8935-e3a7d6a75371 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:08.532273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574f6df-4381-4e97-9aa5-f0e96593419f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:08.534094 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574f6df-4381-4e97-9aa5-f0e96593419f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:08.568993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03edcf6-bbfe-4c3c-8ad5-c7d2b7693da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:08.569782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03edcf6-bbfe-4c3c-8ad5-c7d2b7693da7 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.570068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03edcf6-bbfe-4c3c-8ad5-c7d2b7693da7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.570345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03edcf6-bbfe-4c3c-8ad5-c7d2b7693da7 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.571357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03edcf6-bbfe-4c3c-8ad5-c7d2b7693da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:08.571646 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03edcf6-bbfe-4c3c-8ad5-c7d2b7693da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:08.573205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03edcf6-bbfe-4c3c-8ad5-c7d2b7693da7 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:08.592507 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 346/698] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:08.592507 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03edcf6-bbfe-4c3c-8ad5-c7d2b7693da7 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:08.655772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 353/699] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:08.657034 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574f6df-4381-4e97-9aa5-f0e96593419f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:08.705433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03edcf6-bbfe-4c3c-8ad5-c7d2b7693da7 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:08.715756 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:08.747182 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48c104-3299-4a80-8c60-9e5ab9e87d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:08.748702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48c104-3299-4a80-8c60-9e5ab9e87d75 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.749132 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48c104-3299-4a80-8c60-9e5ab9e87d75 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.749553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48c104-3299-4a80-8c60-9e5ab9e87d75 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.750444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48c104-3299-4a80-8c60-9e5ab9e87d75 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:08.750887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48c104-3299-4a80-8c60-9e5ab9e87d75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:08.752560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48c104-3299-4a80-8c60-9e5ab9e87d75 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:08.764440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 347/700] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 2 13:36:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:08.765718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48c104-3299-4a80-8c60-9e5ab9e87d75 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:08.771610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574f6df-4381-4e97-9aa5-f0e96593419f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:08.790358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:08.808489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5e338-53f1-462c-8d38-a5d8d682b9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:08.809471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5e338-53f1-462c-8d38-a5d8d682b9f3 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.809858 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5e338-53f1-462c-8d38-a5d8d682b9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.810235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5e338-53f1-462c-8d38-a5d8d682b9f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.818772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5e338-53f1-462c-8d38-a5d8d682b9f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:08.820475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5e338-53f1-462c-8d38-a5d8d682b9f3 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-5ce5e338-53f1-462c-8d38-a5d8d682b9f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:08.836639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:08.837709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:08.838681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:08.838681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:08.838681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:08.838681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:08.838681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:08.838681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:08.838681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:08.838681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:08.838681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 354/701] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:08.844280 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5e338-53f1-462c-8d38-a5d8d682b9f3 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:08.886137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48c104-3299-4a80-8c60-9e5ab9e87d75 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:08.924918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f13bd-9b18-4c40-8889-5b7be5488017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:08.926021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f13bd-9b18-4c40-8889-5b7be5488017 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.926485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f13bd-9b18-4c40-8889-5b7be5488017 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.926939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f13bd-9b18-4c40-8889-5b7be5488017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.941465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f13bd-9b18-4c40-8889-5b7be5488017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:08.943304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f13bd-9b18-4c40-8889-5b7be5488017 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:08.955690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5e338-53f1-462c-8d38-a5d8d682b9f3 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-0e2f13bd-9b18-4c40-8889-5b7be5488017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:08.963918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:08.964858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:08.965788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:08.965788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:08.965788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:08.965788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:08.968244 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 348/702] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:08.969284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f13bd-9b18-4c40-8889-5b7be5488017 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:08.970264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:08.993597 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f80d1-bfa1-47e5-8a31-9df01c81a5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:08.994430 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f80d1-bfa1-47e5-8a31-9df01c81a5e0 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.994811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f80d1-bfa1-47e5-8a31-9df01c81a5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.995144 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f80d1-bfa1-47e5-8a31-9df01c81a5e0 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.996172 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f80d1-bfa1-47e5-8a31-9df01c81a5e0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:08.996482 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f80d1-bfa1-47e5-8a31-9df01c81a5e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:08.997870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f80d1-bfa1-47e5-8a31-9df01c81a5e0 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:09.011817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 355/703] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 2 13:36:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:09.012904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f80d1-bfa1-47e5-8a31-9df01c81a5e0 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:09.056191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:09.092313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f13bd-9b18-4c40-8889-5b7be5488017 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:09.139264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc7103-295c-447b-a5f0-382a1ee092a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:09.140377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc7103-295c-447b-a5f0-382a1ee092a9 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.140972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc7103-295c-447b-a5f0-382a1ee092a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.142230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc7103-295c-447b-a5f0-382a1ee092a9 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.143311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc7103-295c-447b-a5f0-382a1ee092a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:09.144144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc7103-295c-447b-a5f0-382a1ee092a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:09.151861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc7103-295c-447b-a5f0-382a1ee092a9 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:09.175063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 349/704] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:09.180599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc7103-295c-447b-a5f0-382a1ee092a9 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:09.218546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f80d1-bfa1-47e5-8a31-9df01c81a5e0 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:09.323848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc7103-295c-447b-a5f0-382a1ee092a9 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:09.324183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d61966-0e7b-4f80-8398-2cf5b7ecfc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:09.325235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d61966-0e7b-4f80-8398-2cf5b7ecfc5e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.325665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d61966-0e7b-4f80-8398-2cf5b7ecfc5e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.326087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d61966-0e7b-4f80-8398-2cf5b7ecfc5e None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.327623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d61966-0e7b-4f80-8398-2cf5b7ecfc5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:09.328161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d61966-0e7b-4f80-8398-2cf5b7ecfc5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:09.329863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d61966-0e7b-4f80-8398-2cf5b7ecfc5e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:09.345153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 356/705] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:09.356269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d61966-0e7b-4f80-8398-2cf5b7ecfc5e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:09.359728 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:09.366349 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33d26b-448f-4ff7-ab0c-062b1aa56bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:09.367316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33d26b-448f-4ff7-ab0c-062b1aa56bfe None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.367780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33d26b-448f-4ff7-ab0c-062b1aa56bfe None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.368201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33d26b-448f-4ff7-ab0c-062b1aa56bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.369392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33d26b-448f-4ff7-ab0c-062b1aa56bfe None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=b9971f2bf0f2400b90168f6032a0e226) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:09.369948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33d26b-448f-4ff7-ab0c-062b1aa56bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:09.371892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33d26b-448f-4ff7-ab0c-062b1aa56bfe None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:09.379107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 350/706] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:09 2022] GET /identity/v3/role_assignments?user.id=b9971f2bf0f2400b90168f6032a0e226&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=c5632345c9274d348669482f1f7414c8 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:09.414890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:09.509679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d61966-0e7b-4f80-8398-2cf5b7ecfc5e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:09.565448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22def52-4f6b-44b9-890e-e5561c1f8392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:09.566273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22def52-4f6b-44b9-890e-e5561c1f8392 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.566556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22def52-4f6b-44b9-890e-e5561c1f8392 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.566831 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22def52-4f6b-44b9-890e-e5561c1f8392 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.577848 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22def52-4f6b-44b9-890e-e5561c1f8392 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:09.579685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22def52-4f6b-44b9-890e-e5561c1f8392 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-c22def52-4f6b-44b9-890e-e5561c1f8392 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:09.607188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:09.608259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:09.609188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:09.609188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:09.609188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:09.609188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:09.609188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:09.609188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:09.609188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:09.609188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:09.612395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 357/707] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:09.619553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33d26b-448f-4ff7-ab0c-062b1aa56bfe None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:09.773796 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33d26b-448f-4ff7-ab0c-062b1aa56bfe None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:09.812752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d9c5b-05ac-45c6-80a0-a99880f58fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:09.813437 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d9c5b-05ac-45c6-80a0-a99880f58fe8 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.813724 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d9c5b-05ac-45c6-80a0-a99880f58fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.813998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d9c5b-05ac-45c6-80a0-a99880f58fe8 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.814802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d9c5b-05ac-45c6-80a0-a99880f58fe8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:09.815112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d9c5b-05ac-45c6-80a0-a99880f58fe8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:09.816636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d9c5b-05ac-45c6-80a0-a99880f58fe8 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:09.831038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 351/708] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:09.837087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22def52-4f6b-44b9-890e-e5561c1f8392 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:09.848563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27d3ef-178a-4a42-94a5-e4dc182ee964 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.848880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27d3ef-178a-4a42-94a5-e4dc182ee964 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.849128 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27d3ef-178a-4a42-94a5-e4dc182ee964 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.853053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 352/709] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:09 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:09.857237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e657385-396c-4377-915b-41bb6b034046 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.857556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e657385-396c-4377-915b-41bb6b034046 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.857837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e657385-396c-4377-915b-41bb6b034046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.890404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-1e657385-396c-4377-915b-41bb6b034046 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:09.891649 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1e657385-396c-4377-915b-41bb6b034046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:09.984630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:09.992766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22def52-4f6b-44b9-890e-e5561c1f8392 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:10.025067 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:10.037015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd013e9b-6d2a-440b-87a7-6af52dcecec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:10.038297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd013e9b-6d2a-440b-87a7-6af52dcecec6 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.038297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd013e9b-6d2a-440b-87a7-6af52dcecec6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.038471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd013e9b-6d2a-440b-87a7-6af52dcecec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.039386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd013e9b-6d2a-440b-87a7-6af52dcecec6 None admin] RBAC: Adding query filter params (role.id=a9712a3506694519b4e4945b54539d79, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=00f3424dc2ee4f828638b3a8f5c9fc5d) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:10.039889 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd013e9b-6d2a-440b-87a7-6af52dcecec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:10.041554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd013e9b-6d2a-440b-87a7-6af52dcecec6 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:10.049200 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 358/710] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:09 2022] GET /identity/v3/role_assignments?user.id=00f3424dc2ee4f828638b3a8f5c9fc5d&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=a9712a3506694519b4e4945b54539d79 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:10.062331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 353/711] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:36:10.088205 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013308a5-c912-4296-ab2b-aa503cae22f3 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.088537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013308a5-c912-4296-ab2b-aa503cae22f3 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.088791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013308a5-c912-4296-ab2b-aa503cae22f3 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.090459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 359/712] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:10.096997 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de79d4-a7bc-46ad-be91-1838946b0b34 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.097489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de79d4-a7bc-46ad-be91-1838946b0b34 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.097667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de79d4-a7bc-46ad-be91-1838946b0b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.098055 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e657385-396c-4377-915b-41bb6b034046 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:10.125665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-a8de79d4-a7bc-46ad-be91-1838946b0b34 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:10.127366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a8de79d4-a7bc-46ad-be91-1838946b0b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:10.281594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 360/713] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:36:10.301983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e657385-396c-4377-915b-41bb6b034046 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:10.307490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de79d4-a7bc-46ad-be91-1838946b0b34 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:10.348622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903046d0-b848-4214-9f5a-1c92480778db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:10.349435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903046d0-b848-4214-9f5a-1c92480778db None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.349727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903046d0-b848-4214-9f5a-1c92480778db None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.350087 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903046d0-b848-4214-9f5a-1c92480778db None admin] PATH_INFO: `/v3/services/network` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.350662 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903046d0-b848-4214-9f5a-1c92480778db None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:10.352149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903046d0-b848-4214-9f5a-1c92480778db None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-903046d0-b848-4214-9f5a-1c92480778db None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:10.366998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:10.371332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:10.372487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 354/714] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:10 2022] GET /identity/v3/services/network => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:10.376453 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903046d0-b848-4214-9f5a-1c92480778db None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:10.420764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:10.431738 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de79d4-a7bc-46ad-be91-1838946b0b34 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:10.444147 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:10.473778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958167b-af93-454b-afcc-77faaeec86b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:10.474597 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958167b-af93-454b-afcc-77faaeec86b4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.474876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958167b-af93-454b-afcc-77faaeec86b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.475147 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958167b-af93-454b-afcc-77faaeec86b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.487868 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958167b-af93-454b-afcc-77faaeec86b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:10.489356 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958167b-af93-454b-afcc-77faaeec86b4 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:10.499530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903046d0-b848-4214-9f5a-1c92480778db None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-2958167b-af93-454b-afcc-77faaeec86b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:10.509714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:10.511012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:10.511949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:10.511949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:10.511949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:10.511949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:10.511949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 361/715] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:10.517196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958167b-af93-454b-afcc-77faaeec86b4 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:10.537416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4bb96-06ec-4774-817b-a16e06a3870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:10.538012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4bb96-06ec-4774-817b-a16e06a3870f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.538300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4bb96-06ec-4774-817b-a16e06a3870f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.538579 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4bb96-06ec-4774-817b-a16e06a3870f None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.539308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4bb96-06ec-4774-817b-a16e06a3870f None admin] RBAC: Adding query filter params (name=network) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:10.539650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4bb96-06ec-4774-817b-a16e06a3870f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:10.541063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4bb96-06ec-4774-817b-a16e06a3870f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:10.547761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 355/716] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 2 13:36:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:10.554139 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4bb96-06ec-4774-817b-a16e06a3870f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:10.691192 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958167b-af93-454b-afcc-77faaeec86b4 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:10.723413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4bb96-06ec-4774-817b-a16e06a3870f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:10.740608 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:10.763086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915e507-c1cd-42f3-8a29-d3c54febeac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:10.764602 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915e507-c1cd-42f3-8a29-d3c54febeac4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.765118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915e507-c1cd-42f3-8a29-d3c54febeac4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.765738 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a536-6da1-4381-97bb-2bcd7ebb0207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:10.765903 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915e507-c1cd-42f3-8a29-d3c54febeac4 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.766674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a536-6da1-4381-97bb-2bcd7ebb0207 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.767057 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a536-6da1-4381-97bb-2bcd7ebb0207 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.767333 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915e507-c1cd-42f3-8a29-d3c54febeac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:10.767533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a536-6da1-4381-97bb-2bcd7ebb0207 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.767908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915e507-c1cd-42f3-8a29-d3c54febeac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:10.768448 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320a536-6da1-4381-97bb-2bcd7ebb0207 None admin] RBAC: Adding query filter params (type=network) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:10.768857 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320a536-6da1-4381-97bb-2bcd7ebb0207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:10.770341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320a536-6da1-4381-97bb-2bcd7ebb0207 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:10.770467 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915e507-c1cd-42f3-8a29-d3c54febeac4 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:10.780109 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 356/717] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 2 13:36:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:10.793258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 362/718] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:10.798586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a536-6da1-4381-97bb-2bcd7ebb0207 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:10.983315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a536-6da1-4381-97bb-2bcd7ebb0207 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:11.028703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6c27b-0998-4cf0-adfc-0dc70a2c5cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:11.029799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6c27b-0998-4cf0-adfc-0dc70a2c5cdf None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:11.030290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6c27b-0998-4cf0-adfc-0dc70a2c5cdf None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:11.030769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6c27b-0998-4cf0-adfc-0dc70a2c5cdf None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:11.031749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6c27b-0998-4cf0-adfc-0dc70a2c5cdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:11.033440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6c27b-0998-4cf0-adfc-0dc70a2c5cdf None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:11.140482 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 357/719] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:36:10 2022] POST /identity/v3/users => generated 254 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:12.028438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0abd0-118b-4151-bfb3-afff44322887 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:12.030128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0abd0-118b-4151-bfb3-afff44322887 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:12.030626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0abd0-118b-4151-bfb3-afff44322887 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:12.032492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 363/720] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:12.038269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4ff6b-7f8a-4ff3-84a6-06821933af3b None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:12.039144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4ff6b-7f8a-4ff3-84a6-06821933af3b None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:12.039686 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4ff6b-7f8a-4ff3-84a6-06821933af3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:12.058446 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-e9e4ff6b-7f8a-4ff3-84a6-06821933af3b None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:12.060067 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e9e4ff6b-7f8a-4ff3-84a6-06821933af3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:12.094176 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:12.166193 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 358/721] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:36:12.212958 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0abd0-118b-4151-bfb3-afff44322887 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:12.215885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:12.274373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d251be-7f63-443e-94c1-8985598f8004 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:12.274706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d251be-7f63-443e-94c1-8985598f8004 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:12.274937 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d251be-7f63-443e-94c1-8985598f8004 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:12.276733 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 359/722] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:12.283298 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f609ea1-7dca-4b05-81bf-771dee2b0379 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:12.283920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f609ea1-7dca-4b05-81bf-771dee2b0379 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:12.284355 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f609ea1-7dca-4b05-81bf-771dee2b0379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:12.311591 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-9f609ea1-7dca-4b05-81bf-771dee2b0379 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:12.314602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9f609ea1-7dca-4b05-81bf-771dee2b0379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:12.408604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0abd0-118b-4151-bfb3-afff44322887 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:12.456729 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 360/723] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:36:12.480265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d0e0-dec5-4cb5-bcfa-c1ede54223dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:12.481073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d0e0-dec5-4cb5-bcfa-c1ede54223dd None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:12.481369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d0e0-dec5-4cb5-bcfa-c1ede54223dd None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:12.481650 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d0e0-dec5-4cb5-bcfa-c1ede54223dd None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:12.482400 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53d0e0-dec5-4cb5-bcfa-c1ede54223dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:12.483540 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f609ea1-7dca-4b05-81bf-771dee2b0379 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:12.484419 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53d0e0-dec5-4cb5-bcfa-c1ede54223dd None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:12.586324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:12.594125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f609ea1-7dca-4b05-81bf-771dee2b0379 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:12.627865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 364/724] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 2 13:36:12 2022] POST /identity/v3/services => generated 251 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:12.668987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba26a9-e698-4020-bd03-cf44b3555c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:12.669819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba26a9-e698-4020-bd03-cf44b3555c47 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:12.670684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba26a9-e698-4020-bd03-cf44b3555c47 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:12.670977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba26a9-e698-4020-bd03-cf44b3555c47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:12.685737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba26a9-e698-4020-bd03-cf44b3555c47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-bbba26a9-e698-4020-bd03-cf44b3555c47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:12.705846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:12.706862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:12.707748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:12.707748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:12.707748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:12.707748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:12.707748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:12.707748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:12.707748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:12.707748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:12.707748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:12.707748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:12.707748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:12.707748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:12.707748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 361/725] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:12.715155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d0e0-dec5-4cb5-bcfa-c1ede54223dd None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:12.797503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:12.852786 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d0e0-dec5-4cb5-bcfa-c1ede54223dd None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:12.909296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18351cdd-14d7-4059-aa76-928cdf0391f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:12.909995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18351cdd-14d7-4059-aa76-928cdf0391f4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:12.910275 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18351cdd-14d7-4059-aa76-928cdf0391f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:12.910550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18351cdd-14d7-4059-aa76-928cdf0391f4 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:12.911330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18351cdd-14d7-4059-aa76-928cdf0391f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:12.911664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18351cdd-14d7-4059-aa76-928cdf0391f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:12.913092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18351cdd-14d7-4059-aa76-928cdf0391f4 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:12.926109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 365/726] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:36:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:12.932289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba26a9-e698-4020-bd03-cf44b3555c47 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:13.053340 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba26a9-e698-4020-bd03-cf44b3555c47 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:13.088850 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69536e23-689a-4914-b451-20b5ee4de069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:13.089651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69536e23-689a-4914-b451-20b5ee4de069 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.089933 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69536e23-689a-4914-b451-20b5ee4de069 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.090206 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69536e23-689a-4914-b451-20b5ee4de069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.102075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69536e23-689a-4914-b451-20b5ee4de069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:13.103646 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69536e23-689a-4914-b451-20b5ee4de069 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-69536e23-689a-4914-b451-20b5ee4de069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:13.121821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:13.122764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:13.124319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:13.124319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:13.124319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:13.124319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:13.124319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 362/727] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:13.130628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18351cdd-14d7-4059-aa76-928cdf0391f4 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:13.259251 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18351cdd-14d7-4059-aa76-928cdf0391f4 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:13.300877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:13.312203 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7fa60-88bc-44dc-8421-c39b8c5db8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:13.312871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7fa60-88bc-44dc-8421-c39b8c5db8c4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.313153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7fa60-88bc-44dc-8421-c39b8c5db8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.313426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7fa60-88bc-44dc-8421-c39b8c5db8c4 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.314146 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7fa60-88bc-44dc-8421-c39b8c5db8c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:13.314518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7fa60-88bc-44dc-8421-c39b8c5db8c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:13.315966 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7fa60-88bc-44dc-8421-c39b8c5db8c4 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:13.332827 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 366/728] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:13.338237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69536e23-689a-4914-b451-20b5ee4de069 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:13.341323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:13.374593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01d8ee-adf4-4af6-baea-0957ba3fb18d None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.374892 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01d8ee-adf4-4af6-baea-0957ba3fb18d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.375127 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01d8ee-adf4-4af6-baea-0957ba3fb18d None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.376667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 367/729] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:36:13.397227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43dfb5-ca34-437f-b0a6-f115d92ebb91 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.397532 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43dfb5-ca34-437f-b0a6-f115d92ebb91 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.397770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43dfb5-ca34-437f-b0a6-f115d92ebb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.427184 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-9a43dfb5-ca34-437f-b0a6-f115d92ebb91 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:13.430734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9a43dfb5-ca34-437f-b0a6-f115d92ebb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:13.517339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69536e23-689a-4914-b451-20b5ee4de069 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:13.566450 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75001cc2-0131-4abc-927a-d1b159e43388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:13.567258 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75001cc2-0131-4abc-927a-d1b159e43388 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.567582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75001cc2-0131-4abc-927a-d1b159e43388 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.567857 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75001cc2-0131-4abc-927a-d1b159e43388 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.576743 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75001cc2-0131-4abc-927a-d1b159e43388 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:13.578402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75001cc2-0131-4abc-927a-d1b159e43388 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:13.589782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 368/730] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-75001cc2-0131-4abc-927a-d1b159e43388 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:13.594022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:13.594951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:13.595941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:13.595941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:13.595941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:13.595941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:13.595941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:13.595941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:13.595941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:13.595941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:13.595941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:36:13.595941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:13.595941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 363/731] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 2 13:36:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:13.601207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43dfb5-ca34-437f-b0a6-f115d92ebb91 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:13.602943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ada469-56d2-4089-ad00-b2f85501d07b None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.603438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ada469-56d2-4089-ad00-b2f85501d07b None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.603969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ada469-56d2-4089-ad00-b2f85501d07b None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.609493 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 364/732] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:13.611364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d8240-e5e1-4da8-a51b-eaf8925d1c6d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.611693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d8240-e5e1-4da8-a51b-eaf8925d1c6d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.611972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d8240-e5e1-4da8-a51b-eaf8925d1c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.635708 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-1f1d8240-e5e1-4da8-a51b-eaf8925d1c6d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:13.636811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1f1d8240-e5e1-4da8-a51b-eaf8925d1c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:13.702638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:13.719474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 365/733] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:36:13.719474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d8240-e5e1-4da8-a51b-eaf8925d1c6d None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:13.740532 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43dfb5-ca34-437f-b0a6-f115d92ebb91 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:13.758024 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:13.779927 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159dd0fd-2c83-4b9f-ae99-7dfdd13fe220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:13.780659 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dd0fd-2c83-4b9f-ae99-7dfdd13fe220 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.780960 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dd0fd-2c83-4b9f-ae99-7dfdd13fe220 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.781267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dd0fd-2c83-4b9f-ae99-7dfdd13fe220 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.782147 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159dd0fd-2c83-4b9f-ae99-7dfdd13fe220 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:13.782513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159dd0fd-2c83-4b9f-ae99-7dfdd13fe220 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:13.784581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159dd0fd-2c83-4b9f-ae99-7dfdd13fe220 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:13.804331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 369/734] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 2 13:36:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:13.809681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159dd0fd-2c83-4b9f-ae99-7dfdd13fe220 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:13.840784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d8240-e5e1-4da8-a51b-eaf8925d1c6d None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:13.877873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c9ec7-bf31-4321-a2f9-e9dc42cba05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:13.879048 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c9ec7-bf31-4321-a2f9-e9dc42cba05b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.879581 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c9ec7-bf31-4321-a2f9-e9dc42cba05b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.880052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c9ec7-bf31-4321-a2f9-e9dc42cba05b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.893235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c9ec7-bf31-4321-a2f9-e9dc42cba05b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-556c9ec7-bf31-4321-a2f9-e9dc42cba05b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:13.902072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:13.903336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:13.904545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:13.904545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:13.904545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:13.904545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:13.904545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:13.904545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:13.904545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:13.904545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:13.904545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:13.904545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:13.904545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:13.904545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:13.912411 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 366/735] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:13.913771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c9ec7-bf31-4321-a2f9-e9dc42cba05b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:13.919217 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159dd0fd-2c83-4b9f-ae99-7dfdd13fe220 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:13.956979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280902a1-74a6-401c-ad66-d7fd6ed35322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:13.957646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280902a1-74a6-401c-ad66-d7fd6ed35322 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.957990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280902a1-74a6-401c-ad66-d7fd6ed35322 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.958282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280902a1-74a6-401c-ad66-d7fd6ed35322 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.959041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280902a1-74a6-401c-ad66-d7fd6ed35322 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:13.960438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280902a1-74a6-401c-ad66-d7fd6ed35322 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:13.975169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:14.028388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c9ec7-bf31-4321-a2f9-e9dc42cba05b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:14.033948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 370/736] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 2 13:36:13 2022] POST /identity/v3/services => generated 240 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:14.034895 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280902a1-74a6-401c-ad66-d7fd6ed35322 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:14.079569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:14.116851 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfd55f-f2f9-464d-91e4-dd86b7281922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:14.117687 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfd55f-f2f9-464d-91e4-dd86b7281922 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.117968 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfd55f-f2f9-464d-91e4-dd86b7281922 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.118242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfd55f-f2f9-464d-91e4-dd86b7281922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.145021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfd55f-f2f9-464d-91e4-dd86b7281922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:14.146642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfd55f-f2f9-464d-91e4-dd86b7281922 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-eabfd55f-f2f9-464d-91e4-dd86b7281922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:14.179488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:14.180553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:14.181678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:14.181678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:14.181678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:14.181678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:14.181678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 367/737] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:14.181678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfd55f-f2f9-464d-91e4-dd86b7281922 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:14.184277 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280902a1-74a6-401c-ad66-d7fd6ed35322 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:14.236551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186d7f6-360d-47d2-80ae-de3f66c1b303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:14.237654 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186d7f6-360d-47d2-80ae-de3f66c1b303 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.238942 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186d7f6-360d-47d2-80ae-de3f66c1b303 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.239600 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186d7f6-360d-47d2-80ae-de3f66c1b303 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.242161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186d7f6-360d-47d2-80ae-de3f66c1b303 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:14.242704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186d7f6-360d-47d2-80ae-de3f66c1b303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:14.247098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186d7f6-360d-47d2-80ae-de3f66c1b303 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:14.264016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 371/738] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:14.265814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce7854-45f9-4ab0-a479-e548e35e815d None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.266276 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce7854-45f9-4ab0-a479-e548e35e815d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.266720 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce7854-45f9-4ab0-a479-e548e35e815d None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.274594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 372/739] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:14.275794 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce7854-45f9-4ab0-a479-e548e35e815d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:14.362345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:14.365994 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfd55f-f2f9-464d-91e4-dd86b7281922 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:14.416412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71d9f0-efd6-4836-8ec4-e69c7fc60661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:14.417254 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71d9f0-efd6-4836-8ec4-e69c7fc60661 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.417750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:14.418756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71d9f0-efd6-4836-8ec4-e69c7fc60661 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.419653 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71d9f0-efd6-4836-8ec4-e69c7fc60661 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.421263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71d9f0-efd6-4836-8ec4-e69c7fc60661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:14.421647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71d9f0-efd6-4836-8ec4-e69c7fc60661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:14.423569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71d9f0-efd6-4836-8ec4-e69c7fc60661 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:14.430554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce7854-45f9-4ab0-a479-e548e35e815d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:14.443927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 368/740] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:14.443927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184895-f6bd-4fd9-83f4-70153c372d0e None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.443927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184895-f6bd-4fd9-83f4-70153c372d0e None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.443927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184895-f6bd-4fd9-83f4-70153c372d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.460236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-fa184895-f6bd-4fd9-83f4-70153c372d0e None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:14.461434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-fa184895-f6bd-4fd9-83f4-70153c372d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:14.478224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a97345-78c9-431d-9402-8d87caa0cc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:14.479414 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a97345-78c9-431d-9402-8d87caa0cc13 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.479953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a97345-78c9-431d-9402-8d87caa0cc13 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.480431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a97345-78c9-431d-9402-8d87caa0cc13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.492628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a97345-78c9-431d-9402-8d87caa0cc13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:14.494444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a97345-78c9-431d-9402-8d87caa0cc13 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-55a97345-78c9-431d-9402-8d87caa0cc13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:14.514755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:14.515749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:14.516636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:14.516636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:14.516636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:14.516636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:14.519016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 373/741] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:14.520257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a97345-78c9-431d-9402-8d87caa0cc13 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:14.551633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 369/742] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:14.552543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa184895-f6bd-4fd9-83f4-70153c372d0e None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:14.649354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a97345-78c9-431d-9402-8d87caa0cc13 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:14.671906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:14.682439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa184895-f6bd-4fd9-83f4-70153c372d0e None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:14.696408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdede489-521d-44de-8fa6-0f67375143a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:14.697247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede489-521d-44de-8fa6-0f67375143a3 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.697531 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede489-521d-44de-8fa6-0f67375143a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.697805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede489-521d-44de-8fa6-0f67375143a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.705459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdede489-521d-44de-8fa6-0f67375143a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:14.706940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdede489-521d-44de-8fa6-0f67375143a3 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:14.722227 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf53f3b-c929-4585-9817-996a88011d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:14.723236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf53f3b-c929-4585-9817-996a88011d5b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.723752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf53f3b-c929-4585-9817-996a88011d5b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.724231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf53f3b-c929-4585-9817-996a88011d5b None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-cdede489-521d-44de-8fa6-0f67375143a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:14.724406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:14.725258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:14.726152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:14.726152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:14.726152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:14.726152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:14.726152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:14.726152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:14.726152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:14.726152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:14.727880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf53f3b-c929-4585-9817-996a88011d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:14.728475 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf53f3b-c929-4585-9817-996a88011d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:14.730127 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf53f3b-c929-4585-9817-996a88011d5b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:14.730716 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 374/743] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:14.731678 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdede489-521d-44de-8fa6-0f67375143a3 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:14.742371 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:14.744678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 370/744] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:14.746077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf53f3b-c929-4585-9817-996a88011d5b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:14.848953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdede489-521d-44de-8fa6-0f67375143a3 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:14.854973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf53f3b-c929-4585-9817-996a88011d5b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:14.887877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58e933-fb84-4ba3-8fc5-45f6a87b211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:14.888712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58e933-fb84-4ba3-8fc5-45f6a87b211b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.889008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58e933-fb84-4ba3-8fc5-45f6a87b211b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.889281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58e933-fb84-4ba3-8fc5-45f6a87b211b None admin] PATH_INFO: `/v3/roles/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.893505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b467d88-5497-4b2a-b806-d2d768da9361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:14.894480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b467d88-5497-4b2a-b806-d2d768da9361 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.894991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b467d88-5497-4b2a-b806-d2d768da9361 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.895513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b467d88-5497-4b2a-b806-d2d768da9361 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.896783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b467d88-5497-4b2a-b806-d2d768da9361 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:14.897350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b467d88-5497-4b2a-b806-d2d768da9361 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:14.899044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b467d88-5497-4b2a-b806-d2d768da9361 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:14.901905 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58e933-fb84-4ba3-8fc5-45f6a87b211b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-ce58e933-fb84-4ba3-8fc5-45f6a87b211b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:14.910819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:14.911843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:14.912723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:14.912723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:14.912723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:14.912723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:14.912723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:14.912723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:14.912723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:14.912723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:14.912723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:14.912723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:14.912723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:14.912723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:14.912723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 375/745] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:36:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:14.913408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58e933-fb84-4ba3-8fc5-45f6a87b211b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:14.917499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 371/746] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:14.918752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b467d88-5497-4b2a-b806-d2d768da9361 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:14.940778 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:15.006933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:15.056878 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b467d88-5497-4b2a-b806-d2d768da9361 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:15.060218 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58e933-fb84-4ba3-8fc5-45f6a87b211b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:15.104613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0ec9e-ba18-44eb-bf91-156e77af49cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.105443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0ec9e-ba18-44eb-bf91-156e77af49cc None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.105843 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0ec9e-ba18-44eb-bf91-156e77af49cc None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.106222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0ec9e-ba18-44eb-bf91-156e77af49cc None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.106640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12e56a-a6e9-4fbf-82ba-01b97b9e269b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.107183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0ec9e-ba18-44eb-bf91-156e77af49cc None admin] RBAC: Adding query filter params (name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:15.107663 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0ec9e-ba18-44eb-bf91-156e77af49cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:15.107986 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12e56a-a6e9-4fbf-82ba-01b97b9e269b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.108431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12e56a-a6e9-4fbf-82ba-01b97b9e269b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.108860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12e56a-a6e9-4fbf-82ba-01b97b9e269b None admin] PATH_INFO: `/v3/users/swift` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.109422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0ec9e-ba18-44eb-bf91-156e77af49cc None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:15.117541 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12e56a-a6e9-4fbf-82ba-01b97b9e269b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:15.119260 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12e56a-a6e9-4fbf-82ba-01b97b9e269b None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:15.119998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 372/747] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:36:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:15.121246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0ec9e-ba18-44eb-bf91-156e77af49cc None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-bc12e56a-a6e9-4fbf-82ba-01b97b9e269b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:15.136819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:15.137847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:15.139357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:15.139357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:15.139357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:15.139357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:15.139357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:15.139357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:15.139357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:15.139357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:15.139357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:36:15.139357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:15.142248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 376/748] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:15.143399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12e56a-a6e9-4fbf-82ba-01b97b9e269b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:15.221109 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:15.258105 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0ec9e-ba18-44eb-bf91-156e77af49cc None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:15.272682 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12e56a-a6e9-4fbf-82ba-01b97b9e269b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:15.300185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:15.309663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11244bc0-9c3e-453f-959e-f665d39b9d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.310781 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11244bc0-9c3e-453f-959e-f665d39b9d1d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.311333 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11244bc0-9c3e-453f-959e-f665d39b9d1d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.312477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11244bc0-9c3e-453f-959e-f665d39b9d1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.315083 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30da25-30ec-4b96-a00c-52ab18e2ffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.316329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30da25-30ec-4b96-a00c-52ab18e2ffdd None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.316614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30da25-30ec-4b96-a00c-52ab18e2ffdd None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.316891 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30da25-30ec-4b96-a00c-52ab18e2ffdd None admin] PATH_INFO: `/v3/projects/8deff8fec8614da6997a32993c033fd8/users/b9971f2bf0f2400b90168f6032a0e226/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.318925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30da25-30ec-4b96-a00c-52ab18e2ffdd None admin] RBAC: Authorizing `identity:create_grant(project_id=8deff8fec8614da6997a32993c033fd8, user_id=b9971f2bf0f2400b90168f6032a0e226, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:15.320577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30da25-30ec-4b96-a00c-52ab18e2ffdd None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:15.325283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11244bc0-9c3e-453f-959e-f665d39b9d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:15.327588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11244bc0-9c3e-453f-959e-f665d39b9d1d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-11244bc0-9c3e-453f-959e-f665d39b9d1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:15.346828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:15.347824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:15.348724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:15.348724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:15.348724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:15.348724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:15.348724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 377/749] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:15.352480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11244bc0-9c3e-453f-959e-f665d39b9d1d None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:15.415853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 373/750] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:36:15 2022] PUT /identity/v3/projects/8deff8fec8614da6997a32993c033fd8/users/b9971f2bf0f2400b90168f6032a0e226/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:15.417248 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30da25-30ec-4b96-a00c-52ab18e2ffdd None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:15.484725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11244bc0-9c3e-453f-959e-f665d39b9d1d None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:15.526458 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b3504-f878-42d0-b2e9-7e48514d387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.527134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b3504-f878-42d0-b2e9-7e48514d387f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.527487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b3504-f878-42d0-b2e9-7e48514d387f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.527768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b3504-f878-42d0-b2e9-7e48514d387f None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.528607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b3504-f878-42d0-b2e9-7e48514d387f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:15.528963 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b3504-f878-42d0-b2e9-7e48514d387f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:15.530460 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b3504-f878-42d0-b2e9-7e48514d387f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:15.551299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 378/751] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 2 13:36:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:15.552792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07185bbc-2102-4029-8824-41de0e77416e None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.553080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07185bbc-2102-4029-8824-41de0e77416e None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.553353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07185bbc-2102-4029-8824-41de0e77416e None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.559063 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 379/752] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:15.560053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07185bbc-2102-4029-8824-41de0e77416e None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:15.595837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30da25-30ec-4b96-a00c-52ab18e2ffdd None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:15.603158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:15.638019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:15.645171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec6246-2736-445a-84d9-02e7ea247044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.646130 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec6246-2736-445a-84d9-02e7ea247044 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.646600 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec6246-2736-445a-84d9-02e7ea247044 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.647054 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec6246-2736-445a-84d9-02e7ea247044 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.647817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec6246-2736-445a-84d9-02e7ea247044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:15.648122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec6246-2736-445a-84d9-02e7ea247044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:15.649495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec6246-2736-445a-84d9-02e7ea247044 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:15.662511 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 374/753] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:15.663853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b5cbc-3459-4c66-860b-aba6aafee67d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.664138 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b5cbc-3459-4c66-860b-aba6aafee67d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.664412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b5cbc-3459-4c66-860b-aba6aafee67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.681754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07185bbc-2102-4029-8824-41de0e77416e None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:15.683983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d84b5cbc-3459-4c66-860b-aba6aafee67d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:15.685164 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d84b5cbc-3459-4c66-860b-aba6aafee67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:15.723105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28383db-05f7-4355-af74-19572a7e707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.723790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28383db-05f7-4355-af74-19572a7e707c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.724075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28383db-05f7-4355-af74-19572a7e707c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.724350 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28383db-05f7-4355-af74-19572a7e707c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.768234 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 375/754] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:15.769490 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b5cbc-3459-4c66-860b-aba6aafee67d None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:15.816705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28383db-05f7-4355-af74-19572a7e707c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:15.818186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28383db-05f7-4355-af74-19572a7e707c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:15.855243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:15.878686 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b5cbc-3459-4c66-860b-aba6aafee67d None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:15.916061 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e6dd2-bbc0-43c0-b67b-8e3fe2d3eb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.917308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e6dd2-bbc0-43c0-b67b-8e3fe2d3eb7b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.917750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e6dd2-bbc0-43c0-b67b-8e3fe2d3eb7b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.923563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 380/755] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:36:15.923717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:15.924251 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e6dd2-bbc0-43c0-b67b-8e3fe2d3eb7b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.924397 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28383db-05f7-4355-af74-19572a7e707c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:15.934402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e6dd2-bbc0-43c0-b67b-8e3fe2d3eb7b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:15.937353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e6dd2-bbc0-43c0-b67b-8e3fe2d3eb7b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-aa1e6dd2-bbc0-43c0-b67b-8e3fe2d3eb7b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:15.958700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:15.959771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:15.960897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:15.960897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:15.960897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:15.960897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:15.960897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:15.960897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:15.960897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:15.960897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:15.960897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:36:15.960897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:15.967631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 376/756] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 2 13:36:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:15.967631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e6dd2-bbc0-43c0-b67b-8e3fe2d3eb7b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:16.045368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28383db-05f7-4355-af74-19572a7e707c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:16.084189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9299b6-44ee-47bb-a405-b892c8bce825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:16.085002 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9299b6-44ee-47bb-a405-b892c8bce825 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.085280 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9299b6-44ee-47bb-a405-b892c8bce825 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.085557 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9299b6-44ee-47bb-a405-b892c8bce825 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.085876 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e6dd2-bbc0-43c0-b67b-8e3fe2d3eb7b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:16.086212 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9299b6-44ee-47bb-a405-b892c8bce825 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:16.087623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9299b6-44ee-47bb-a405-b892c8bce825 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:16.091955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-2a9299b6-44ee-47bb-a405-b892c8bce825 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:16.103357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:16.109081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:16.109924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 381/757] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jun 2 13:36:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:16.110888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9299b6-44ee-47bb-a405-b892c8bce825 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:16.131273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f06a31-5b13-449c-aed5-a49cdcd2f80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:16.132797 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f06a31-5b13-449c-aed5-a49cdcd2f80f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.133309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f06a31-5b13-449c-aed5-a49cdcd2f80f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.133800 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f06a31-5b13-449c-aed5-a49cdcd2f80f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.146677 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f06a31-5b13-449c-aed5-a49cdcd2f80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:16.148512 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f06a31-5b13-449c-aed5-a49cdcd2f80f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-28f06a31-5b13-449c-aed5-a49cdcd2f80f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:16.168682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:16.169660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:16.171182 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:16.171182 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:16.171182 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:16.171182 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:16.173587 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 377/758] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:16.174659 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f06a31-5b13-449c-aed5-a49cdcd2f80f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:16.220208 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:16.222418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9299b6-44ee-47bb-a405-b892c8bce825 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:16.278471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6405a-3240-4db2-b369-1df542ec3573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:16.279249 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6405a-3240-4db2-b369-1df542ec3573 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.279993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6405a-3240-4db2-b369-1df542ec3573 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.280270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6405a-3240-4db2-b369-1df542ec3573 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.281120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6405a-3240-4db2-b369-1df542ec3573 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:16.281469 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6405a-3240-4db2-b369-1df542ec3573 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:16.282877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6405a-3240-4db2-b369-1df542ec3573 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:16.307733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 382/759] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 2 13:36:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:16.307733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6405a-3240-4db2-b369-1df542ec3573 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:16.325917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f06a31-5b13-449c-aed5-a49cdcd2f80f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:16.364284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd24f67-68a4-4af2-9aa2-3e26ee7dc9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:16.364959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd24f67-68a4-4af2-9aa2-3e26ee7dc9ef None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.365239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd24f67-68a4-4af2-9aa2-3e26ee7dc9ef None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.365509 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd24f67-68a4-4af2-9aa2-3e26ee7dc9ef None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.366211 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd24f67-68a4-4af2-9aa2-3e26ee7dc9ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:16.366511 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd24f67-68a4-4af2-9aa2-3e26ee7dc9ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:16.368030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd24f67-68a4-4af2-9aa2-3e26ee7dc9ef None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:16.374161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:16.374443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 378/760] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 2 13:36:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:16.378880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd24f67-68a4-4af2-9aa2-3e26ee7dc9ef None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:16.434476 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6405a-3240-4db2-b369-1df542ec3573 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:16.482211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebc4bc-4ea5-4e2e-be6f-a3d382ca9925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:16.483383 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebc4bc-4ea5-4e2e-be6f-a3d382ca9925 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.483714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebc4bc-4ea5-4e2e-be6f-a3d382ca9925 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.484338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebc4bc-4ea5-4e2e-be6f-a3d382ca9925 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.484697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebc4bc-4ea5-4e2e-be6f-a3d382ca9925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:16.485000 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebc4bc-4ea5-4e2e-be6f-a3d382ca9925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:16.486369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebc4bc-4ea5-4e2e-be6f-a3d382ca9925 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:16.503524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 383/761] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:16.503524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebc4bc-4ea5-4e2e-be6f-a3d382ca9925 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:16.517363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:16.523645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd24f67-68a4-4af2-9aa2-3e26ee7dc9ef None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:16.579726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a464c-4dfa-46c0-96aa-785a822cbcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:16.581850 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a464c-4dfa-46c0-96aa-785a822cbcd8 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.582361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a464c-4dfa-46c0-96aa-785a822cbcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.582833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a464c-4dfa-46c0-96aa-785a822cbcd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.617027 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebc4bc-4ea5-4e2e-be6f-a3d382ca9925 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:16.637809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:16.664888 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a464c-4dfa-46c0-96aa-785a822cbcd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:16.665480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e2187-c01a-4c9c-9c86-72b7dfb6f2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:16.666603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a464c-4dfa-46c0-96aa-785a822cbcd8 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:16.667052 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e2187-c01a-4c9c-9c86-72b7dfb6f2ed None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.667154 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e2187-c01a-4c9c-9c86-72b7dfb6f2ed None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.667633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e2187-c01a-4c9c-9c86-72b7dfb6f2ed None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.668959 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e2187-c01a-4c9c-9c86-72b7dfb6f2ed None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:16.669513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e2187-c01a-4c9c-9c86-72b7dfb6f2ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:16.672287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e2187-c01a-4c9c-9c86-72b7dfb6f2ed None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:16.683619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 384/762] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 2 13:36:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:16.683619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e2187-c01a-4c9c-9c86-72b7dfb6f2ed None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:16.797695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:16.808305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 379/763] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:36:16.808305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a45c41-227f-4316-a50b-8506f075b8d0 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.808305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a45c41-227f-4316-a50b-8506f075b8d0 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.808305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a45c41-227f-4316-a50b-8506f075b8d0 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.808305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 380/764] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:16.822459 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a45c41-227f-4316-a50b-8506f075b8d0 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:16.822554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e2187-c01a-4c9c-9c86-72b7dfb6f2ed None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:16.859090 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20e466-54a0-4bd6-a6a5-889e5debabe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:16.860131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20e466-54a0-4bd6-a6a5-889e5debabe9 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.860425 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20e466-54a0-4bd6-a6a5-889e5debabe9 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.860705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20e466-54a0-4bd6-a6a5-889e5debabe9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.868223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20e466-54a0-4bd6-a6a5-889e5debabe9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:16.869694 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20e466-54a0-4bd6-a6a5-889e5debabe9 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-1f20e466-54a0-4bd6-a6a5-889e5debabe9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:16.885435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:16.886471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:16.887428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:16.887428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:16.887428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:16.887428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:16.887428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:16.887428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:16.887428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:16.887428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:16.887428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 385/765] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:16.887428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20e466-54a0-4bd6-a6a5-889e5debabe9 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:16.927745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a45c41-227f-4316-a50b-8506f075b8d0 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:16.938488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:16.970363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818c557-5e25-4eb9-a610-ca139b9019a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:16.971185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818c557-5e25-4eb9-a610-ca139b9019a8 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.971498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818c557-5e25-4eb9-a610-ca139b9019a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.971784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818c557-5e25-4eb9-a610-ca139b9019a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.972813 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818c557-5e25-4eb9-a610-ca139b9019a8 None admin] RBAC: Adding query filter params (interface=public, service_id=39e820d65a524092804d32ee7f58b596, region_id=RegionOne) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:16.973135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818c557-5e25-4eb9-a610-ca139b9019a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:16.975168 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818c557-5e25-4eb9-a610-ca139b9019a8 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:16.987878 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 381/766] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 2 13:36:16 2022] GET /identity/v3/endpoints?service_id=39e820d65a524092804d32ee7f58b596&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:16.989789 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae19c-1924-4e62-a08d-a8b750b20676 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.990077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae19c-1924-4e62-a08d-a8b750b20676 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.990352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae19c-1924-4e62-a08d-a8b750b20676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:17.008338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-5a5ae19c-1924-4e62-a08d-a8b750b20676 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:17.009662 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-5a5ae19c-1924-4e62-a08d-a8b750b20676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:17.009987 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20e466-54a0-4bd6-a6a5-889e5debabe9 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:17.052395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b22f9e-86db-485c-a9b3-7ab5d4a3eaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:17.053204 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22f9e-86db-485c-a9b3-7ab5d4a3eaff None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:17.053483 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22f9e-86db-485c-a9b3-7ab5d4a3eaff None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:17.053749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22f9e-86db-485c-a9b3-7ab5d4a3eaff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:17.065942 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b22f9e-86db-485c-a9b3-7ab5d4a3eaff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:17.067614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b22f9e-86db-485c-a9b3-7ab5d4a3eaff None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:17.076388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:17.094307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 382/767] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-95b22f9e-86db-485c-a9b3-7ab5d4a3eaff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:17.094534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:17.095665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:17.096747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:17.096747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:17.096747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:17.096747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:17.097034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ae19c-1924-4e62-a08d-a8b750b20676 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:17.097111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 386/768] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:17.097111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b22f9e-86db-485c-a9b3-7ab5d4a3eaff None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:17.225985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ae19c-1924-4e62-a08d-a8b750b20676 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:17.234962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:17.247388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b22f9e-86db-485c-a9b3-7ab5d4a3eaff None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:17.272159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f376fe-3d07-4e99-bd95-3b4d17572bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:17.273188 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f376fe-3d07-4e99-bd95-3b4d17572bd8 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:17.273689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f376fe-3d07-4e99-bd95-3b4d17572bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:17.274190 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f376fe-3d07-4e99-bd95-3b4d17572bd8 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:17.275774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f376fe-3d07-4e99-bd95-3b4d17572bd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:17.276303 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f376fe-3d07-4e99-bd95-3b4d17572bd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:17.277918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f376fe-3d07-4e99-bd95-3b4d17572bd8 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:17.292465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 383/769] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:17.293419 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f376fe-3d07-4e99-bd95-3b4d17572bd8 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:17.305764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be80d98-29c2-4db3-b7e9-73fc6ad9fddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:17.306457 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be80d98-29c2-4db3-b7e9-73fc6ad9fddf None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:17.306780 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be80d98-29c2-4db3-b7e9-73fc6ad9fddf None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:17.307064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be80d98-29c2-4db3-b7e9-73fc6ad9fddf None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:17.307831 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be80d98-29c2-4db3-b7e9-73fc6ad9fddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:17.309217 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be80d98-29c2-4db3-b7e9-73fc6ad9fddf None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:17.319875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 387/770] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 2 13:36:17 2022] GET /identity/v3/services => generated 772 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:17.321663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be80d98-29c2-4db3-b7e9-73fc6ad9fddf None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:17.387343 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:17.461722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f376fe-3d07-4e99-bd95-3b4d17572bd8 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:17.469848 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be80d98-29c2-4db3-b7e9-73fc6ad9fddf None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:17.509393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe6230-780a-4704-ab4b-e8ea85a884dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:17.510097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6230-780a-4704-ab4b-e8ea85a884dd None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:17.510455 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6230-780a-4704-ab4b-e8ea85a884dd None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:17.510822 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6230-780a-4704-ab4b-e8ea85a884dd None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:17.511997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe6230-780a-4704-ab4b-e8ea85a884dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:17.511997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe6230-780a-4704-ab4b-e8ea85a884dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:17.513554 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe6230-780a-4704-ab4b-e8ea85a884dd None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:17.522161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8e8a1-8c37-4b13-a0dd-11cb0c2edca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:17.524101 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8e8a1-8c37-4b13-a0dd-11cb0c2edca1 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:17.524550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8e8a1-8c37-4b13-a0dd-11cb0c2edca1 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:17.525518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8e8a1-8c37-4b13-a0dd-11cb0c2edca1 None admin] PATH_INFO: `/v3/services/network` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:17.526353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8e8a1-8c37-4b13-a0dd-11cb0c2edca1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:17.528229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8e8a1-8c37-4b13-a0dd-11cb0c2edca1 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:17.530110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 384/771] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:17.531062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe6230-780a-4704-ab4b-e8ea85a884dd None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-64c8e8a1-8c37-4b13-a0dd-11cb0c2edca1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:17.544488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:17.546130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:17.547324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 388/772] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:17 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:17.548596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8e8a1-8c37-4b13-a0dd-11cb0c2edca1 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:17.578498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:17.667101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe6230-780a-4704-ab4b-e8ea85a884dd None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:17.671693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8e8a1-8c37-4b13-a0dd-11cb0c2edca1 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:17.697327 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:17.713258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387975d3-d784-4bc5-98e9-0fd7e8754ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:17.714093 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387975d3-d784-4bc5-98e9-0fd7e8754ba2 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:17.714390 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387975d3-d784-4bc5-98e9-0fd7e8754ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:17.714651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387975d3-d784-4bc5-98e9-0fd7e8754ba2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:17.724106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387975d3-d784-4bc5-98e9-0fd7e8754ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:17.725768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387975d3-d784-4bc5-98e9-0fd7e8754ba2 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:17.726944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9265730-165a-4572-92c0-fc7e421955dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:17.728111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9265730-165a-4572-92c0-fc7e421955dc None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:17.728981 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9265730-165a-4572-92c0-fc7e421955dc None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:17.729425 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9265730-165a-4572-92c0-fc7e421955dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:17.730423 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9265730-165a-4572-92c0-fc7e421955dc None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=00f3424dc2ee4f828638b3a8f5c9fc5d) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:17.730894 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9265730-165a-4572-92c0-fc7e421955dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:17.733374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9265730-165a-4572-92c0-fc7e421955dc None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:17.740399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 385/773] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:17 2022] GET /identity/v3/role_assignments?user.id=00f3424dc2ee4f828638b3a8f5c9fc5d&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=c5632345c9274d348669482f1f7414c8 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:17.741511 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9265730-165a-4572-92c0-fc7e421955dc None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-387975d3-d784-4bc5-98e9-0fd7e8754ba2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:17.750489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:17.751700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:17.752838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:17.752838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:17.752838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:17.752838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:17.752838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:17.752838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:17.752838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:17.752838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:17.753829 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 389/774] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:17.759841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387975d3-d784-4bc5-98e9-0fd7e8754ba2 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:17.877110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:17.886627 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9265730-165a-4572-92c0-fc7e421955dc None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:17.902520 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387975d3-d784-4bc5-98e9-0fd7e8754ba2 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:17.940079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45366300-99cc-48a6-bad1-54d4fda4200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:17.941312 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45366300-99cc-48a6-bad1-54d4fda4200b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:17.941875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45366300-99cc-48a6-bad1-54d4fda4200b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:17.942580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45366300-99cc-48a6-bad1-54d4fda4200b None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:17.944132 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45366300-99cc-48a6-bad1-54d4fda4200b None admin] RBAC: Adding query filter params (name=network) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:17.945068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45366300-99cc-48a6-bad1-54d4fda4200b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:17.947177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45366300-99cc-48a6-bad1-54d4fda4200b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:17.953589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 386/775] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 2 13:36:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:17.955557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eb6e4-a2ad-4605-ae7a-b36d2e849977 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:17.955845 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eb6e4-a2ad-4605-ae7a-b36d2e849977 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:17.956123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eb6e4-a2ad-4605-ae7a-b36d2e849977 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:17.957791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 387/776] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:17.960513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc66502-71cd-4065-9621-614faade5664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:17.962614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc66502-71cd-4065-9621-614faade5664 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:17.963133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc66502-71cd-4065-9621-614faade5664 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:17.963429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade32dd0-1c0e-4be4-b7f1-04871165aa22 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:17.963681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc66502-71cd-4065-9621-614faade5664 None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:17.963800 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade32dd0-1c0e-4be4-b7f1-04871165aa22 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:17.964020 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade32dd0-1c0e-4be4-b7f1-04871165aa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:17.965356 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc66502-71cd-4065-9621-614faade5664 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:17.965922 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc66502-71cd-4065-9621-614faade5664 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:17.972275 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc66502-71cd-4065-9621-614faade5664 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:17.985595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ade32dd0-1c0e-4be4-b7f1-04871165aa22 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:17.987436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ade32dd0-1c0e-4be4-b7f1-04871165aa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:18.001308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 390/777] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:18.004432 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc66502-71cd-4065-9621-614faade5664 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:18.055941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:18.094105 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 388/778] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:18.095819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade32dd0-1c0e-4be4-b7f1-04871165aa22 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:18.187233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc66502-71cd-4065-9621-614faade5664 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:18.235917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade32dd0-1c0e-4be4-b7f1-04871165aa22 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:18.243736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501aef8d-c62f-490c-ae4c-ac55d3e2678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:18.244849 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aef8d-c62f-490c-ae4c-ac55d3e2678d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:18.245279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aef8d-c62f-490c-ae4c-ac55d3e2678d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:18.245869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aef8d-c62f-490c-ae4c-ac55d3e2678d None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:18.246626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501aef8d-c62f-490c-ae4c-ac55d3e2678d None admin] RBAC: Adding query filter params (type=network) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:18.246938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501aef8d-c62f-490c-ae4c-ac55d3e2678d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:18.248500 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501aef8d-c62f-490c-ae4c-ac55d3e2678d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:18.259955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 391/779] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 2 13:36:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:18.261297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501aef8d-c62f-490c-ae4c-ac55d3e2678d None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:18.282553 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:18.301845 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768ed81-706f-437a-9c3c-b02b708e9d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:18.302517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768ed81-706f-437a-9c3c-b02b708e9d3c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:18.302848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768ed81-706f-437a-9c3c-b02b708e9d3c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:18.303125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768ed81-706f-437a-9c3c-b02b708e9d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:18.304249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768ed81-706f-437a-9c3c-b02b708e9d3c None admin] RBAC: Adding query filter params (role.id=a9712a3506694519b4e4945b54539d79, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=70f0634c146244a1a0e91f89493cc076) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:18.304382 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768ed81-706f-437a-9c3c-b02b708e9d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:18.305760 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768ed81-706f-437a-9c3c-b02b708e9d3c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:18.312575 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 389/780] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:18 2022] GET /identity/v3/role_assignments?user.id=70f0634c146244a1a0e91f89493cc076&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=a9712a3506694519b4e4945b54539d79 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:18.313564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768ed81-706f-437a-9c3c-b02b708e9d3c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:18.360770 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:18.399921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501aef8d-c62f-490c-ae4c-ac55d3e2678d None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:18.472259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aada7bc-819b-44d6-ab96-12edc74c058c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:18.473437 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aada7bc-819b-44d6-ab96-12edc74c058c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:18.473913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aada7bc-819b-44d6-ab96-12edc74c058c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:18.474382 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aada7bc-819b-44d6-ab96-12edc74c058c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:18.492472 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768ed81-706f-437a-9c3c-b02b708e9d3c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:18.498914 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aada7bc-819b-44d6-ab96-12edc74c058c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-6aada7bc-819b-44d6-ab96-12edc74c058c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:18.519513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:18.520544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:18.521459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:18.521459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:18.521459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:18.521459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:18.521459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:18.521459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:18.521459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:18.521459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:18.521459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:18.521459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:18.521459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:18.521459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:18.524002 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 392/781] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:18.530458 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aada7bc-819b-44d6-ab96-12edc74c058c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:18.534846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045880-ff12-4c5c-8173-8cd0c61ea636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:18.535668 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045880-ff12-4c5c-8173-8cd0c61ea636 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:18.535957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045880-ff12-4c5c-8173-8cd0c61ea636 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:18.536230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045880-ff12-4c5c-8173-8cd0c61ea636 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:18.537038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb045880-ff12-4c5c-8173-8cd0c61ea636 None admin] RBAC: Adding query filter params (interface=public, service_id=80ec75b4d22b4f3aa0d99e2ce3a106ae, region_id=RegionOne) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:18.537354 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb045880-ff12-4c5c-8173-8cd0c61ea636 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:18.538732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb045880-ff12-4c5c-8173-8cd0c61ea636 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:18.548982 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 390/782] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 2 13:36:18 2022] GET /identity/v3/endpoints?service_id=80ec75b4d22b4f3aa0d99e2ce3a106ae&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:18.554898 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045880-ff12-4c5c-8173-8cd0c61ea636 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:18.681352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:18.735656 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aada7bc-819b-44d6-ab96-12edc74c058c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:18.743852 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:18.748718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045880-ff12-4c5c-8173-8cd0c61ea636 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:18.789879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb016af7-33b5-435e-922f-18c600648034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:18.790599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb016af7-33b5-435e-922f-18c600648034 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:18.790886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb016af7-33b5-435e-922f-18c600648034 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:18.791186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb016af7-33b5-435e-922f-18c600648034 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:18.791925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb016af7-33b5-435e-922f-18c600648034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:18.793651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb016af7-33b5-435e-922f-18c600648034 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:18.801087 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 391/783] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 2 13:36:18 2022] GET /identity/v3/services => generated 772 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:18.854844 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d450bc-0b27-47e6-ab04-a3a4f461439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:18.855630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d450bc-0b27-47e6-ab04-a3a4f461439b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:18.855919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d450bc-0b27-47e6-ab04-a3a4f461439b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:18.856196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d450bc-0b27-47e6-ab04-a3a4f461439b None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:18.856975 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d450bc-0b27-47e6-ab04-a3a4f461439b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:18.857286 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d450bc-0b27-47e6-ab04-a3a4f461439b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:18.859318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d450bc-0b27-47e6-ab04-a3a4f461439b None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:18.876357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 393/784] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:18.881772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb016af7-33b5-435e-922f-18c600648034 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.088483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb016af7-33b5-435e-922f-18c600648034 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.138324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01f5ad-7749-402f-b3d5-31d2bb6e21cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.139176 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01f5ad-7749-402f-b3d5-31d2bb6e21cb None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.139485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01f5ad-7749-402f-b3d5-31d2bb6e21cb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.139755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01f5ad-7749-402f-b3d5-31d2bb6e21cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.159973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01f5ad-7749-402f-b3d5-31d2bb6e21cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.161465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01f5ad-7749-402f-b3d5-31d2bb6e21cb None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-5b01f5ad-7749-402f-b3d5-31d2bb6e21cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:19.183030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:19.184064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:19.185421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:19.185421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:19.185421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:19.185421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:19.185421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 392/785] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:19.190383 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d450bc-0b27-47e6-ab04-a3a4f461439b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.346078 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d450bc-0b27-47e6-ab04-a3a4f461439b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.381598 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:19.393525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1472c3-d613-449c-bbf4-a1b48fd96661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.394189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1472c3-d613-449c-bbf4-a1b48fd96661 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.394469 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1472c3-d613-449c-bbf4-a1b48fd96661 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.394741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1472c3-d613-449c-bbf4-a1b48fd96661 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.395479 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1472c3-d613-449c-bbf4-a1b48fd96661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:19.395791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1472c3-d613-449c-bbf4-a1b48fd96661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.397168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1472c3-d613-449c-bbf4-a1b48fd96661 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:19.410328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 394/786] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:19.415609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01f5ad-7749-402f-b3d5-31d2bb6e21cb None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.467816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:19.605183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01f5ad-7749-402f-b3d5-31d2bb6e21cb None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.646458 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa589a8-3268-4b8c-8d80-e37c48b12bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.647264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa589a8-3268-4b8c-8d80-e37c48b12bc0 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.647595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa589a8-3268-4b8c-8d80-e37c48b12bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.647877 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa589a8-3268-4b8c-8d80-e37c48b12bc0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.656628 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa589a8-3268-4b8c-8d80-e37c48b12bc0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.658111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa589a8-3268-4b8c-8d80-e37c48b12bc0 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-3fa589a8-3268-4b8c-8d80-e37c48b12bc0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:19.674257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:19.675269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:19.676727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:19.676727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:19.676727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:19.676727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:19.676727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:19.676727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:19.676727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:19.676727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:19.676727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:36:19.676727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:19.676727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 393/787] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 2 13:36:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:19.684573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1472c3-d613-449c-bbf4-a1b48fd96661 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.890814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1472c3-d613-449c-bbf4-a1b48fd96661 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.926075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087192-37b9-489d-b571-ce7e118afe87 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.926420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087192-37b9-489d-b571-ce7e118afe87 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.926626 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087192-37b9-489d-b571-ce7e118afe87 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.928190 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 394/788] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:36:19.933006 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029445c-1673-4ff1-8e06-32509cde4ff6 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.933288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029445c-1673-4ff1-8e06-32509cde4ff6 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.933560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029445c-1673-4ff1-8e06-32509cde4ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.958835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-7029445c-1673-4ff1-8e06-32509cde4ff6 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:19.960076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-7029445c-1673-4ff1-8e06-32509cde4ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:19.963586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe3d14-1635-4daf-a05b-f302eaa4eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.964273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe3d14-1635-4daf-a05b-f302eaa4eada None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.964558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe3d14-1635-4daf-a05b-f302eaa4eada None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.964836 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe3d14-1635-4daf-a05b-f302eaa4eada None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.965687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe3d14-1635-4daf-a05b-f302eaa4eada None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:19.965998 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe3d14-1635-4daf-a05b-f302eaa4eada None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.967496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe3d14-1635-4daf-a05b-f302eaa4eada None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:20.006681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 395/789] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 2 13:36:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:20.012329 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe3d14-1635-4daf-a05b-f302eaa4eada None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:20.105258 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 395/790] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:20.106432 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:20.152193 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029445c-1673-4ff1-8e06-32509cde4ff6 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:20.155572 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:20.192963 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe3d14-1635-4daf-a05b-f302eaa4eada None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:20.265963 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45eda9b-4f90-4986-b6f7-7155407d76dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:20.267198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eda9b-4f90-4986-b6f7-7155407d76dd None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:20.267761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eda9b-4f90-4986-b6f7-7155407d76dd None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:20.270994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eda9b-4f90-4986-b6f7-7155407d76dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:20.333451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029445c-1673-4ff1-8e06-32509cde4ff6 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:20.395420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45eda9b-4f90-4986-b6f7-7155407d76dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:20.396907 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45eda9b-4f90-4986-b6f7-7155407d76dd None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:20.406221 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5917f9-738e-41f1-825e-2d7cded4af58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:20.406967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5917f9-738e-41f1-825e-2d7cded4af58 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:20.407246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5917f9-738e-41f1-825e-2d7cded4af58 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:20.407543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5917f9-738e-41f1-825e-2d7cded4af58 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:20.408207 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5917f9-738e-41f1-825e-2d7cded4af58 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:20.409590 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5917f9-738e-41f1-825e-2d7cded4af58 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-7e5917f9-738e-41f1-825e-2d7cded4af58 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:20.433310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:20.434727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:36:20.435569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:20.439199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 396/791] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jun 2 13:36:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:20.445288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5917f9-738e-41f1-825e-2d7cded4af58 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:20.504368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:20.571110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:20.616238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5917f9-738e-41f1-825e-2d7cded4af58 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:20.619502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 396/792] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:36:20.636134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45eda9b-4f90-4986-b6f7-7155407d76dd None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:20.662021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e68c5-acec-46ff-a96b-12e6b176f8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:20.662609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e68c5-acec-46ff-a96b-12e6b176f8e9 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:20.662887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e68c5-acec-46ff-a96b-12e6b176f8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:20.663160 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e68c5-acec-46ff-a96b-12e6b176f8e9 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:20.663955 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e68c5-acec-46ff-a96b-12e6b176f8e9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:20.664257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e68c5-acec-46ff-a96b-12e6b176f8e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:20.665660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e68c5-acec-46ff-a96b-12e6b176f8e9 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:20.671839 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 397/793] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 2 13:36:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:20.673186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad5f13-8c33-4412-b93a-b7152f136a6c None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:20.673477 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad5f13-8c33-4412-b93a-b7152f136a6c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:20.673753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad5f13-8c33-4412-b93a-b7152f136a6c None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:20.675246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 398/794] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:20.677382 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad5f13-8c33-4412-b93a-b7152f136a6c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:20.775882 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45eda9b-4f90-4986-b6f7-7155407d76dd None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:20.796924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad5f13-8c33-4412-b93a-b7152f136a6c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:20.829536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9c971-7d87-405c-a996-802026a7a02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:20.830872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9c971-7d87-405c-a996-802026a7a02e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:20.831630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9c971-7d87-405c-a996-802026a7a02e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:20.832104 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9c971-7d87-405c-a996-802026a7a02e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:20.836098 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:20.841616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374014c-9988-405d-8d23-13361db6cdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:20.843031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374014c-9988-405d-8d23-13361db6cdc8 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:20.843486 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374014c-9988-405d-8d23-13361db6cdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:20.846716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374014c-9988-405d-8d23-13361db6cdc8 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:20.846716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374014c-9988-405d-8d23-13361db6cdc8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:20.846716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374014c-9988-405d-8d23-13361db6cdc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:20.846998 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9c971-7d87-405c-a996-802026a7a02e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:20.847618 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374014c-9988-405d-8d23-13361db6cdc8 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:20.847949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9c971-7d87-405c-a996-802026a7a02e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:20.854387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 399/795] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 2 13:36:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:20.856167 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c46c89-44bf-4888-bb41-2cb9c2db4b26 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:20.856645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c46c89-44bf-4888-bb41-2cb9c2db4b26 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:20.857098 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c46c89-44bf-4888-bb41-2cb9c2db4b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:20.857429 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-6db9c971-7d87-405c-a996-802026a7a02e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:20.871303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:20.872358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:20.874045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:20.874045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:20.874045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:20.874045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:20.875543 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 397/796] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:20.876605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9c971-7d87-405c-a996-802026a7a02e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:20.883712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-b0c46c89-44bf-4888-bb41-2cb9c2db4b26 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:20.886877 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b0c46c89-44bf-4888-bb41-2cb9c2db4b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:20.961986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 400/797] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:20.963422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c46c89-44bf-4888-bb41-2cb9c2db4b26 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:20.988326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9c971-7d87-405c-a996-802026a7a02e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:21.026427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203f97c-cfa7-484c-9b57-ac02288466fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:21.027502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203f97c-cfa7-484c-9b57-ac02288466fb None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.027973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203f97c-cfa7-484c-9b57-ac02288466fb None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.028426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203f97c-cfa7-484c-9b57-ac02288466fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.029450 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203f97c-cfa7-484c-9b57-ac02288466fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:21.031207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203f97c-cfa7-484c-9b57-ac02288466fb None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:21.081333 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c46c89-44bf-4888-bb41-2cb9c2db4b26 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:21.111543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:21.120889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6dc9c-4f97-4b45-a33e-5227b2e2b20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:21.121560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6dc9c-4f97-4b45-a33e-5227b2e2b20e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.121848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6dc9c-4f97-4b45-a33e-5227b2e2b20e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.122111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6dc9c-4f97-4b45-a33e-5227b2e2b20e None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.122837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6dc9c-4f97-4b45-a33e-5227b2e2b20e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:21.123173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6dc9c-4f97-4b45-a33e-5227b2e2b20e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:21.125180 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6dc9c-4f97-4b45-a33e-5227b2e2b20e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:21.141235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 401/798] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:21.141235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6dc9c-4f97-4b45-a33e-5227b2e2b20e None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:21.160015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 398/799] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 2 13:36:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:21.162314 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203f97c-cfa7-484c-9b57-ac02288466fb None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:21.314327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:21.382712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6dc9c-4f97-4b45-a33e-5227b2e2b20e None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:21.411606 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203f97c-cfa7-484c-9b57-ac02288466fb None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:21.427104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149a34f-e1b6-41b8-b459-8e1757d2820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:21.428321 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149a34f-e1b6-41b8-b459-8e1757d2820e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.428866 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149a34f-e1b6-41b8-b459-8e1757d2820e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.429156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149a34f-e1b6-41b8-b459-8e1757d2820e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.448565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149a34f-e1b6-41b8-b459-8e1757d2820e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-c149a34f-e1b6-41b8-b459-8e1757d2820e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:21.458644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:21.459725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:21.460766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:21.460766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:21.460766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:21.460766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:21.460766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:21.460766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:21.460766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:21.460766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:21.460766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:21.460766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:21.460766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:21.460766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:21.461522 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f461b-841a-4163-9ae7-d4547175d677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:21.461907 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f461b-841a-4163-9ae7-d4547175d677 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.462188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f461b-841a-4163-9ae7-d4547175d677 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.462462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f461b-841a-4163-9ae7-d4547175d677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.463531 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 402/800] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:21.465043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca518515-f7f6-4c3a-a209-38355f3e9e1b None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.465488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca518515-f7f6-4c3a-a209-38355f3e9e1b None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.465906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca518515-f7f6-4c3a-a209-38355f3e9e1b None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.467753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 403/801] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:21.471273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f461b-841a-4163-9ae7-d4547175d677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:21.473255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f461b-841a-4163-9ae7-d4547175d677 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:21.473828 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaa2f1-06b9-4407-ba73-1a9786e458d1 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.474284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaa2f1-06b9-4407-ba73-1a9786e458d1 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.474703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaa2f1-06b9-4407-ba73-1a9786e458d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-a49f461b-841a-4163-9ae7-d4547175d677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:21.490318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:21.491498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:21.492421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:21.492421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:21.492421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:21.492421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:21.492421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:21.492421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:21.492421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:21.492421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:21.492421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 399/802] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:21.492421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f461b-841a-4163-9ae7-d4547175d677 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:21.496949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-81aaa2f1-06b9-4407-ba73-1a9786e458d1 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:21.498940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-81aaa2f1-06b9-4407-ba73-1a9786e458d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:21.545505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:21.573836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 404/803] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:21.580555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaa2f1-06b9-4407-ba73-1a9786e458d1 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:21.604953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f461b-841a-4163-9ae7-d4547175d677 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:21.616420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:21.641908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96b1e3-b52e-486f-9ef6-d3a02fb84631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:21.642575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96b1e3-b52e-486f-9ef6-d3a02fb84631 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.642845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96b1e3-b52e-486f-9ef6-d3a02fb84631 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.643117 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96b1e3-b52e-486f-9ef6-d3a02fb84631 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.643901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96b1e3-b52e-486f-9ef6-d3a02fb84631 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:21.644206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96b1e3-b52e-486f-9ef6-d3a02fb84631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:21.645834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96b1e3-b52e-486f-9ef6-d3a02fb84631 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:21.655275 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 400/804] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:36:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:21.656707 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998a381-ff8a-437c-a25f-474611c5353f None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.657188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998a381-ff8a-437c-a25f-474611c5353f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.657360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998a381-ff8a-437c-a25f-474611c5353f None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.663005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 401/805] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:21.663005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998a381-ff8a-437c-a25f-474611c5353f None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:21.707317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaa2f1-06b9-4407-ba73-1a9786e458d1 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:21.744525 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706206d-c2f2-42c5-9085-c487ac0e5385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:21.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706206d-c2f2-42c5-9085-c487ac0e5385 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.745568 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706206d-c2f2-42c5-9085-c487ac0e5385 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.746102 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706206d-c2f2-42c5-9085-c487ac0e5385 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.746885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706206d-c2f2-42c5-9085-c487ac0e5385 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:21.747187 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706206d-c2f2-42c5-9085-c487ac0e5385 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:21.748725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706206d-c2f2-42c5-9085-c487ac0e5385 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:21.763642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 405/806] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:21.765086 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706206d-c2f2-42c5-9085-c487ac0e5385 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:21.778959 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998a381-ff8a-437c-a25f-474611c5353f None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:21.805667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:21.816379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd8975-565e-404c-a345-c2d02c1f2d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:21.817170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd8975-565e-404c-a345-c2d02c1f2d09 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.817447 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd8975-565e-404c-a345-c2d02c1f2d09 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.817718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd8975-565e-404c-a345-c2d02c1f2d09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.829124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd8975-565e-404c-a345-c2d02c1f2d09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-07bd8975-565e-404c-a345-c2d02c1f2d09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:21.837112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:21.838235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:21.839129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:21.839129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:21.839129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:21.839129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:21.839129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:21.839129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:21.839129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:21.839129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:21.839129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:21.839129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:21.839129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:21.839129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:21.839129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 402/807] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:36:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:21.840527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b97d-8771-4632-b884-e395bdb531f5 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.840527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b97d-8771-4632-b884-e395bdb531f5 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.840662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b97d-8771-4632-b884-e395bdb531f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.859266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-2719b97d-8771-4632-b884-e395bdb531f5 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:21.860534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2719b97d-8771-4632-b884-e395bdb531f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:21.883210 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706206d-c2f2-42c5-9085-c487ac0e5385 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:21.888503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:21.918799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8affb8-4294-499d-96ec-36bcc42c1171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:21.919609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8affb8-4294-499d-96ec-36bcc42c1171 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.919886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8affb8-4294-499d-96ec-36bcc42c1171 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.920737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8affb8-4294-499d-96ec-36bcc42c1171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.931986 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 403/808] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:21.932648 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719b97d-8771-4632-b884-e395bdb531f5 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:21.939958 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8affb8-4294-499d-96ec-36bcc42c1171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:21.941917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8affb8-4294-499d-96ec-36bcc42c1171 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-2a8affb8-4294-499d-96ec-36bcc42c1171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:21.967153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:21.969315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:21.970871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:21.970871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:21.970871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:21.970871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:21.971744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 406/809] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:21.972662 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8affb8-4294-499d-96ec-36bcc42c1171 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:22.053681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719b97d-8771-4632-b884-e395bdb531f5 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:22.076604 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:22.089424 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8affb8-4294-499d-96ec-36bcc42c1171 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:22.093276 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90d8d8-7ef4-42f1-a79e-916cb70468b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:22.094057 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90d8d8-7ef4-42f1-a79e-916cb70468b9 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:22.094528 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90d8d8-7ef4-42f1-a79e-916cb70468b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:22.095553 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90d8d8-7ef4-42f1-a79e-916cb70468b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:22.096379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90d8d8-7ef4-42f1-a79e-916cb70468b9 None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=b9971f2bf0f2400b90168f6032a0e226) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:22.096694 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90d8d8-7ef4-42f1-a79e-916cb70468b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:22.098556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90d8d8-7ef4-42f1-a79e-916cb70468b9 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:22.106255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 404/810] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:21 2022] GET /identity/v3/role_assignments?user.id=b9971f2bf0f2400b90168f6032a0e226&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=c5632345c9274d348669482f1f7414c8 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:22.107101 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90d8d8-7ef4-42f1-a79e-916cb70468b9 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:22.143611 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4bc87-95cf-4155-a5da-20270a4c1197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:22.144724 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4bc87-95cf-4155-a5da-20270a4c1197 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:22.145024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4bc87-95cf-4155-a5da-20270a4c1197 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:22.145300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4bc87-95cf-4155-a5da-20270a4c1197 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:22.146081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4bc87-95cf-4155-a5da-20270a4c1197 None admin] RBAC: Adding query filter params (name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:22.146398 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4bc87-95cf-4155-a5da-20270a4c1197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:22.147888 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4bc87-95cf-4155-a5da-20270a4c1197 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:22.154239 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:22.167026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 407/811] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:36:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:22.167026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4bc87-95cf-4155-a5da-20270a4c1197 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:22.274246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90d8d8-7ef4-42f1-a79e-916cb70468b9 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:22.309514 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4bc87-95cf-4155-a5da-20270a4c1197 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:22.320342 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec7a81-b9d8-4fb8-aa6b-99ba686a0a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:22.321693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec7a81-b9d8-4fb8-aa6b-99ba686a0a41 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:22.322212 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec7a81-b9d8-4fb8-aa6b-99ba686a0a41 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:22.322790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec7a81-b9d8-4fb8-aa6b-99ba686a0a41 None admin] PATH_INFO: `/v3/services/network` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:22.323743 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec7a81-b9d8-4fb8-aa6b-99ba686a0a41 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:22.325772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec7a81-b9d8-4fb8-aa6b-99ba686a0a41 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-3fec7a81-b9d8-4fb8-aa6b-99ba686a0a41 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:22.340279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:22.341411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:22.342798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:22.342798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:22.342798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:22.342798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:22.342798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:22.342798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:22.342798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:22.342798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:22.342798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:22.342798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:22.342798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:22.342798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:22.342798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:36:22.342798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:22.344136 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 405/812] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:22 2022] GET /identity/v3/services/network => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:22.344823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec7a81-b9d8-4fb8-aa6b-99ba686a0a41 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:22.362019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38a6d4-acca-48a7-b5d5-2602629d66c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:22.363069 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38a6d4-acca-48a7-b5d5-2602629d66c5 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:22.363362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38a6d4-acca-48a7-b5d5-2602629d66c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:22.363819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38a6d4-acca-48a7-b5d5-2602629d66c5 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:22.364433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38a6d4-acca-48a7-b5d5-2602629d66c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:22.364749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38a6d4-acca-48a7-b5d5-2602629d66c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:22.366165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38a6d4-acca-48a7-b5d5-2602629d66c5 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:22.381567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 408/813] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:22.382676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38a6d4-acca-48a7-b5d5-2602629d66c5 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:22.395808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:22.473329 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:22.488052 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec7a81-b9d8-4fb8-aa6b-99ba686a0a41 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:22.521743 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38a6d4-acca-48a7-b5d5-2602629d66c5 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:22.531803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c60052-e177-4e03-8ecf-6c537cd763f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:22.532904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c60052-e177-4e03-8ecf-6c537cd763f1 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:22.533383 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c60052-e177-4e03-8ecf-6c537cd763f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:22.533815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c60052-e177-4e03-8ecf-6c537cd763f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:22.545930 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c60052-e177-4e03-8ecf-6c537cd763f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:22.547667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c60052-e177-4e03-8ecf-6c537cd763f1 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:22.561224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74beb31-c3e9-4169-8339-28451d847793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:22.562001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74beb31-c3e9-4169-8339-28451d847793 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:22.562358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74beb31-c3e9-4169-8339-28451d847793 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:22.562707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74beb31-c3e9-4169-8339-28451d847793 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:22.563524 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74beb31-c3e9-4169-8339-28451d847793 None admin] RBAC: Adding query filter params (name=network) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:22.563907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74beb31-c3e9-4169-8339-28451d847793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:22.565429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74beb31-c3e9-4169-8339-28451d847793 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-54c60052-e177-4e03-8ecf-6c537cd763f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:22.569029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:22.570119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:22.571218 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:22.571218 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:22.571218 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:22.571218 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:22.572713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 409/814] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 2 13:36:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:22.577722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74beb31-c3e9-4169-8339-28451d847793 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:22.584264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 406/815] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:22.584264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c60052-e177-4e03-8ecf-6c537cd763f1 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:22.689845 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:22.716587 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74beb31-c3e9-4169-8339-28451d847793 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:22.718314 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c60052-e177-4e03-8ecf-6c537cd763f1 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:22.760504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49897732-63ac-431e-b6cf-24dcc34de8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:22.761692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49897732-63ac-431e-b6cf-24dcc34de8e7 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:22.761992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cc9f7-43e3-4a46-8271-90f0fc81e4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:22.762305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49897732-63ac-431e-b6cf-24dcc34de8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:22.762730 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49897732-63ac-431e-b6cf-24dcc34de8e7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:22.762964 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cc9f7-43e3-4a46-8271-90f0fc81e4bb None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:22.763347 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cc9f7-43e3-4a46-8271-90f0fc81e4bb None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:22.764301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cc9f7-43e3-4a46-8271-90f0fc81e4bb None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:22.765235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cc9f7-43e3-4a46-8271-90f0fc81e4bb None admin] RBAC: Adding query filter params (type=network) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:22.765662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cc9f7-43e3-4a46-8271-90f0fc81e4bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:22.767173 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cc9f7-43e3-4a46-8271-90f0fc81e4bb None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:22.773791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49897732-63ac-431e-b6cf-24dcc34de8e7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:22.775642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49897732-63ac-431e-b6cf-24dcc34de8e7 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:22.777993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 407/816] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 2 13:36:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:22.779050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cc9f7-43e3-4a46-8271-90f0fc81e4bb None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:22.789665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-49897732-63ac-431e-b6cf-24dcc34de8e7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:22.798445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:22.805144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:22.806432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:22.806432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:22.806432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:22.806432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:22.806432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:22.806432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:22.806432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:22.806432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:22.806432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:36:22.806432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:22.806432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 410/817] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:22.806432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49897732-63ac-431e-b6cf-24dcc34de8e7 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:22.917338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cc9f7-43e3-4a46-8271-90f0fc81e4bb None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:22.944542 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49897732-63ac-431e-b6cf-24dcc34de8e7 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:22.957546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddae18e-9211-496f-90dd-bc79a543dc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:22.958575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddae18e-9211-496f-90dd-bc79a543dc7c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:22.959064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddae18e-9211-496f-90dd-bc79a543dc7c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:22.959575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddae18e-9211-496f-90dd-bc79a543dc7c None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:22.960584 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddae18e-9211-496f-90dd-bc79a543dc7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:22.961120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddae18e-9211-496f-90dd-bc79a543dc7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:22.962724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddae18e-9211-496f-90dd-bc79a543dc7c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:22.980359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 408/818] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:22.981607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddae18e-9211-496f-90dd-bc79a543dc7c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:22.988730 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abeb5f-977f-45cf-8b79-8ff803cebf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:22.989407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abeb5f-977f-45cf-8b79-8ff803cebf8c None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:22.989689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abeb5f-977f-45cf-8b79-8ff803cebf8c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:22.989966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abeb5f-977f-45cf-8b79-8ff803cebf8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:22.990714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abeb5f-977f-45cf-8b79-8ff803cebf8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:22.992708 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abeb5f-977f-45cf-8b79-8ff803cebf8c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:22.998063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:23.061940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:23.098540 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddae18e-9211-496f-90dd-bc79a543dc7c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:23.120546 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 411/819] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 2 13:36:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:23.121073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abeb5f-977f-45cf-8b79-8ff803cebf8c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:23.176781 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb776ba4-c4d4-4602-8178-e65fdf1761cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:23.177569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb776ba4-c4d4-4602-8178-e65fdf1761cb None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:23.177856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb776ba4-c4d4-4602-8178-e65fdf1761cb None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:23.178283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb776ba4-c4d4-4602-8178-e65fdf1761cb None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:23.179149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb776ba4-c4d4-4602-8178-e65fdf1761cb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:23.179502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb776ba4-c4d4-4602-8178-e65fdf1761cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:23.182134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb776ba4-c4d4-4602-8178-e65fdf1761cb None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:23.226665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 409/820] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 2 13:36:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:23.244966 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb776ba4-c4d4-4602-8178-e65fdf1761cb None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:23.303002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abeb5f-977f-45cf-8b79-8ff803cebf8c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:23.348818 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea0924-cabd-482f-9d99-fa14daf3a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:23.349663 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea0924-cabd-482f-9d99-fa14daf3a617 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:23.349950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea0924-cabd-482f-9d99-fa14daf3a617 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:23.350225 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea0924-cabd-482f-9d99-fa14daf3a617 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:23.371991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea0924-cabd-482f-9d99-fa14daf3a617 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:23.374093 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea0924-cabd-482f-9d99-fa14daf3a617 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-0eea0924-cabd-482f-9d99-fa14daf3a617 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:23.405018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:23.406115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:23.407706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:23.407706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:23.407706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:23.407706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:23.407706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:23.407706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:23.407706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:23.407706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:23.407706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:36:23.407706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:23.407706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 412/821] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 2 13:36:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:23.411867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea0924-cabd-482f-9d99-fa14daf3a617 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:23.482748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb776ba4-c4d4-4602-8178-e65fdf1761cb None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:23.499895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:23.524528 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:23.543983 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ed9c1-23b7-4291-8aea-5a4f6d3ed33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:23.544940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ed9c1-23b7-4291-8aea-5a4f6d3ed33c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:23.545215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ed9c1-23b7-4291-8aea-5a4f6d3ed33c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:23.545491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ed9c1-23b7-4291-8aea-5a4f6d3ed33c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:23.559750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ed9c1-23b7-4291-8aea-5a4f6d3ed33c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:23.561797 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ed9c1-23b7-4291-8aea-5a4f6d3ed33c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:23.566383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea0924-cabd-482f-9d99-fa14daf3a617 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-983ed9c1-23b7-4291-8aea-5a4f6d3ed33c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:23.583338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:23.598271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:23.599156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:23.599156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:23.599156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:23.599156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:23.599156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 410/822] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:23.599156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ed9c1-23b7-4291-8aea-5a4f6d3ed33c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:23.622002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c027098-0e2d-4c3b-87fb-2b4141654094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:23.623038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c027098-0e2d-4c3b-87fb-2b4141654094 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:23.623927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c027098-0e2d-4c3b-87fb-2b4141654094 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:23.624202 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c027098-0e2d-4c3b-87fb-2b4141654094 None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:23.625059 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c027098-0e2d-4c3b-87fb-2b4141654094 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:23.625367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c027098-0e2d-4c3b-87fb-2b4141654094 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:23.628278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c027098-0e2d-4c3b-87fb-2b4141654094 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:23.672941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 413/823] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 2 13:36:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:23.677757 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e904aa-c546-484f-8721-ff42af6700f6 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:23.677757 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e904aa-c546-484f-8721-ff42af6700f6 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:23.677997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e904aa-c546-484f-8721-ff42af6700f6 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:23.679559 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 414/824] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:23.680311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e904aa-c546-484f-8721-ff42af6700f6 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:23.739876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ed9c1-23b7-4291-8aea-5a4f6d3ed33c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:23.782042 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933748b-4bc1-4016-b05e-754f96389f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:23.782723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933748b-4bc1-4016-b05e-754f96389f28 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:23.783009 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933748b-4bc1-4016-b05e-754f96389f28 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:23.783281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933748b-4bc1-4016-b05e-754f96389f28 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:23.784426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933748b-4bc1-4016-b05e-754f96389f28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:23.784740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933748b-4bc1-4016-b05e-754f96389f28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:23.786453 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933748b-4bc1-4016-b05e-754f96389f28 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:23.803287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 411/825] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:23.803287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979dbec-c23d-4a7b-960b-c5d0cef10bd6 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:23.803287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979dbec-c23d-4a7b-960b-c5d0cef10bd6 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:23.803287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979dbec-c23d-4a7b-960b-c5d0cef10bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:23.818651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-d979dbec-c23d-4a7b-960b-c5d0cef10bd6 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:23.820001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d979dbec-c23d-4a7b-960b-c5d0cef10bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:23.820112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e904aa-c546-484f-8721-ff42af6700f6 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:23.833037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:23.849038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:23.859551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a61f92-d824-402e-9a50-dfdeb6c0507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:23.860415 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a61f92-d824-402e-9a50-dfdeb6c0507c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:23.860707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a61f92-d824-402e-9a50-dfdeb6c0507c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:23.860985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a61f92-d824-402e-9a50-dfdeb6c0507c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:23.871938 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a61f92-d824-402e-9a50-dfdeb6c0507c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:23.873928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a61f92-d824-402e-9a50-dfdeb6c0507c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-82a61f92-d824-402e-9a50-dfdeb6c0507c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:23.893716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:23.894831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:23.895788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:23.895788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:23.895788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:23.895788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:23.895788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 415/826] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:23.895788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a61f92-d824-402e-9a50-dfdeb6c0507c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:23.909304 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 412/827] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:23.910514 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979dbec-c23d-4a7b-960b-c5d0cef10bd6 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.024480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a61f92-d824-402e-9a50-dfdeb6c0507c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.026032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979dbec-c23d-4a7b-960b-c5d0cef10bd6 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.064028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac74d3-b889-49df-8553-25b4e60b9df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.064572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38756c5-0ce4-445d-b5a8-87cee590f5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.065240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38756c5-0ce4-445d-b5a8-87cee590f5c4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.065522 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38756c5-0ce4-445d-b5a8-87cee590f5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.065772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac74d3-b889-49df-8553-25b4e60b9df5 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.065885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38756c5-0ce4-445d-b5a8-87cee590f5c4 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.066320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac74d3-b889-49df-8553-25b4e60b9df5 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.066518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38756c5-0ce4-445d-b5a8-87cee590f5c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:24.066824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38756c5-0ce4-445d-b5a8-87cee590f5c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.067110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac74d3-b889-49df-8553-25b4e60b9df5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.068235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38756c5-0ce4-445d-b5a8-87cee590f5c4 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.075219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac74d3-b889-49df-8553-25b4e60b9df5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.077284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac74d3-b889-49df-8553-25b4e60b9df5 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.080672 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 413/828] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:24.081732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38756c5-0ce4-445d-b5a8-87cee590f5c4 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-b3ac74d3-b889-49df-8553-25b4e60b9df5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:24.094012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:24.095101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:24.096115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:24.096115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:24.096115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:24.096115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:24.096115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:24.096115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:24.096115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:24.096115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:24.100132 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 416/829] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:24.101046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac74d3-b889-49df-8553-25b4e60b9df5 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.113645 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:24.128662 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:24.195708 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38756c5-0ce4-445d-b5a8-87cee590f5c4 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.214391 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac74d3-b889-49df-8553-25b4e60b9df5 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.241732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da18ad-1237-4129-8561-10af29bded9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.242756 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da18ad-1237-4129-8561-10af29bded9a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.243206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da18ad-1237-4129-8561-10af29bded9a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.243705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da18ad-1237-4129-8561-10af29bded9a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.244376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da18ad-1237-4129-8561-10af29bded9a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.246314 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da18ad-1237-4129-8561-10af29bded9a None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.253643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be644a29-0bf3-4a32-aa78-57d105a67be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.254440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be644a29-0bf3-4a32-aa78-57d105a67be4 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.254771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be644a29-0bf3-4a32-aa78-57d105a67be4 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.255046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be644a29-0bf3-4a32-aa78-57d105a67be4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-b3da18ad-1237-4129-8561-10af29bded9a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:24.264449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:24.265586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:24.266496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 414/830] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:36:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:24.267327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da18ad-1237-4129-8561-10af29bded9a None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.272975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be644a29-0bf3-4a32-aa78-57d105a67be4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.274981 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be644a29-0bf3-4a32-aa78-57d105a67be4 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-be644a29-0bf3-4a32-aa78-57d105a67be4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:24.291494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:24.292494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:24.293393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:24.293393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:24.293393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:24.293393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:24.293393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:24.293393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:24.293393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:24.293393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:24.298422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 417/831] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:24.299417 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be644a29-0bf3-4a32-aa78-57d105a67be4 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.368629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:24.383228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da18ad-1237-4129-8561-10af29bded9a None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.390412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:24.411402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be644a29-0bf3-4a32-aa78-57d105a67be4 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.417515 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d85930-a285-408b-bef4-afa2b33dd0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.418175 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d85930-a285-408b-bef4-afa2b33dd0fa None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.418456 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d85930-a285-408b-bef4-afa2b33dd0fa None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.418735 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d85930-a285-408b-bef4-afa2b33dd0fa None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.422530 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d85930-a285-408b-bef4-afa2b33dd0fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:24.422530 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d85930-a285-408b-bef4-afa2b33dd0fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.422530 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d85930-a285-408b-bef4-afa2b33dd0fa None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.438499 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 415/832] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:24.439767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d85930-a285-408b-bef4-afa2b33dd0fa None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.462092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827552c-9fcc-454c-a75d-236ab3e76955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.462749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827552c-9fcc-454c-a75d-236ab3e76955 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.463033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827552c-9fcc-454c-a75d-236ab3e76955 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.463307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827552c-9fcc-454c-a75d-236ab3e76955 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.464060 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827552c-9fcc-454c-a75d-236ab3e76955 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:24.464356 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827552c-9fcc-454c-a75d-236ab3e76955 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.465735 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827552c-9fcc-454c-a75d-236ab3e76955 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.471682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 418/833] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:36:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:24.472503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827552c-9fcc-454c-a75d-236ab3e76955 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.548411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d85930-a285-408b-bef4-afa2b33dd0fa None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.585066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4e37b-f33c-46d2-a23e-0afbd91e0129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.585742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4e37b-f33c-46d2-a23e-0afbd91e0129 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.586025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4e37b-f33c-46d2-a23e-0afbd91e0129 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.586299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4e37b-f33c-46d2-a23e-0afbd91e0129 None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.587095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4e37b-f33c-46d2-a23e-0afbd91e0129 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:24.587402 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4e37b-f33c-46d2-a23e-0afbd91e0129 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.588568 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827552c-9fcc-454c-a75d-236ab3e76955 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.589017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4e37b-f33c-46d2-a23e-0afbd91e0129 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.603439 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 416/834] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:24.604798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4e37b-f33c-46d2-a23e-0afbd91e0129 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.621287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:24.636846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32904639-4d6b-4445-9a76-f8c779a7d4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.637738 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32904639-4d6b-4445-9a76-f8c779a7d4ae None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.655163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32904639-4d6b-4445-9a76-f8c779a7d4ae None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.655163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32904639-4d6b-4445-9a76-f8c779a7d4ae None admin] PATH_INFO: `/v3/projects/8deff8fec8614da6997a32993c033fd8/users/00f3424dc2ee4f828638b3a8f5c9fc5d/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.655163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32904639-4d6b-4445-9a76-f8c779a7d4ae None admin] RBAC: Authorizing `identity:create_grant(project_id=8deff8fec8614da6997a32993c033fd8, user_id=00f3424dc2ee4f828638b3a8f5c9fc5d, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.655163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32904639-4d6b-4445-9a76-f8c779a7d4ae None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.735665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4e37b-f33c-46d2-a23e-0afbd91e0129 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.762278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 419/835] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:36:24 2022] PUT /identity/v3/projects/8deff8fec8614da6997a32993c033fd8/users/00f3424dc2ee4f828638b3a8f5c9fc5d/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:24.768571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32904639-4d6b-4445-9a76-f8c779a7d4ae None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.768571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:24.785605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabfd29-f73c-4f78-a3b8-b30b153ba442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.786504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabfd29-f73c-4f78-a3b8-b30b153ba442 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.787174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabfd29-f73c-4f78-a3b8-b30b153ba442 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.787488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabfd29-f73c-4f78-a3b8-b30b153ba442 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.788233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabfd29-f73c-4f78-a3b8-b30b153ba442 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:24.788544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabfd29-f73c-4f78-a3b8-b30b153ba442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.790645 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabfd29-f73c-4f78-a3b8-b30b153ba442 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.807745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 417/836] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:36:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:24.807745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25305a4c-a95d-4ffd-a925-d82049827561 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.807745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25305a4c-a95d-4ffd-a925-d82049827561 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.807745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25305a4c-a95d-4ffd-a925-d82049827561 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.807745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 418/837] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:24.809517 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be63a5-f41d-40e7-a0ac-7e1f162c371a None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.809815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be63a5-f41d-40e7-a0ac-7e1f162c371a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.810100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be63a5-f41d-40e7-a0ac-7e1f162c371a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.836109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-20be63a5-f41d-40e7-a0ac-7e1f162c371a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:24.838601 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-20be63a5-f41d-40e7-a0ac-7e1f162c371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:24.906592 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32904639-4d6b-4445-9a76-f8c779a7d4ae None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.949442 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555dc6f-a845-4115-850e-11fcc7a1f0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.950371 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555dc6f-a845-4115-850e-11fcc7a1f0c2 None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.950674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555dc6f-a845-4115-850e-11fcc7a1f0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.950935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555dc6f-a845-4115-850e-11fcc7a1f0c2 None admin] PATH_INFO: `/v3/projects/8deff8fec8614da6997a32993c033fd8/users/70f0634c146244a1a0e91f89493cc076/roles/a9712a3506694519b4e4945b54539d79` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.952676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:24.959505 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 419/838] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:24.980303 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555dc6f-a845-4115-850e-11fcc7a1f0c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8deff8fec8614da6997a32993c033fd8, user_id=70f0634c146244a1a0e91f89493cc076, role_id=a9712a3506694519b4e4945b54539d79)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.981943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555dc6f-a845-4115-850e-11fcc7a1f0c2 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.984854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be63a5-f41d-40e7-a0ac-7e1f162c371a None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:25.084693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 420/839] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:36:24 2022] PUT /identity/v3/projects/8deff8fec8614da6997a32993c033fd8/users/70f0634c146244a1a0e91f89493cc076/roles/a9712a3506694519b4e4945b54539d79 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:25.109175 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be63a5-f41d-40e7-a0ac-7e1f162c371a None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:25.154205 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4248-c98f-4027-8e0b-291e3892b4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:25.155128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4248-c98f-4027-8e0b-291e3892b4be None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:25.155407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4248-c98f-4027-8e0b-291e3892b4be None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:25.155741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4248-c98f-4027-8e0b-291e3892b4be None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:25.156624 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d4248-c98f-4027-8e0b-291e3892b4be None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:25.158440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d4248-c98f-4027-8e0b-291e3892b4be None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-f16d4248-c98f-4027-8e0b-291e3892b4be None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:25.172504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:25.173524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:25.174357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 420/840] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jun 2 13:36:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:25.180338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555dc6f-a845-4115-850e-11fcc7a1f0c2 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:25.250342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:25.306340 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555dc6f-a845-4115-850e-11fcc7a1f0c2 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:25.351206 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f9aa8-94f0-40f5-8443-cb09defc8620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:25.351893 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9aa8-94f0-40f5-8443-cb09defc8620 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:25.352174 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9aa8-94f0-40f5-8443-cb09defc8620 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:25.352450 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9aa8-94f0-40f5-8443-cb09defc8620 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:25.353177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f9aa8-94f0-40f5-8443-cb09defc8620 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:25.353533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f9aa8-94f0-40f5-8443-cb09defc8620 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:25.354997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f9aa8-94f0-40f5-8443-cb09defc8620 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:25.360780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 421/841] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 2 13:36:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:25.366795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4248-c98f-4027-8e0b-291e3892b4be None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:25.432350 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:25.472928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4248-c98f-4027-8e0b-291e3892b4be None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:25.508647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b3dc3-c28b-41e0-a059-16651aa28447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:25.509316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b3dc3-c28b-41e0-a059-16651aa28447 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:25.509599 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b3dc3-c28b-41e0-a059-16651aa28447 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:25.509875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b3dc3-c28b-41e0-a059-16651aa28447 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:25.510580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b3dc3-c28b-41e0-a059-16651aa28447 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:25.510885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b3dc3-c28b-41e0-a059-16651aa28447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:25.512284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b3dc3-c28b-41e0-a059-16651aa28447 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:25.517294 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 421/842] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 2 13:36:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:27.202457 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304f74-5547-428e-bb91-4779d4cb5f5d None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.202985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304f74-5547-428e-bb91-4779d4cb5f5d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.202985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304f74-5547-428e-bb91-4779d4cb5f5d None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.204721 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 422/843] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:27.205174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795665d-d8c4-4a77-b2b3-936c6dac8960 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.206059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795665d-d8c4-4a77-b2b3-936c6dac8960 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.206533 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795665d-d8c4-4a77-b2b3-936c6dac8960 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.208430 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 422/844] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:27.210295 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a9b03-552e-4e07-8638-40ea3f790085 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.210581 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a9b03-552e-4e07-8638-40ea3f790085 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.210861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a9b03-552e-4e07-8638-40ea3f790085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.214897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd096b11-d22f-4d33-a50d-d01a519f9ae9 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.215479 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd096b11-d22f-4d33-a50d-d01a519f9ae9 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.215956 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd096b11-d22f-4d33-a50d-d01a519f9ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.232424 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-be3a9b03-552e-4e07-8638-40ea3f790085 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:27.234261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-be3a9b03-552e-4e07-8638-40ea3f790085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:27.236972 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-cd096b11-d22f-4d33-a50d-d01a519f9ae9 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:27.238537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-cd096b11-d22f-4d33-a50d-d01a519f9ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:27.317645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 423/845] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:27.337038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 423/846] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:27.341388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a9b03-552e-4e07-8638-40ea3f790085 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:27.366494 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd096b11-d22f-4d33-a50d-d01a519f9ae9 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:27.402237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:27.443500 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:27.461723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a9b03-552e-4e07-8638-40ea3f790085 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:27.502695 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd096b11-d22f-4d33-a50d-d01a519f9ae9 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:27.508229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d153f-a714-4ca6-b046-d689c587e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:27.509321 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d153f-a714-4ca6-b046-d689c587e2b6 None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.509822 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d153f-a714-4ca6-b046-d689c587e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.510309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d153f-a714-4ca6-b046-d689c587e2b6 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.511963 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d153f-a714-4ca6-b046-d689c587e2b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:27.514529 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d153f-a714-4ca6-b046-d689c587e2b6 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:27.540177 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf26fc-bda0-4883-8206-ce900f8a896f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:27.541001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf26fc-bda0-4883-8206-ce900f8a896f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.541290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf26fc-bda0-4883-8206-ce900f8a896f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.541559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf26fc-bda0-4883-8206-ce900f8a896f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.552734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf26fc-bda0-4883-8206-ce900f8a896f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-4cdf26fc-bda0-4883-8206-ce900f8a896f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:27.560555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:27.562236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:27.563072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:27.563072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:27.563072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:27.563072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:27.563072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:27.563072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:27.563072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:27.563072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:27.563072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:27.563072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:27.563072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:27.563072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:27.563072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 424/847] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:27.563816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fb95b-3924-450c-9bb0-51c0d7e580bd None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.563888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fb95b-3924-450c-9bb0-51c0d7e580bd None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.564379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fb95b-3924-450c-9bb0-51c0d7e580bd None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.565642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 425/848] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:27.571153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecdcaa-8b4a-4242-8ff9-dcca636ee568 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.571443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecdcaa-8b4a-4242-8ff9-dcca636ee568 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.571747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecdcaa-8b4a-4242-8ff9-dcca636ee568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.589576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-70ecdcaa-8b4a-4242-8ff9-dcca636ee568 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:27.590776 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-70ecdcaa-8b4a-4242-8ff9-dcca636ee568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:27.603399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 424/849] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 2 13:36:27 2022] POST /identity/v3/services => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:27.603399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d153f-a714-4ca6-b046-d689c587e2b6 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:27.724164 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 426/850] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:27.749695 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecdcaa-8b4a-4242-8ff9-dcca636ee568 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:27.750373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d153f-a714-4ca6-b046-d689c587e2b6 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:27.763080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:27.793472 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af73fa-b4fb-42b4-8aa5-e00008939c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:27.794515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af73fa-b4fb-42b4-8aa5-e00008939c11 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.794990 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af73fa-b4fb-42b4-8aa5-e00008939c11 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.796028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af73fa-b4fb-42b4-8aa5-e00008939c11 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.796992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af73fa-b4fb-42b4-8aa5-e00008939c11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:27.797490 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af73fa-b4fb-42b4-8aa5-e00008939c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:27.799287 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af73fa-b4fb-42b4-8aa5-e00008939c11 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:27.811568 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 425/851] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:36:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:27.812514 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:27.818817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af73fa-b4fb-42b4-8aa5-e00008939c11 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:27.874576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecdcaa-8b4a-4242-8ff9-dcca636ee568 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:27.915111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a182a-911e-4541-a084-16087e060692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:27.915952 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a182a-911e-4541-a084-16087e060692 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.916241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a182a-911e-4541-a084-16087e060692 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.916515 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a182a-911e-4541-a084-16087e060692 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.932385 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a182a-911e-4541-a084-16087e060692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-b92a182a-911e-4541-a084-16087e060692 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:27.948403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:27.949444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:27.950299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:27.950299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:27.950299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:27.950299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:27.950299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:27.950299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:27.950299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:27.950299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:27.950299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:27.950299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:27.950299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:27.950299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:27.950945 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af73fa-b4fb-42b4-8aa5-e00008939c11 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:27.951022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 427/852] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:36:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:27.954039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b094b-11db-49fb-b74c-d1452d405757 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.954556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b094b-11db-49fb-b74c-d1452d405757 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.955061 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b094b-11db-49fb-b74c-d1452d405757 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.957463 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 428/853] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:27.958914 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b094b-11db-49fb-b74c-d1452d405757 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:27.998867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c3dc7-ae40-40d5-b409-d0665f0a7702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.000143 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c3dc7-ae40-40d5-b409-d0665f0a7702 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.000469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c3dc7-ae40-40d5-b409-d0665f0a7702 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.000840 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c3dc7-ae40-40d5-b409-d0665f0a7702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.012832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c3dc7-ae40-40d5-b409-d0665f0a7702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.014873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c3dc7-ae40-40d5-b409-d0665f0a7702 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-7c5c3dc7-ae40-40d5-b409-d0665f0a7702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:28.037140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:28.038153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:28.039049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:28.039049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:28.039049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:28.039049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:28.039049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 426/854] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:28.039905 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36377-2a9c-48bf-b37b-59164a0f1317 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.040008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36377-2a9c-48bf-b37b-59164a0f1317 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.040622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36377-2a9c-48bf-b37b-59164a0f1317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.058103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-4ed36377-2a9c-48bf-b37b-59164a0f1317 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:28.059302 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4ed36377-2a9c-48bf-b37b-59164a0f1317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:28.085528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:28.114854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b094b-11db-49fb-b74c-d1452d405757 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.117767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:28.157262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 427/855] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:28 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:28.158426 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed36377-2a9c-48bf-b37b-59164a0f1317 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.176440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b86be-c21d-4894-ab8f-f0d762fec04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.177729 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b86be-c21d-4894-ab8f-f0d762fec04f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.178007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b86be-c21d-4894-ab8f-f0d762fec04f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.178285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b86be-c21d-4894-ab8f-f0d762fec04f None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.179105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b86be-c21d-4894-ab8f-f0d762fec04f None admin] RBAC: Adding query filter params (name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:28.179480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b86be-c21d-4894-ab8f-f0d762fec04f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.181633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b86be-c21d-4894-ab8f-f0d762fec04f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.193907 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 429/856] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:36:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:28.196466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b86be-c21d-4894-ab8f-f0d762fec04f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.300440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed36377-2a9c-48bf-b37b-59164a0f1317 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.332127 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b86be-c21d-4894-ab8f-f0d762fec04f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.345333 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad56d7-8add-46be-bc46-0301675e4411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.346006 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad56d7-8add-46be-bc46-0301675e4411 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.346289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad56d7-8add-46be-bc46-0301675e4411 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.346622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad56d7-8add-46be-bc46-0301675e4411 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.347357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad56d7-8add-46be-bc46-0301675e4411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:28.347817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad56d7-8add-46be-bc46-0301675e4411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.349099 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad56d7-8add-46be-bc46-0301675e4411 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.361401 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 428/857] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:28.362257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad56d7-8add-46be-bc46-0301675e4411 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.379629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:28.388238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cec5f-8c83-4402-878c-ff92260e2774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.390257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cec5f-8c83-4402-878c-ff92260e2774 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.391002 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cec5f-8c83-4402-878c-ff92260e2774 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.391822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cec5f-8c83-4402-878c-ff92260e2774 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.393383 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cec5f-8c83-4402-878c-ff92260e2774 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.395961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cec5f-8c83-4402-878c-ff92260e2774 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.470682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad56d7-8add-46be-bc46-0301675e4411 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.506127 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fe841-80c9-4b03-9791-d52aa9631c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.506932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe841-80c9-4b03-9791-d52aa9631c28 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.507267 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe841-80c9-4b03-9791-d52aa9631c28 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.507517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe841-80c9-4b03-9791-d52aa9631c28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.521158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fe841-80c9-4b03-9791-d52aa9631c28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.522747 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fe841-80c9-4b03-9791-d52aa9631c28 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.529767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 430/858] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 2 13:36:28 2022] POST /identity/v3/services => generated 269 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:28.530821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cec5f-8c83-4402-878c-ff92260e2774 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-574fe841-80c9-4b03-9791-d52aa9631c28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:28.556441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:28.557623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:28.558746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:28.558746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:28.558746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:28.558746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:28.561760 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 429/859] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:28.567844 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fe841-80c9-4b03-9791-d52aa9631c28 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.571389 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:28.665409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:28.699191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cec5f-8c83-4402-878c-ff92260e2774 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.736376 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fe841-80c9-4b03-9791-d52aa9631c28 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.742837 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90b165-d10b-4887-9c6a-7a575bcf68e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.743696 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b165-d10b-4887-9c6a-7a575bcf68e4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.743986 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b165-d10b-4887-9c6a-7a575bcf68e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.744374 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b165-d10b-4887-9c6a-7a575bcf68e4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.753047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90b165-d10b-4887-9c6a-7a575bcf68e4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.754479 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90b165-d10b-4887-9c6a-7a575bcf68e4 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-5b90b165-d10b-4887-9c6a-7a575bcf68e4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:28.772215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:28.773193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:28.774855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:28.774855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:28.774855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:28.774855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:28.774855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:28.774855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:28.774855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:28.774855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:28.774855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:36:28.774855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:28.774855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 431/860] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:28.778082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabefc6-9ace-48c0-b0c2-fe497e1d5b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.778754 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabefc6-9ace-48c0-b0c2-fe497e1d5b53 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.778912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90b165-d10b-4887-9c6a-7a575bcf68e4 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.779077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabefc6-9ace-48c0-b0c2-fe497e1d5b53 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.779310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabefc6-9ace-48c0-b0c2-fe497e1d5b53 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.781409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabefc6-9ace-48c0-b0c2-fe497e1d5b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:28.781409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabefc6-9ace-48c0-b0c2-fe497e1d5b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.782375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabefc6-9ace-48c0-b0c2-fe497e1d5b53 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.801339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 430/861] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:28.808931 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabefc6-9ace-48c0-b0c2-fe497e1d5b53 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.887108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:28.918717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90b165-d10b-4887-9c6a-7a575bcf68e4 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.945304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabefc6-9ace-48c0-b0c2-fe497e1d5b53 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.963207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6651608-18f6-4176-a89f-67275faa4713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.963929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6651608-18f6-4176-a89f-67275faa4713 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.964209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6651608-18f6-4176-a89f-67275faa4713 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.964480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6651608-18f6-4176-a89f-67275faa4713 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.965440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6651608-18f6-4176-a89f-67275faa4713 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:28.965630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6651608-18f6-4176-a89f-67275faa4713 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.967175 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6651608-18f6-4176-a89f-67275faa4713 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.977320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:28.987114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 432/862] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:28.990210 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be46dfe-9abe-41e8-8538-6a3f16f38719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.991334 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be46dfe-9abe-41e8-8538-6a3f16f38719 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.991775 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be46dfe-9abe-41e8-8538-6a3f16f38719 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.995070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be46dfe-9abe-41e8-8538-6a3f16f38719 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.995205 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6651608-18f6-4176-a89f-67275faa4713 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:29.002061 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be46dfe-9abe-41e8-8538-6a3f16f38719 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:29.003809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be46dfe-9abe-41e8-8538-6a3f16f38719 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-8be46dfe-9abe-41e8-8538-6a3f16f38719 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:29.020782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:29.022019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:29.023243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:29.023243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:29.023243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:29.023243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:29.023243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:29.023243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:29.023243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:29.023243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:29.023243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:36:29.023243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:29.026427 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 431/863] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:29.033640 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be46dfe-9abe-41e8-8538-6a3f16f38719 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:29.133708 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6651608-18f6-4176-a89f-67275faa4713 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:29.177509 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be46dfe-9abe-41e8-8538-6a3f16f38719 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:29.181488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2e718-c13e-4f2d-b7b7-0572b1970af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:29.182479 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2e718-c13e-4f2d-b7b7-0572b1970af1 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:29.183013 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2e718-c13e-4f2d-b7b7-0572b1970af1 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:29.183570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2e718-c13e-4f2d-b7b7-0572b1970af1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:29.198998 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:29.223773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d8434-6440-4e0f-8a7c-10b25bc04a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:29.224474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d8434-6440-4e0f-8a7c-10b25bc04a82 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:29.224767 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d8434-6440-4e0f-8a7c-10b25bc04a82 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:29.225045 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d8434-6440-4e0f-8a7c-10b25bc04a82 None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:29.226107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d8434-6440-4e0f-8a7c-10b25bc04a82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:29.226421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d8434-6440-4e0f-8a7c-10b25bc04a82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:29.228703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d8434-6440-4e0f-8a7c-10b25bc04a82 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.263000 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 432/864] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 2 13:36:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:29.265460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d8434-6440-4e0f-8a7c-10b25bc04a82 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:29.302015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2e718-c13e-4f2d-b7b7-0572b1970af1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:29.304584 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2e718-c13e-4f2d-b7b7-0572b1970af1 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.374521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:29.481959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d8434-6440-4e0f-8a7c-10b25bc04a82 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:29.525571 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 433/865] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:36:29.527418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2e718-c13e-4f2d-b7b7-0572b1970af1 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:29.544352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc66660-c45f-4eb5-8bb6-d9c866609351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:29.545067 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66660-c45f-4eb5-8bb6-d9c866609351 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:29.545367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66660-c45f-4eb5-8bb6-d9c866609351 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:29.545651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66660-c45f-4eb5-8bb6-d9c866609351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:29.590212 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:29.630498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc66660-c45f-4eb5-8bb6-d9c866609351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:29.632353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc66660-c45f-4eb5-8bb6-d9c866609351 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.670597 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2e718-c13e-4f2d-b7b7-0572b1970af1 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:29.698901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:29.714263 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6d97c-983e-428d-8a50-f64dd8127e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:29.714981 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6d97c-983e-428d-8a50-f64dd8127e85 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:29.715380 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6d97c-983e-428d-8a50-f64dd8127e85 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:29.715806 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6d97c-983e-428d-8a50-f64dd8127e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:29.727122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6d97c-983e-428d-8a50-f64dd8127e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:29.728799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6d97c-983e-428d-8a50-f64dd8127e85 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-11a6d97c-983e-428d-8a50-f64dd8127e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:29.749923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:29.751123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:29.752307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:29.752307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:29.752307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:29.752307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:29.758376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 434/866] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:29.760301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6d97c-983e-428d-8a50-f64dd8127e85 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:29.791615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 433/867] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:29 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:36:29.793948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc66660-c45f-4eb5-8bb6-d9c866609351 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:29.878683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:29.888583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6d97c-983e-428d-8a50-f64dd8127e85 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:29.927826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfe6f4-4998-415b-9a99-8a32d6363f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:29.928473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe6f4-4998-415b-9a99-8a32d6363f5b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:29.928755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe6f4-4998-415b-9a99-8a32d6363f5b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:29.929026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe6f4-4998-415b-9a99-8a32d6363f5b None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:29.929774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfe6f4-4998-415b-9a99-8a32d6363f5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:29.930081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfe6f4-4998-415b-9a99-8a32d6363f5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:29.931524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfe6f4-4998-415b-9a99-8a32d6363f5b None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.935899 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc66660-c45f-4eb5-8bb6-d9c866609351 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:29.949201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 435/868] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:29.950478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfe6f4-4998-415b-9a99-8a32d6363f5b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:29.989363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c22bdf-85ca-4d0c-aa35-8e7ebd03ffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:29.991657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22bdf-85ca-4d0c-aa35-8e7ebd03ffc4 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:29.992153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22bdf-85ca-4d0c-aa35-8e7ebd03ffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:29.992593 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22bdf-85ca-4d0c-aa35-8e7ebd03ffc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:30.006218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c22bdf-85ca-4d0c-aa35-8e7ebd03ffc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:30.007973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c22bdf-85ca-4d0c-aa35-8e7ebd03ffc4 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:30.009962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-58c22bdf-85ca-4d0c-aa35-8e7ebd03ffc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:30.028199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:30.029173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:30.030697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:30.030697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:30.030697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:30.030697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:30.030697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 434/869] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:30.031931 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f77c-c365-4745-8e71-8c3c2354e051 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:30.031931 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f77c-c365-4745-8e71-8c3c2354e051 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:30.031931 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f77c-c365-4745-8e71-8c3c2354e051 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:30.035875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 435/870] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:30.037159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64f77c-c365-4745-8e71-8c3c2354e051 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:30.079000 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfe6f4-4998-415b-9a99-8a32d6363f5b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:30.116761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9d9c7-7476-4de1-bb62-6f91d7da4957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:30.117726 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9d9c7-7476-4de1-bb62-6f91d7da4957 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:30.118014 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9d9c7-7476-4de1-bb62-6f91d7da4957 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:30.118757 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9d9c7-7476-4de1-bb62-6f91d7da4957 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:30.125989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9d9c7-7476-4de1-bb62-6f91d7da4957 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:30.127471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9d9c7-7476-4de1-bb62-6f91d7da4957 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-6ca9d9c7-7476-4de1-bb62-6f91d7da4957 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:30.143357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:30.144485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:30.145578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:30.145578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:30.145578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:30.145578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:30.145578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:30.145578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:30.145578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:30.145578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:30.145578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 436/871] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:30.150847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8c2b8-1d09-470f-b12a-ed72516778a0 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:30.151137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8c2b8-1d09-470f-b12a-ed72516778a0 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:30.151413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8c2b8-1d09-470f-b12a-ed72516778a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:30.160209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64f77c-c365-4745-8e71-8c3c2354e051 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:30.169866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f8f8c2b8-1d09-470f-b12a-ed72516778a0 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:30.171112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f8f8c2b8-1d09-470f-b12a-ed72516778a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:30.180481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:30.199906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11703b3-e6d1-42bd-ab88-d906ba9a5133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:30.200569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11703b3-e6d1-42bd-ab88-d906ba9a5133 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:30.200893 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11703b3-e6d1-42bd-ab88-d906ba9a5133 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:30.201169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11703b3-e6d1-42bd-ab88-d906ba9a5133 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:30.202593 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11703b3-e6d1-42bd-ab88-d906ba9a5133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:30.202946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11703b3-e6d1-42bd-ab88-d906ba9a5133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:30.204344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11703b3-e6d1-42bd-ab88-d906ba9a5133 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:30.221776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 436/872] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:30.221776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11703b3-e6d1-42bd-ab88-d906ba9a5133 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:30.251153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 437/873] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:30.251864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8c2b8-1d09-470f-b12a-ed72516778a0 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:30.300875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:30.348027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11703b3-e6d1-42bd-ab88-d906ba9a5133 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:30.375886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8c2b8-1d09-470f-b12a-ed72516778a0 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:30.384127 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e197324-612a-4a15-a397-6cbac9291936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:30.384790 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e197324-612a-4a15-a397-6cbac9291936 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:30.385072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e197324-612a-4a15-a397-6cbac9291936 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:30.385349 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e197324-612a-4a15-a397-6cbac9291936 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:30.386136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e197324-612a-4a15-a397-6cbac9291936 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:30.386439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e197324-612a-4a15-a397-6cbac9291936 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:30.387895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e197324-612a-4a15-a397-6cbac9291936 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:30.405534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 437/874] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:30.405534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e197324-612a-4a15-a397-6cbac9291936 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:30.420543 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d6db4-d8b2-4a8d-ad8d-a73ac97d400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:30.421445 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d6db4-d8b2-4a8d-ad8d-a73ac97d400e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:30.421804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d6db4-d8b2-4a8d-ad8d-a73ac97d400e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:30.422153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d6db4-d8b2-4a8d-ad8d-a73ac97d400e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:30.433684 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d6db4-d8b2-4a8d-ad8d-a73ac97d400e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:30.436441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d6db4-d8b2-4a8d-ad8d-a73ac97d400e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-6b6d6db4-d8b2-4a8d-ad8d-a73ac97d400e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:30.454980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:30.456211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:30.457789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:30.457789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:30.457789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:30.457789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:30.457789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:30.457789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:30.457789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:30.457789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:30.457789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 438/875] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:30.457789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d6db4-d8b2-4a8d-ad8d-a73ac97d400e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:30.463880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:30.522396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e197324-612a-4a15-a397-6cbac9291936 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:30.539264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:30.563805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f44d12-a2ae-4af3-b2e9-153385f02978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:30.565198 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f44d12-a2ae-4af3-b2e9-153385f02978 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:30.565701 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f44d12-a2ae-4af3-b2e9-153385f02978 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:30.566185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f44d12-a2ae-4af3-b2e9-153385f02978 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:30.567439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f44d12-a2ae-4af3-b2e9-153385f02978 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:30.569364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f44d12-a2ae-4af3-b2e9-153385f02978 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:30.578010 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d6db4-d8b2-4a8d-ad8d-a73ac97d400e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-58f44d12-a2ae-4af3-b2e9-153385f02978 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:30.582980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:30.584219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:30.585275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:30.585275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:30.585275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:30.585275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:30.585275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:30.585275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:30.585275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:30.585275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:30.585275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:30.585275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:30.585275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:30.585275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:30.585275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:36:30.585275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:30.589507 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 438/876] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:36:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:30.590487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f44d12-a2ae-4af3-b2e9-153385f02978 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:30.626162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdca752-67fb-4f20-915a-1453f0e77095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:30.627109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdca752-67fb-4f20-915a-1453f0e77095 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:30.627595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdca752-67fb-4f20-915a-1453f0e77095 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:30.628098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdca752-67fb-4f20-915a-1453f0e77095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:30.629092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdca752-67fb-4f20-915a-1453f0e77095 None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=00f3424dc2ee4f828638b3a8f5c9fc5d) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:30.629595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdca752-67fb-4f20-915a-1453f0e77095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:30.631067 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdca752-67fb-4f20-915a-1453f0e77095 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:30.647480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 439/877] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:30 2022] GET /identity/v3/role_assignments?user.id=00f3424dc2ee4f828638b3a8f5c9fc5d&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=c5632345c9274d348669482f1f7414c8 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:30.647480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdca752-67fb-4f20-915a-1453f0e77095 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:30.719631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f44d12-a2ae-4af3-b2e9-153385f02978 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:30.756121 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:30.776127 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea1ee0-ed3c-403a-aeb7-4e38f88648d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:30.776853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea1ee0-ed3c-403a-aeb7-4e38f88648d7 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:30.777134 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea1ee0-ed3c-403a-aeb7-4e38f88648d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:30.777409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea1ee0-ed3c-403a-aeb7-4e38f88648d7 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:30.778212 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea1ee0-ed3c-403a-aeb7-4e38f88648d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:30.778521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea1ee0-ed3c-403a-aeb7-4e38f88648d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:30.780049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea1ee0-ed3c-403a-aeb7-4e38f88648d7 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:30.794736 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 439/878] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:30.801012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea1ee0-ed3c-403a-aeb7-4e38f88648d7 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:30.807057 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdca752-67fb-4f20-915a-1453f0e77095 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:30.846618 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098ed79-795f-49b4-8319-d92306199d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:30.847730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ed79-795f-49b4-8319-d92306199d83 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:30.848213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ed79-795f-49b4-8319-d92306199d83 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:30.848684 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ed79-795f-49b4-8319-d92306199d83 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:30.849586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098ed79-795f-49b4-8319-d92306199d83 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:30.850104 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098ed79-795f-49b4-8319-d92306199d83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:30.851715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098ed79-795f-49b4-8319-d92306199d83 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:30.853150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:30.857233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 440/879] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:36:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:30.863734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098ed79-795f-49b4-8319-d92306199d83 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:30.924269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea1ee0-ed3c-403a-aeb7-4e38f88648d7 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:30.959948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1505c67-9ccd-4cea-bfce-79e5dac52cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:30.960599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1505c67-9ccd-4cea-bfce-79e5dac52cbd None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:30.960877 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1505c67-9ccd-4cea-bfce-79e5dac52cbd None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:30.961148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1505c67-9ccd-4cea-bfce-79e5dac52cbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:30.961978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1505c67-9ccd-4cea-bfce-79e5dac52cbd None admin] RBAC: Adding query filter params (role.id=a9712a3506694519b4e4945b54539d79, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=70f0634c146244a1a0e91f89493cc076) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:30.962286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1505c67-9ccd-4cea-bfce-79e5dac52cbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:30.963738 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1505c67-9ccd-4cea-bfce-79e5dac52cbd None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:30.969791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 440/880] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:30 2022] GET /identity/v3/role_assignments?user.id=70f0634c146244a1a0e91f89493cc076&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=a9712a3506694519b4e4945b54539d79 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:30.971047 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b642b-0993-4bbe-8d37-d48a3e22326d None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:30.971332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b642b-0993-4bbe-8d37-d48a3e22326d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:30.971639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b642b-0993-4bbe-8d37-d48a3e22326d None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:30.975489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 441/881] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:30.979336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a1f37-9b1e-4426-905a-f23d59e42c05 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:30.979667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a1f37-9b1e-4426-905a-f23d59e42c05 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:30.979933 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a1f37-9b1e-4426-905a-f23d59e42c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:30.996858 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098ed79-795f-49b4-8319-d92306199d83 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:31.006841 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-8d2a1f37-9b1e-4426-905a-f23d59e42c05 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:31.009066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8d2a1f37-9b1e-4426-905a-f23d59e42c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:31.032175 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:31.039019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fda963-076a-4ae8-924a-1745a83ff9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:31.050378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fda963-076a-4ae8-924a-1745a83ff9ca None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:31.050378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fda963-076a-4ae8-924a-1745a83ff9ca None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:31.050378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fda963-076a-4ae8-924a-1745a83ff9ca None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:31.050378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fda963-076a-4ae8-924a-1745a83ff9ca None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:31.050378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fda963-076a-4ae8-924a-1745a83ff9ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:31.050378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fda963-076a-4ae8-924a-1745a83ff9ca None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:31.050830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 441/882] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:36:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:31.055420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fda963-076a-4ae8-924a-1745a83ff9ca None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:31.108456 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 442/883] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:31.126679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a1f37-9b1e-4426-905a-f23d59e42c05 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:31.172171 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fda963-076a-4ae8-924a-1745a83ff9ca None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:31.184034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:31.212839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a42b8-35d0-4906-8dd4-8ff180ceeb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:31.215953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a42b8-35d0-4906-8dd4-8ff180ceeb17 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:31.215953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a42b8-35d0-4906-8dd4-8ff180ceeb17 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:31.215953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a42b8-35d0-4906-8dd4-8ff180ceeb17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:31.215953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a42b8-35d0-4906-8dd4-8ff180ceeb17 None admin] RBAC: Adding query filter params (interface=public, service_id=b9391b01aed74249834c213d80609a2f, region_id=RegionOne) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:31.215953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a42b8-35d0-4906-8dd4-8ff180ceeb17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:31.217407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a42b8-35d0-4906-8dd4-8ff180ceeb17 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:31.225970 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 442/884] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 2 13:36:31 2022] GET /identity/v3/endpoints?service_id=b9391b01aed74249834c213d80609a2f&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:31.231561 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a42b8-35d0-4906-8dd4-8ff180ceeb17 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:31.243205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a1f37-9b1e-4426-905a-f23d59e42c05 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:31.297681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80852945-d38e-444f-91f1-d0082416aab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:31.298508 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80852945-d38e-444f-91f1-d0082416aab6 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:31.299053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80852945-d38e-444f-91f1-d0082416aab6 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:31.299340 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80852945-d38e-444f-91f1-d0082416aab6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:31.300440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80852945-d38e-444f-91f1-d0082416aab6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:31.301823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80852945-d38e-444f-91f1-d0082416aab6 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:31.309943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-80852945-d38e-444f-91f1-d0082416aab6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:31.317469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:31.318460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:31.319309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 443/885] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jun 2 13:36:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:31.327255 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80852945-d38e-444f-91f1-d0082416aab6 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:31.362011 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a42b8-35d0-4906-8dd4-8ff180ceeb17 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:31.398980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8d71e-8976-4609-90cf-c6a4e30f7218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:31.399834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8d71e-8976-4609-90cf-c6a4e30f7218 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:31.400213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8d71e-8976-4609-90cf-c6a4e30f7218 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:31.400583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8d71e-8976-4609-90cf-c6a4e30f7218 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:31.401420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8d71e-8976-4609-90cf-c6a4e30f7218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:31.402935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8d71e-8976-4609-90cf-c6a4e30f7218 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:31.409994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 443/886] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 2 13:36:31 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:31.462440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:31.474107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80852945-d38e-444f-91f1-d0082416aab6 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:31.523623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dbe42-f21c-4c80-bf7c-0c35cf19825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:31.524238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dbe42-f21c-4c80-bf7c-0c35cf19825b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:31.524522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dbe42-f21c-4c80-bf7c-0c35cf19825b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:31.524797 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dbe42-f21c-4c80-bf7c-0c35cf19825b None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:31.525662 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94dbe42-f21c-4c80-bf7c-0c35cf19825b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:31.525971 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94dbe42-f21c-4c80-bf7c-0c35cf19825b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:31.527363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94dbe42-f21c-4c80-bf7c-0c35cf19825b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:31.533988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 444/887] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 2 13:36:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:31.539781 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8d71e-8976-4609-90cf-c6a4e30f7218 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:31.658526 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8d71e-8976-4609-90cf-c6a4e30f7218 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:31.684816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:31.697756 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cd3d8-3a2b-4c53-8f1c-e33acb993729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:31.698438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cd3d8-3a2b-4c53-8f1c-e33acb993729 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:31.698723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cd3d8-3a2b-4c53-8f1c-e33acb993729 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:31.698997 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cd3d8-3a2b-4c53-8f1c-e33acb993729 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:31.699748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cd3d8-3a2b-4c53-8f1c-e33acb993729 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:31.700055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cd3d8-3a2b-4c53-8f1c-e33acb993729 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:31.701495 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cd3d8-3a2b-4c53-8f1c-e33acb993729 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:31.707362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 444/888] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 2 13:36:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:31.713233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dbe42-f21c-4c80-bf7c-0c35cf19825b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:31.822111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dbe42-f21c-4c80-bf7c-0c35cf19825b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:31.857210 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c8c6a-ca96-45d5-b2f3-42694a91d63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:31.858443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c8c6a-ca96-45d5-b2f3-42694a91d63b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:31.858730 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c8c6a-ca96-45d5-b2f3-42694a91d63b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:31.859051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c8c6a-ca96-45d5-b2f3-42694a91d63b None admin] PATH_INFO: `/v3/endpoints` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:31.859905 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c8c6a-ca96-45d5-b2f3-42694a91d63b None admin] RBAC: Adding query filter params (interface=public, service_id=7120da776db442fcab86aa74d548e8ec, region_id=RegionOne) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:31.860273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c8c6a-ca96-45d5-b2f3-42694a91d63b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:31.861748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c8c6a-ca96-45d5-b2f3-42694a91d63b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:31.868317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 445/889] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 2 13:36:31 2022] GET /identity/v3/endpoints?service_id=7120da776db442fcab86aa74d548e8ec&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:31.874368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cd3d8-3a2b-4c53-8f1c-e33acb993729 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:31.981119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cd3d8-3a2b-4c53-8f1c-e33acb993729 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:32.018070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d04b5-db88-46b6-b122-eba30afeb5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:32.019077 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d04b5-db88-46b6-b122-eba30afeb5c7 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:32.019577 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d04b5-db88-46b6-b122-eba30afeb5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:32.020087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d04b5-db88-46b6-b122-eba30afeb5c7 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:32.020946 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d04b5-db88-46b6-b122-eba30afeb5c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:32.022604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d04b5-db88-46b6-b122-eba30afeb5c7 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:32.029164 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 445/890] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 2 13:36:31 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:36:33.036221 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e799530-5a30-45d6-98e4-5463637c6fc3 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:33.036747 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e799530-5a30-45d6-98e4-5463637c6fc3 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:33.036826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e799530-5a30-45d6-98e4-5463637c6fc3 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:33.038438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 446/891] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:33.044019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ba54-910b-447e-ac99-0714fed87d5b None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:33.044429 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ba54-910b-447e-ac99-0714fed87d5b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:33.044598 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ba54-910b-447e-ac99-0714fed87d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:33.061545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-71c9ba54-910b-447e-ac99-0714fed87d5b None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:33.062721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-71c9ba54-910b-447e-ac99-0714fed87d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:33.111631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:33.136926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 446/892] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:33.159651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e799530-5a30-45d6-98e4-5463637c6fc3 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:33.191740 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:33.276946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e799530-5a30-45d6-98e4-5463637c6fc3 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:33.316015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f42af3-cc16-478e-9ea0-306be119f078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:33.316762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f42af3-cc16-478e-9ea0-306be119f078 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:33.317049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f42af3-cc16-478e-9ea0-306be119f078 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:33.317329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f42af3-cc16-478e-9ea0-306be119f078 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:33.317994 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f42af3-cc16-478e-9ea0-306be119f078 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:33.319405 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f42af3-cc16-478e-9ea0-306be119f078 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-33f42af3-cc16-478e-9ea0-306be119f078 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:33.333038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:33.334097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:33.334926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 447/893] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 2 13:36:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:33.340682 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9ba54-910b-447e-ac99-0714fed87d5b None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:33.450100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9ba54-910b-447e-ac99-0714fed87d5b None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:33.485712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f484597-93fa-4f39-9453-75ab2d7a06c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:33.486392 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f484597-93fa-4f39-9453-75ab2d7a06c7 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:33.486673 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f484597-93fa-4f39-9453-75ab2d7a06c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:33.486953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f484597-93fa-4f39-9453-75ab2d7a06c7 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:33.487707 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f484597-93fa-4f39-9453-75ab2d7a06c7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:33.488018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f484597-93fa-4f39-9453-75ab2d7a06c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:33.489462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f484597-93fa-4f39-9453-75ab2d7a06c7 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:33.499046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72436f-0d6f-425c-900a-876501c79690 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:33.499536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 447/894] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 2 13:36:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:33.499947 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72436f-0d6f-425c-900a-876501c79690 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:33.500424 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72436f-0d6f-425c-900a-876501c79690 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:33.502374 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f484597-93fa-4f39-9453-75ab2d7a06c7 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:33.503157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 448/895] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:33.509061 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c10de-ce8e-45da-82da-9606ffeb3915 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:33.509696 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c10de-ce8e-45da-82da-9606ffeb3915 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:33.510223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c10de-ce8e-45da-82da-9606ffeb3915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:33.528804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d92c10de-ce8e-45da-82da-9606ffeb3915 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:33.530555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d92c10de-ce8e-45da-82da-9606ffeb3915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:33.561558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:33.621957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 449/896] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:33.634696 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f484597-93fa-4f39-9453-75ab2d7a06c7 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:33.646141 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c10de-ce8e-45da-82da-9606ffeb3915 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:33.667902 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:33.682079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7ec63-fa19-45d6-aa98-4fd842a25995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:33.683144 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7ec63-fa19-45d6-aa98-4fd842a25995 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:33.686409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7ec63-fa19-45d6-aa98-4fd842a25995 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:33.686863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7ec63-fa19-45d6-aa98-4fd842a25995 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:33.687771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7ec63-fa19-45d6-aa98-4fd842a25995 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:33.688257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7ec63-fa19-45d6-aa98-4fd842a25995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:33.689795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7ec63-fa19-45d6-aa98-4fd842a25995 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:33.696839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 448/897] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 2 13:36:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:33.767013 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c10de-ce8e-45da-82da-9606ffeb3915 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:33.808093 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7b1f0-cb7b-472d-9bfe-2f9e835fa363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:33.808950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7b1f0-cb7b-472d-9bfe-2f9e835fa363 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:33.809274 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7b1f0-cb7b-472d-9bfe-2f9e835fa363 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:33.809558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7b1f0-cb7b-472d-9bfe-2f9e835fa363 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:33.822604 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7b1f0-cb7b-472d-9bfe-2f9e835fa363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-95d7b1f0-cb7b-472d-9bfe-2f9e835fa363 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:33.832516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:33.833526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:33.834375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:33.834375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:33.834375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:33.834375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:33.834375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:33.834375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:33.834375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:33.834375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:33.834375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:33.834375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:33.834375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:36:33.834375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:33.834375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 450/898] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 2 13:36:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:33.840218 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7ec63-fa19-45d6-aa98-4fd842a25995 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:33.869281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877eb9c-b0d7-4b06-83de-7c62e7b3df66 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:33.869624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877eb9c-b0d7-4b06-83de-7c62e7b3df66 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:33.869857 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877eb9c-b0d7-4b06-83de-7c62e7b3df66 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:33.872058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 451/899] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:33.880748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec0c58-7e6c-4f31-9520-89ac1c5e5515 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:33.881066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec0c58-7e6c-4f31-9520-89ac1c5e5515 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:33.881298 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec0c58-7e6c-4f31-9520-89ac1c5e5515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:33.904117 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-f3ec0c58-7e6c-4f31-9520-89ac1c5e5515 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:33.905357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f3ec0c58-7e6c-4f31-9520-89ac1c5e5515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:33.976055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7ec63-fa19-45d6-aa98-4fd842a25995 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:33.988483 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:34.006083 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 452/900] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:34.031333 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786590c8-bc54-474f-9f98-a6b034dd1487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:34.032635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786590c8-bc54-474f-9f98-a6b034dd1487 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.033201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786590c8-bc54-474f-9f98-a6b034dd1487 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.033854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786590c8-bc54-474f-9f98-a6b034dd1487 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.035623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786590c8-bc54-474f-9f98-a6b034dd1487 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:34.035969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec0c58-7e6c-4f31-9520-89ac1c5e5515 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:34.036556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786590c8-bc54-474f-9f98-a6b034dd1487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:34.038691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786590c8-bc54-474f-9f98-a6b034dd1487 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:34.050744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:34.053347 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 449/901] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 2 13:36:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:34.061372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786590c8-bc54-474f-9f98-a6b034dd1487 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:34.160209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec0c58-7e6c-4f31-9520-89ac1c5e5515 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:34.175342 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786590c8-bc54-474f-9f98-a6b034dd1487 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:34.199482 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7e530-e1a9-44a8-ab19-c96ceee057da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:34.200473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7e530-e1a9-44a8-ab19-c96ceee057da None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.200832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7e530-e1a9-44a8-ab19-c96ceee057da None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.201184 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7e530-e1a9-44a8-ab19-c96ceee057da None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.202216 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7e530-e1a9-44a8-ab19-c96ceee057da None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:34.203713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7e530-e1a9-44a8-ab19-c96ceee057da None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:34.213186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d54821-ac37-4269-850a-48a8c53f76cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:34.214278 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d54821-ac37-4269-850a-48a8c53f76cd None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.214803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d54821-ac37-4269-850a-48a8c53f76cd None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.215262 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d54821-ac37-4269-850a-48a8c53f76cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-c0e7e530-e1a9-44a8-ab19-c96ceee057da None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:34.218363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:34.219385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:34.220464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:34.220464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:34.220464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:34.220464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:34.220464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:34.220464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:34.220464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:34.220464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:34.220464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:34.220464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:34.220464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:34.220464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:34.220464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:36:34.220464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:34.225209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 453/902] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:36:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:34.226172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7e530-e1a9-44a8-ab19-c96ceee057da None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:34.231880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d54821-ac37-4269-850a-48a8c53f76cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:34.234232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d54821-ac37-4269-850a-48a8c53f76cd None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-72d54821-ac37-4269-850a-48a8c53f76cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:34.253662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:34.254637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:34.255578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:34.255578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:34.255578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:34.255578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:34.262550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 450/903] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:34.263709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d54821-ac37-4269-850a-48a8c53f76cd None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:34.291678 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:34.313757 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:34.347974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7e530-e1a9-44a8-ab19-c96ceee057da None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:34.377040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d54821-ac37-4269-850a-48a8c53f76cd None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:34.386963 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5819e5a-c7c4-4127-8cf4-18ba66b3034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:34.387709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5819e5a-c7c4-4127-8cf4-18ba66b3034a None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.387999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5819e5a-c7c4-4127-8cf4-18ba66b3034a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.388278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5819e5a-c7c4-4127-8cf4-18ba66b3034a None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.389230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5819e5a-c7c4-4127-8cf4-18ba66b3034a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:34.389445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5819e5a-c7c4-4127-8cf4-18ba66b3034a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:34.391051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5819e5a-c7c4-4127-8cf4-18ba66b3034a None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:34.401316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 454/904] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:36:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:34.402732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213c1bf-5c63-4a96-acc5-4b6a48b16ed6 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.403031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213c1bf-5c63-4a96-acc5-4b6a48b16ed6 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.403319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213c1bf-5c63-4a96-acc5-4b6a48b16ed6 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.405431 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 455/905] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:34.406015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213c1bf-5c63-4a96-acc5-4b6a48b16ed6 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:34.421940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890f82-fa04-4e8d-a3a3-b752b418280b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:34.423122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890f82-fa04-4e8d-a3a3-b752b418280b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.424026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890f82-fa04-4e8d-a3a3-b752b418280b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.424652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890f82-fa04-4e8d-a3a3-b752b418280b None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.425677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c890f82-fa04-4e8d-a3a3-b752b418280b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:34.426316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c890f82-fa04-4e8d-a3a3-b752b418280b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:34.428206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c890f82-fa04-4e8d-a3a3-b752b418280b None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:34.443692 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 451/906] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:34.444966 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26313f3-9595-483a-acab-622366ec1477 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.445271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26313f3-9595-483a-acab-622366ec1477 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.445533 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26313f3-9595-483a-acab-622366ec1477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.467493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-c26313f3-9595-483a-acab-622366ec1477 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:34.469466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c26313f3-9595-483a-acab-622366ec1477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:34.519376 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213c1bf-5c63-4a96-acc5-4b6a48b16ed6 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:34.547387 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 452/907] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:34.548311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26313f3-9595-483a-acab-622366ec1477 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:34.561699 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea5c42-a724-4f96-b301-8bb5150d3801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:34.562764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea5c42-a724-4f96-b301-8bb5150d3801 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.563363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea5c42-a724-4f96-b301-8bb5150d3801 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.563877 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea5c42-a724-4f96-b301-8bb5150d3801 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.564882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea5c42-a724-4f96-b301-8bb5150d3801 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:34.565394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea5c42-a724-4f96-b301-8bb5150d3801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:34.567367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea5c42-a724-4f96-b301-8bb5150d3801 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:34.570395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:34.572261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:34.575286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 456/908] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 2 13:36:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:34.576178 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea5c42-a724-4f96-b301-8bb5150d3801 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:34.665410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26313f3-9595-483a-acab-622366ec1477 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:34.686123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea5c42-a724-4f96-b301-8bb5150d3801 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:34.705269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42b584-26c3-4c58-8102-b230f840cf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:34.706244 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42b584-26c3-4c58-8102-b230f840cf6a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.706627 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42b584-26c3-4c58-8102-b230f840cf6a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.707112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42b584-26c3-4c58-8102-b230f840cf6a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.715325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42b584-26c3-4c58-8102-b230f840cf6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:34.716896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42b584-26c3-4c58-8102-b230f840cf6a None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:34.722831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72513439-be90-47df-ad4f-c06a9c6b2457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:34.723669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72513439-be90-47df-ad4f-c06a9c6b2457 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.723956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72513439-be90-47df-ad4f-c06a9c6b2457 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.724260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72513439-be90-47df-ad4f-c06a9c6b2457 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.724913 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72513439-be90-47df-ad4f-c06a9c6b2457 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:34.726332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72513439-be90-47df-ad4f-c06a9c6b2457 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-af42b584-26c3-4c58-8102-b230f840cf6a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:34.734004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:34.735398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:34.736655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:34.736655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:34.736655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:34.736655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:34.736655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:34.736655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:34.736655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:34.736655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:34.736655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:36:34.736655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:34.742745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 453/909] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 2 13:36:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:34.742745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42b584-26c3-4c58-8102-b230f840cf6a None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-72513439-be90-47df-ad4f-c06a9c6b2457 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:34.743043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:34.744157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:34.745288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 457/910] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jun 2 13:36:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:34.746586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72513439-be90-47df-ad4f-c06a9c6b2457 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:34.811318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:34.824396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:34.854941 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42b584-26c3-4c58-8102-b230f840cf6a None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:34.855146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72513439-be90-47df-ad4f-c06a9c6b2457 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:34.895671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcde0e6-85bf-4f7a-aaf2-6bc6630da721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:34.895917 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897133a-189a-4427-b9a1-706e9bbdec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:34.896352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde0e6-85bf-4f7a-aaf2-6bc6630da721 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.896470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897133a-189a-4427-b9a1-706e9bbdec31 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.896630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde0e6-85bf-4f7a-aaf2-6bc6630da721 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.896737 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897133a-189a-4427-b9a1-706e9bbdec31 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.896919 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde0e6-85bf-4f7a-aaf2-6bc6630da721 None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.897021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897133a-189a-4427-b9a1-706e9bbdec31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.897694 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897133a-189a-4427-b9a1-706e9bbdec31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:34.897790 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcde0e6-85bf-4f7a-aaf2-6bc6630da721 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:34.898067 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcde0e6-85bf-4f7a-aaf2-6bc6630da721 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:34.899083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897133a-189a-4427-b9a1-706e9bbdec31 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:34.899517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcde0e6-85bf-4f7a-aaf2-6bc6630da721 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:34.919116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 458/911] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 2 13:36:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:34.920768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcde0e6-85bf-4f7a-aaf2-6bc6630da721 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:34.970916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 454/912] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 2 13:36:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:34.980727 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897133a-189a-4427-b9a1-706e9bbdec31 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:35.040012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcde0e6-85bf-4f7a-aaf2-6bc6630da721 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:35.076408 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:35.108359 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951ea33-49ce-44d2-bb20-496aac958bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:35.109207 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951ea33-49ce-44d2-bb20-496aac958bcb None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.109597 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951ea33-49ce-44d2-bb20-496aac958bcb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.110302 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951ea33-49ce-44d2-bb20-496aac958bcb None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.111553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951ea33-49ce-44d2-bb20-496aac958bcb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:35.111994 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951ea33-49ce-44d2-bb20-496aac958bcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:35.113766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951ea33-49ce-44d2-bb20-496aac958bcb None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:35.121387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 459/913] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 2 13:36:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:35.126928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951ea33-49ce-44d2-bb20-496aac958bcb None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:35.140063 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897133a-189a-4427-b9a1-706e9bbdec31 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:35.175912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:35.184643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40ff51-ddfc-4163-82ae-3c26863fbafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:35.185421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40ff51-ddfc-4163-82ae-3c26863fbafa None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.185726 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40ff51-ddfc-4163-82ae-3c26863fbafa None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.186088 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40ff51-ddfc-4163-82ae-3c26863fbafa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.305522 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40ff51-ddfc-4163-82ae-3c26863fbafa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:35.305752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951ea33-49ce-44d2-bb20-496aac958bcb None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:35.307317 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40ff51-ddfc-4163-82ae-3c26863fbafa None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:35.357456 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362801ab-fe22-4616-86b1-9329840fce33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:35.358175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362801ab-fe22-4616-86b1-9329840fce33 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.359145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362801ab-fe22-4616-86b1-9329840fce33 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.359431 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362801ab-fe22-4616-86b1-9329840fce33 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.360194 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362801ab-fe22-4616-86b1-9329840fce33 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:35.360508 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362801ab-fe22-4616-86b1-9329840fce33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:35.362892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362801ab-fe22-4616-86b1-9329840fce33 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:35.371208 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 460/914] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 2 13:36:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:35.379936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362801ab-fe22-4616-86b1-9329840fce33 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:35.440666 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 455/915] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:34 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:36:35.445079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:35.446960 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40ff51-ddfc-4163-82ae-3c26863fbafa None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:35.487138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:35.523206 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362801ab-fe22-4616-86b1-9329840fce33 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:35.571219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134de998-f3dc-44b6-96f7-efea65857d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:35.572580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134de998-f3dc-44b6-96f7-efea65857d0b None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.573075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134de998-f3dc-44b6-96f7-efea65857d0b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.573612 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134de998-f3dc-44b6-96f7-efea65857d0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.575168 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134de998-f3dc-44b6-96f7-efea65857d0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:35.578621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134de998-f3dc-44b6-96f7-efea65857d0b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:35.595497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40ff51-ddfc-4163-82ae-3c26863fbafa None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:35.635776 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64480390-7c6f-4a91-88ee-62e49eb22d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:35.636584 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64480390-7c6f-4a91-88ee-62e49eb22d59 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.636866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64480390-7c6f-4a91-88ee-62e49eb22d59 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.637142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64480390-7c6f-4a91-88ee-62e49eb22d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.650942 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64480390-7c6f-4a91-88ee-62e49eb22d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:35.652602 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64480390-7c6f-4a91-88ee-62e49eb22d59 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-64480390-7c6f-4a91-88ee-62e49eb22d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:35.673269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:35.674311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:35.676185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:35.676185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:35.676185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:35.676185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:35.679713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 456/916] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:35.680582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64480390-7c6f-4a91-88ee-62e49eb22d59 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:35.748812 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 461/917] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 2 13:36:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:35.806222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:35.834268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64480390-7c6f-4a91-88ee-62e49eb22d59 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:35.882594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bce810-a8bb-4d0e-a116-acdfca9bb0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:35.883691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bce810-a8bb-4d0e-a116-acdfca9bb0c6 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.884198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bce810-a8bb-4d0e-a116-acdfca9bb0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.884677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bce810-a8bb-4d0e-a116-acdfca9bb0c6 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.885645 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bce810-a8bb-4d0e-a116-acdfca9bb0c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:35.886158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bce810-a8bb-4d0e-a116-acdfca9bb0c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:35.887786 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bce810-a8bb-4d0e-a116-acdfca9bb0c6 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:35.902545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 457/918] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:35.908765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134de998-f3dc-44b6-96f7-efea65857d0b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:36.030176 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134de998-f3dc-44b6-96f7-efea65857d0b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:36.031842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:36.041114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41714824-de40-4cdd-83db-585ed6c19db5 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:36.041400 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41714824-de40-4cdd-83db-585ed6c19db5 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:36.041673 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41714824-de40-4cdd-83db-585ed6c19db5 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:36.043035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 458/919] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:36.050762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fe077-beaf-47c4-978f-1c635f349b67 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:36.051047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fe077-beaf-47c4-978f-1c635f349b67 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:36.051322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fe077-beaf-47c4-978f-1c635f349b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:36.071650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc68d0b-9466-4a4e-8c83-9381c936b8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:36.072393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc68d0b-9466-4a4e-8c83-9381c936b8d8 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:36.072672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc68d0b-9466-4a4e-8c83-9381c936b8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:36.072954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc68d0b-9466-4a4e-8c83-9381c936b8d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:36.080636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-a72fe077-beaf-47c4-978f-1c635f349b67 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:36.081292 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc68d0b-9466-4a4e-8c83-9381c936b8d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:36.082772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc68d0b-9466-4a4e-8c83-9381c936b8d8 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:36.083215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a72fe077-beaf-47c4-978f-1c635f349b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-4cc68d0b-9466-4a4e-8c83-9381c936b8d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:36.098077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:36.099038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:36.100342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:36.100342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:36.100342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:36.100342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:36.100342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:36.100342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:36.100342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:36.100342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:36.103695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 462/920] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:36.105323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc68d0b-9466-4a4e-8c83-9381c936b8d8 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:36.178118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 459/921] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:36.197475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fe077-beaf-47c4-978f-1c635f349b67 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:36.228570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc68d0b-9466-4a4e-8c83-9381c936b8d8 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:36.272154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d2bde-f96c-4157-81c0-862a2b3eb8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:36.272826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d2bde-f96c-4157-81c0-862a2b3eb8f6 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:36.273112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d2bde-f96c-4157-81c0-862a2b3eb8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:36.273391 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d2bde-f96c-4157-81c0-862a2b3eb8f6 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:36.274188 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d2bde-f96c-4157-81c0-862a2b3eb8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:36.274497 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d2bde-f96c-4157-81c0-862a2b3eb8f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:36.276173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d2bde-f96c-4157-81c0-862a2b3eb8f6 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:36.294078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 463/922] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:36.296268 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d2bde-f96c-4157-81c0-862a2b3eb8f6 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:36.299118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:36.330565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:36.349670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fe077-beaf-47c4-978f-1c635f349b67 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:36.395244 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09735bf6-3936-44bf-b88e-3532eba3d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:36.395946 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09735bf6-3936-44bf-b88e-3532eba3d3ab None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:36.396222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09735bf6-3936-44bf-b88e-3532eba3d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:36.396492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09735bf6-3936-44bf-b88e-3532eba3d3ab None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:36.397222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09735bf6-3936-44bf-b88e-3532eba3d3ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:36.398607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09735bf6-3936-44bf-b88e-3532eba3d3ab None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:36.434338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d2bde-f96c-4157-81c0-862a2b3eb8f6 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:36.473203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f752bb-83cb-4ad0-876c-7304cdc923ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:36.473866 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f752bb-83cb-4ad0-876c-7304cdc923ae None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:36.474150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f752bb-83cb-4ad0-876c-7304cdc923ae None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:36.474430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f752bb-83cb-4ad0-876c-7304cdc923ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:36.475301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f752bb-83cb-4ad0-876c-7304cdc923ae None admin] RBAC: Adding query filter params (role.id=3613773e53094931b72912bb4cd6a9df, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=70f0634c146244a1a0e91f89493cc076) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:36.475681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f752bb-83cb-4ad0-876c-7304cdc923ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:36.477119 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f752bb-83cb-4ad0-876c-7304cdc923ae None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:36.483842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 464/923] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:36 2022] GET /identity/v3/role_assignments?user.id=70f0634c146244a1a0e91f89493cc076&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=3613773e53094931b72912bb4cd6a9df => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:36.503791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 460/924] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 2 13:36:36 2022] POST /identity/v3/services => generated 241 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:37.415523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef624e2a-ede1-489e-980a-aa0267b3cc37 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:37.416038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef624e2a-ede1-489e-980a-aa0267b3cc37 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:37.416116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef624e2a-ede1-489e-980a-aa0267b3cc37 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:37.417720 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 465/925] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:37.423254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889865ea-b803-4dbd-9db0-f9002b259028 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:37.423762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889865ea-b803-4dbd-9db0-f9002b259028 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:37.424013 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889865ea-b803-4dbd-9db0-f9002b259028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:37.442236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-889865ea-b803-4dbd-9db0-f9002b259028 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:37.443634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-889865ea-b803-4dbd-9db0-f9002b259028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:37.522339 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 461/926] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:37.546502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef624e2a-ede1-489e-980a-aa0267b3cc37 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:37.664957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:37.683426 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef624e2a-ede1-489e-980a-aa0267b3cc37 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:37.733421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d860c-4897-456f-9c41-b8fc84d4db79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:37.734477 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d860c-4897-456f-9c41-b8fc84d4db79 None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:37.734957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d860c-4897-456f-9c41-b8fc84d4db79 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:37.735522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d860c-4897-456f-9c41-b8fc84d4db79 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:37.736448 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d860c-4897-456f-9c41-b8fc84d4db79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:37.738136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d860c-4897-456f-9c41-b8fc84d4db79 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:37.739831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: WARNING keystone.server.flask.common [None req-9f1d860c-4897-456f-9c41-b8fc84d4db79 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 13:36:37.802613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.sql.core [None req-9f1d860c-4897-456f-9c41-b8fc84d4db79 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:36:37.802613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 13:36:37.802613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [parameters: {'id': 'd623727fcf8d42adb9ebbd51d15c8e59', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 13:36:37.802613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92272) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:36:37.811516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-9f1d860c-4897-456f-9c41-b8fc84d4db79 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d623727fcf8d42adb9ebbd51d15c8e59.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d623727fcf8d42adb9ebbd51d15c8e59. Jun 02 13:36:37.811516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:37.811516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:36:37.811516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:36:37.811516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:36:37.811516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:36:37.811516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:36:37.811516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:36:37.811516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:36:37.811516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:36:37.811516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:36:37.811516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:36:37.811516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application result.read() Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 02 13:36:37.812394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application yield resource Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise self.value Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application session.commit() Jun 02 13:36:37.813361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:36:37.814240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:36:37.815145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application result.read() Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:36:37.815991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [parameters: {'id': 'd623727fcf8d42adb9ebbd51d15c8e59', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:37.816848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:37.819577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:37.821769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:37.821769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 02 13:36:37.821769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 02 13:36:37.821769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:37.821769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:37.821769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 02 13:36:37.821769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 02 13:36:37.821769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d623727fcf8d42adb9ebbd51d15c8e59. Jun 02 13:36:37.821769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:37.824971 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 466/927] 10.222.0.39 () {60 vars in 1140 bytes} [Thu Jun 2 13:36:37 2022] POST /identity/v3/projects => generated 262 bytes in 279 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:37.831494 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889865ea-b803-4dbd-9db0-f9002b259028 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:37.888646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:37.937817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889865ea-b803-4dbd-9db0-f9002b259028 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:37.972500 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5ae6a-29be-4021-93fb-368aad985233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:37.973294 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5ae6a-29be-4021-93fb-368aad985233 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:37.973571 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5ae6a-29be-4021-93fb-368aad985233 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:37.973882 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5ae6a-29be-4021-93fb-368aad985233 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:37.980705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5ae6a-29be-4021-93fb-368aad985233 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:37.982133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5ae6a-29be-4021-93fb-368aad985233 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-bcf5ae6a-29be-4021-93fb-368aad985233 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:37.998785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:37.999760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:38.000662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:38.000662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:38.000662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:38.000662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:38.000662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:38.000662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:38.000662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:38.000662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:38.000662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 462/928] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:38.008089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d860c-4897-456f-9c41-b8fc84d4db79 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:38.118245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d860c-4897-456f-9c41-b8fc84d4db79 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:38.154559 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ea2f2-ab80-4b5d-9020-a05a93d4b21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:38.155226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ea2f2-ab80-4b5d-9020-a05a93d4b21a None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:38.155535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ea2f2-ab80-4b5d-9020-a05a93d4b21a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:38.155809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ea2f2-ab80-4b5d-9020-a05a93d4b21a None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:38.156560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ea2f2-ab80-4b5d-9020-a05a93d4b21a None admin] RBAC: Adding query filter params (name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:38.156918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ea2f2-ab80-4b5d-9020-a05a93d4b21a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:38.158665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ea2f2-ab80-4b5d-9020-a05a93d4b21a None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:38.159317 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0db90-05bc-4d70-9b0e-37c634ba2f41 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:38.159644 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0db90-05bc-4d70-9b0e-37c634ba2f41 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:38.159921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0db90-05bc-4d70-9b0e-37c634ba2f41 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:38.161510 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 463/929] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:38.166768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3bc1d-946f-489b-bfc1-0c8197942430 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:38.167047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3bc1d-946f-489b-bfc1-0c8197942430 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:38.167325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3bc1d-946f-489b-bfc1-0c8197942430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:38.187479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 467/930] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 2 13:36:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:38.196596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-03e3bc1d-946f-489b-bfc1-0c8197942430 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:38.198004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-03e3bc1d-946f-489b-bfc1-0c8197942430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:38.290859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 464/931] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:38.317652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ea2f2-ab80-4b5d-9020-a05a93d4b21a None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:38.320713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:38.438726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ea2f2-ab80-4b5d-9020-a05a93d4b21a None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:38.475595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c00f-ff54-45ed-ade3-07d7a55cfd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:38.476411 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c00f-ff54-45ed-ade3-07d7a55cfd68 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:38.476691 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c00f-ff54-45ed-ade3-07d7a55cfd68 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:38.476964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c00f-ff54-45ed-ade3-07d7a55cfd68 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:38.477625 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06c00f-ff54-45ed-ade3-07d7a55cfd68 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:38.479059 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06c00f-ff54-45ed-ade3-07d7a55cfd68 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-9a06c00f-ff54-45ed-ade3-07d7a55cfd68 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:38.492329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:38.493404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:38.494316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 468/932] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:38.502028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3bc1d-946f-489b-bfc1-0c8197942430 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:38.550298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:38.613319 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3bc1d-946f-489b-bfc1-0c8197942430 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:38.658490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd22f5-d012-4d83-ba1b-bc724e4d3d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:38.659161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd22f5-d012-4d83-ba1b-bc724e4d3d97 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:38.659443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd22f5-d012-4d83-ba1b-bc724e4d3d97 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:38.659747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd22f5-d012-4d83-ba1b-bc724e4d3d97 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:38.660518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd22f5-d012-4d83-ba1b-bc724e4d3d97 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:38.660830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd22f5-d012-4d83-ba1b-bc724e4d3d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:38.662219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd22f5-d012-4d83-ba1b-bc724e4d3d97 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:38.667847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 465/933] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 2 13:36:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:38.673243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c00f-ff54-45ed-ade3-07d7a55cfd68 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:38.743192 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:38.780449 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c00f-ff54-45ed-ade3-07d7a55cfd68 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:38.821848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93829f-f6b3-4ea8-9b4b-4c376bc5a656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:38.822912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93829f-f6b3-4ea8-9b4b-4c376bc5a656 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:38.823431 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93829f-f6b3-4ea8-9b4b-4c376bc5a656 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:38.824004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93829f-f6b3-4ea8-9b4b-4c376bc5a656 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:38.824925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93829f-f6b3-4ea8-9b4b-4c376bc5a656 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:38.825434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93829f-f6b3-4ea8-9b4b-4c376bc5a656 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:38.827070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93829f-f6b3-4ea8-9b4b-4c376bc5a656 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:38.833460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 469/934] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 2 13:36:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:38.834658 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a04c69-d2c9-4272-bec2-7627cd5bad21 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:38.834954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a04c69-d2c9-4272-bec2-7627cd5bad21 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:38.835239 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a04c69-d2c9-4272-bec2-7627cd5bad21 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:38.840886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 466/935] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:38.843515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e6661-5a3a-4e85-a890-3cb0266805e2 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:38.844014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e6661-5a3a-4e85-a890-3cb0266805e2 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:38.844440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e6661-5a3a-4e85-a890-3cb0266805e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:38.875613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-8e6e6661-5a3a-4e85-a890-3cb0266805e2 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:38.877530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8e6e6661-5a3a-4e85-a890-3cb0266805e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:38.959351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 470/936] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:38.983318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a04c69-d2c9-4272-bec2-7627cd5bad21 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:39.032683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca844d82-3783-4d78-8358-261175db2e1d None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.033334 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca844d82-3783-4d78-8358-261175db2e1d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.033853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca844d82-3783-4d78-8358-261175db2e1d None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.037518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 471/937] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:36:39.042547 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3272c-c27a-48eb-8f80-77d2d326769d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.043272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3272c-c27a-48eb-8f80-77d2d326769d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.043787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3272c-c27a-48eb-8f80-77d2d326769d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.064234 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d8b3272c-c27a-48eb-8f80-77d2d326769d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:39.065740 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d8b3272c-c27a-48eb-8f80-77d2d326769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:39.111429 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a04c69-d2c9-4272-bec2-7627cd5bad21 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:39.119741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:39.149476 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:39.156781 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2434f5-c7c1-420d-8c1c-2a1ee8b22e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:39.163477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2434f5-c7c1-420d-8c1c-2a1ee8b22e8f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.163477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2434f5-c7c1-420d-8c1c-2a1ee8b22e8f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.163477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2434f5-c7c1-420d-8c1c-2a1ee8b22e8f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.163820 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 472/938] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:39.174778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2434f5-c7c1-420d-8c1c-2a1ee8b22e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-6d2434f5-c7c1-420d-8c1c-2a1ee8b22e8f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:39.183426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:39.184433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:39.185470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:39.185470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:39.185470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:39.185470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:39.185470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:39.185470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:39.185470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:39.185470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:39.185470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:39.185470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:39.185470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:36:39.185470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:39.185470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 467/939] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 2 13:36:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:39.192803 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3272c-c27a-48eb-8f80-77d2d326769d None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:39.196884 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2434f5-c7c1-420d-8c1c-2a1ee8b22e8f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:39.337082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3272c-c27a-48eb-8f80-77d2d326769d None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:39.337296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2434f5-c7c1-420d-8c1c-2a1ee8b22e8f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:39.382638 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b284e-4647-433c-86ae-11294cf461ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:39.383482 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b284e-4647-433c-86ae-11294cf461ee None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.383870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b284e-4647-433c-86ae-11294cf461ee None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.384316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b284e-4647-433c-86ae-11294cf461ee None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.384809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43dc71-83ed-4b4f-b550-ab1b0f6e985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:39.385289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b284e-4647-433c-86ae-11294cf461ee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:39.385698 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b284e-4647-433c-86ae-11294cf461ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:39.386073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43dc71-83ed-4b4f-b550-ab1b0f6e985b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.386503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43dc71-83ed-4b4f-b550-ab1b0f6e985b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.386912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43dc71-83ed-4b4f-b550-ab1b0f6e985b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.387509 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b284e-4647-433c-86ae-11294cf461ee None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:39.387879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43dc71-83ed-4b4f-b550-ab1b0f6e985b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:39.390434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43dc71-83ed-4b4f-b550-ab1b0f6e985b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:39.398744 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 468/940] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 2 13:36:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-2c43dc71-83ed-4b4f-b550-ab1b0f6e985b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:39.405503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:39.406553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:39.407383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:39.407383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:39.407383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:39.407383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:39.407383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:39.407383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:39.407383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:39.407383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:39.407383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:39.407383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:39.407383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:39.407383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:39.407383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:39.407383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:39.413123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b284e-4647-433c-86ae-11294cf461ee None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:39.413214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 473/941] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 2 13:36:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:39.414512 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43dc71-83ed-4b4f-b550-ab1b0f6e985b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:39.444524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:39.497892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:39.527304 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b284e-4647-433c-86ae-11294cf461ee None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:39.567197 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517d3d6-628b-48bd-a1be-9a35714500a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:39.568057 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517d3d6-628b-48bd-a1be-9a35714500a8 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.568344 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517d3d6-628b-48bd-a1be-9a35714500a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.568615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517d3d6-628b-48bd-a1be-9a35714500a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.568836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43dc71-83ed-4b4f-b550-ab1b0f6e985b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:39.580286 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517d3d6-628b-48bd-a1be-9a35714500a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:39.581818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517d3d6-628b-48bd-a1be-9a35714500a8 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-5517d3d6-628b-48bd-a1be-9a35714500a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:39.602191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:39.603114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:39.610996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:39.610996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:39.610996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:39.610996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:39.610996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 469/942] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:39.610996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517d3d6-628b-48bd-a1be-9a35714500a8 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:39.616233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ebb5c-5f33-4a8d-b027-b1f041dcc3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:39.617116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ebb5c-5f33-4a8d-b027-b1f041dcc3cd None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.617571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ebb5c-5f33-4a8d-b027-b1f041dcc3cd None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.618041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ebb5c-5f33-4a8d-b027-b1f041dcc3cd None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.619483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ebb5c-5f33-4a8d-b027-b1f041dcc3cd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:39.620015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ebb5c-5f33-4a8d-b027-b1f041dcc3cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:39.622728 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ebb5c-5f33-4a8d-b027-b1f041dcc3cd None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:39.636083 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 474/943] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 2 13:36:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:39.638129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ebb5c-5f33-4a8d-b027-b1f041dcc3cd None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:39.710454 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:39.737194 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517d3d6-628b-48bd-a1be-9a35714500a8 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:39.780178 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ebb5c-5f33-4a8d-b027-b1f041dcc3cd None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:39.785174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad7ef4-332b-4785-a838-638367ece64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:39.785855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7ef4-332b-4785-a838-638367ece64b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.786139 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7ef4-332b-4785-a838-638367ece64b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.786417 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7ef4-332b-4785-a838-638367ece64b None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.787150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad7ef4-332b-4785-a838-638367ece64b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:39.787486 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad7ef4-332b-4785-a838-638367ece64b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:39.789021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad7ef4-332b-4785-a838-638367ece64b None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:39.803429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:39.807609 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 470/944] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:39.811563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad7ef4-332b-4785-a838-638367ece64b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:39.825919 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded04b1b-1842-4262-9536-3a92e57c97f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:39.827100 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded04b1b-1842-4262-9536-3a92e57c97f1 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.827384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded04b1b-1842-4262-9536-3a92e57c97f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.827797 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded04b1b-1842-4262-9536-3a92e57c97f1 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.828563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded04b1b-1842-4262-9536-3a92e57c97f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:39.828872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded04b1b-1842-4262-9536-3a92e57c97f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:39.830484 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded04b1b-1842-4262-9536-3a92e57c97f1 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:39.836365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 475/945] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 2 13:36:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:39.841880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded04b1b-1842-4262-9536-3a92e57c97f1 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:39.926556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad7ef4-332b-4785-a838-638367ece64b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:39.963693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0d6bc-9bad-4d21-81e5-d66b74302390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:39.965045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0d6bc-9bad-4d21-81e5-d66b74302390 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.965579 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0d6bc-9bad-4d21-81e5-d66b74302390 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.966075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0d6bc-9bad-4d21-81e5-d66b74302390 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.975153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0d6bc-9bad-4d21-81e5-d66b74302390 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:39.977043 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0d6bc-9bad-4d21-81e5-d66b74302390 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:39.980239 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-9dc0d6bc-9bad-4d21-81e5-d66b74302390 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:39.995605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:40.000058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:40.001030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:40.001030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:40.001030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:40.001030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:40.001030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:40.001030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:40.001030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:40.001030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:40.001030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:36:40.001030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:40.001030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 471/946] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 2 13:36:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:40.001617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded04b1b-1842-4262-9536-3a92e57c97f1 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.006799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0d6bc-9bad-4d21-81e5-d66b74302390 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.037508 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55eabb-0941-4b90-9756-939d3eb78ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.038187 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55eabb-0941-4b90-9756-939d3eb78ec5 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.038474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55eabb-0941-4b90-9756-939d3eb78ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.038745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55eabb-0941-4b90-9756-939d3eb78ec5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.039596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55eabb-0941-4b90-9756-939d3eb78ec5 None admin] RBAC: Adding query filter params (interface=public, service_id=d8e08726102b4fe19980bcd0c0fa8116, region_id=RegionOne) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:40.039898 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55eabb-0941-4b90-9756-939d3eb78ec5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.041321 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55eabb-0941-4b90-9756-939d3eb78ec5 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.051574 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 476/947] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 2 13:36:39 2022] GET /identity/v3/endpoints?service_id=d8e08726102b4fe19980bcd0c0fa8116&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:40.052998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55eabb-0941-4b90-9756-939d3eb78ec5 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.107813 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:40.130264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0d6bc-9bad-4d21-81e5-d66b74302390 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.168399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2da2fa-489e-4b3a-9d34-44e86a681d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.169088 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2da2fa-489e-4b3a-9d34-44e86a681d06 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.169374 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2da2fa-489e-4b3a-9d34-44e86a681d06 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.169649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2da2fa-489e-4b3a-9d34-44e86a681d06 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.170501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2da2fa-489e-4b3a-9d34-44e86a681d06 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:40.170809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2da2fa-489e-4b3a-9d34-44e86a681d06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.172320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2da2fa-489e-4b3a-9d34-44e86a681d06 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.180148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55eabb-0941-4b90-9756-939d3eb78ec5 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.197856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 472/948] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 2 13:36:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:40.200892 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2da2fa-489e-4b3a-9d34-44e86a681d06 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.244635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d689cc-d1c4-4833-a3f0-d39c4764b614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.246299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d689cc-d1c4-4833-a3f0-d39c4764b614 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.246799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d689cc-d1c4-4833-a3f0-d39c4764b614 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.247332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d689cc-d1c4-4833-a3f0-d39c4764b614 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.249597 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d689cc-d1c4-4833-a3f0-d39c4764b614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.251964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d689cc-d1c4-4833-a3f0-d39c4764b614 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.261662 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 477/949] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 2 13:36:40 2022] GET /identity/v3/services => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:40.300745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:40.393810 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2da2fa-489e-4b3a-9d34-44e86a681d06 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.466185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74819fd4-780d-48e7-b3a1-704ad09ef91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.468535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74819fd4-780d-48e7-b3a1-704ad09ef91d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.469236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74819fd4-780d-48e7-b3a1-704ad09ef91d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.469948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74819fd4-780d-48e7-b3a1-704ad09ef91d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.490867 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74819fd4-780d-48e7-b3a1-704ad09ef91d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.494132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74819fd4-780d-48e7-b3a1-704ad09ef91d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-74819fd4-780d-48e7-b3a1-704ad09ef91d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:40.530787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:40.532504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:40.533761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:40.533761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:40.533761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:40.533761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:40.533761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 473/950] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:40.539572 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d689cc-d1c4-4833-a3f0-d39c4764b614 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.662684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d689cc-d1c4-4833-a3f0-d39c4764b614 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.674842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:40.707419 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c87c7-0c15-438c-8e10-2ed3307028a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.708439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c87c7-0c15-438c-8e10-2ed3307028a2 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.708727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c87c7-0c15-438c-8e10-2ed3307028a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.709011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c87c7-0c15-438c-8e10-2ed3307028a2 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.709842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c87c7-0c15-438c-8e10-2ed3307028a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:40.710156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c87c7-0c15-438c-8e10-2ed3307028a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.711671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c87c7-0c15-438c-8e10-2ed3307028a2 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.725927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 478/951] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:40.727645 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865d376-d7b4-4c6f-9458-3eb25dade68b None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.727931 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865d376-d7b4-4c6f-9458-3eb25dade68b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.728211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865d376-d7b4-4c6f-9458-3eb25dade68b None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.729850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 474/952] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:40.733516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c87c7-0c15-438c-8e10-2ed3307028a2 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.735956 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f61504-68e3-40d0-94ed-08be0394d4cd None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.736247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f61504-68e3-40d0-94ed-08be0394d4cd None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.736552 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f61504-68e3-40d0-94ed-08be0394d4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.762145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-21f61504-68e3-40d0-94ed-08be0394d4cd None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:40.764243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-21f61504-68e3-40d0-94ed-08be0394d4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:40.862662 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c87c7-0c15-438c-8e10-2ed3307028a2 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.893592 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 475/953] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:40.922312 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f61504-68e3-40d0-94ed-08be0394d4cd None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.924457 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebf87a-e1ed-4c4f-9c0a-05d636d448cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.925570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebf87a-e1ed-4c4f-9c0a-05d636d448cd None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.926220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebf87a-e1ed-4c4f-9c0a-05d636d448cd None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.926699 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebf87a-e1ed-4c4f-9c0a-05d636d448cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.935105 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebf87a-e1ed-4c4f-9c0a-05d636d448cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.937572 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebf87a-e1ed-4c4f-9c0a-05d636d448cd None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-58ebf87a-e1ed-4c4f-9c0a-05d636d448cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:40.954759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:40.955799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:40.956726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:40.956726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:40.956726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:40.956726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:40.956726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:40.956726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:40.956726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:40.956726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:40.959433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 479/954] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:40.969658 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebf87a-e1ed-4c4f-9c0a-05d636d448cd None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.978912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:41.019046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:41.065306 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f61504-68e3-40d0-94ed-08be0394d4cd None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:41.112852 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68509b3-23a4-4b4c-9c96-b89b3e9051da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:41.114428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68509b3-23a4-4b4c-9c96-b89b3e9051da None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.115220 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68509b3-23a4-4b4c-9c96-b89b3e9051da None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.115761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68509b3-23a4-4b4c-9c96-b89b3e9051da None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.116735 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68509b3-23a4-4b4c-9c96-b89b3e9051da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:41.117913 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebf87a-e1ed-4c4f-9c0a-05d636d448cd None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:41.118650 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68509b3-23a4-4b4c-9c96-b89b3e9051da None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:41.120439 dv-cinder-826510-6-smb devstack@keystone.service[92271]: WARNING keystone.server.flask.common [None req-d68509b3-23a4-4b4c-9c96-b89b3e9051da None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 13:36:41.159007 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee514056-a8a6-4be8-a4cd-7042f244f71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:41.159713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514056-a8a6-4be8-a4cd-7042f244f71b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.160001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514056-a8a6-4be8-a4cd-7042f244f71b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.160269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514056-a8a6-4be8-a4cd-7042f244f71b None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.161204 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee514056-a8a6-4be8-a4cd-7042f244f71b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:41.161513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee514056-a8a6-4be8-a4cd-7042f244f71b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:41.162956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee514056-a8a6-4be8-a4cd-7042f244f71b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:41.184377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 480/955] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:41.189646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.sql.core [None req-d68509b3-23a4-4b4c-9c96-b89b3e9051da None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:36:41.189646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 13:36:41.189646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [parameters: {'user_id': '0b1172c2ba244fc1b37c74bb5f2c048c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 13:36:41.189646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92271) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:36:41.190365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee514056-a8a6-4be8-a4cd-7042f244f71b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-d68509b3-23a4-4b4c-9c96-b89b3e9051da None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application result.read() Jun 02 13:36:41.236440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:36:41.238190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application yield resource Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise self.value Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application session.commit() Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:36:41.240227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:36:41.241992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:36:41.245443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application result.read() Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:36:41.248980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [parameters: {'user_id': '0b1172c2ba244fc1b37c74bb5f2c048c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:41.251979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 02 13:36:41.255183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 02 13:36:41.258149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 02 13:36:41.258149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 02 13:36:41.258149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:36:41.258149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:36:41.258149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 13:36:41.258149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:41.258149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 476/956] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 2 13:36:40 2022] POST /identity/v3/users => generated 160 bytes in 321 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:41.258149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68509b3-23a4-4b4c-9c96-b89b3e9051da None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:41.329499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:41.341012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee514056-a8a6-4be8-a4cd-7042f244f71b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:41.384889 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68509b3-23a4-4b4c-9c96-b89b3e9051da None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:41.385091 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb4b34-f63a-46fb-993b-902a870d77ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:41.385932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb4b34-f63a-46fb-993b-902a870d77ff None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.386213 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb4b34-f63a-46fb-993b-902a870d77ff None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.386491 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb4b34-f63a-46fb-993b-902a870d77ff None admin] PATH_INFO: `/v3/projects/8deff8fec8614da6997a32993c033fd8/users/70f0634c146244a1a0e91f89493cc076/roles/3613773e53094931b72912bb4cd6a9df` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.387677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:41.389712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb4b34-f63a-46fb-993b-902a870d77ff None admin] RBAC: Authorizing `identity:create_grant(project_id=8deff8fec8614da6997a32993c033fd8, user_id=70f0634c146244a1a0e91f89493cc076, role_id=3613773e53094931b72912bb4cd6a9df)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:41.391963 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb4b34-f63a-46fb-993b-902a870d77ff None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:41.426314 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bb2e7-f20e-42af-98ab-06b85111fbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:41.427429 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bb2e7-f20e-42af-98ab-06b85111fbf8 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.427932 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bb2e7-f20e-42af-98ab-06b85111fbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.428416 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bb2e7-f20e-42af-98ab-06b85111fbf8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.436338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bb2e7-f20e-42af-98ab-06b85111fbf8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:41.438244 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bb2e7-f20e-42af-98ab-06b85111fbf8 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-2d3bb2e7-f20e-42af-98ab-06b85111fbf8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:41.456100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:41.457234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:41.458210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:41.458210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:41.458210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:41.458210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:41.458210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:41.458210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:41.458210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:41.458210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:41.458210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:36:41.458210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:41.459232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 477/957] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:36:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:41.461457 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa2d5f-56c2-4f3d-bf9d-a0695e8ab1f5 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.464551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa2d5f-56c2-4f3d-bf9d-a0695e8ab1f5 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.464551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa2d5f-56c2-4f3d-bf9d-a0695e8ab1f5 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.471050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 478/958] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:41 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:41.472341 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa2d5f-56c2-4f3d-bf9d-a0695e8ab1f5 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:41.573335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 481/959] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:36:41 2022] PUT /identity/v3/projects/8deff8fec8614da6997a32993c033fd8/users/70f0634c146244a1a0e91f89493cc076/roles/3613773e53094931b72912bb4cd6a9df => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:36:41.574652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96edbe2-af4a-4ad0-add8-0eed512804c3 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.574940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96edbe2-af4a-4ad0-add8-0eed512804c3 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.575223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96edbe2-af4a-4ad0-add8-0eed512804c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.608307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d96edbe2-af4a-4ad0-add8-0eed512804c3 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:41.613752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d96edbe2-af4a-4ad0-add8-0eed512804c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:41.621497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa2d5f-56c2-4f3d-bf9d-a0695e8ab1f5 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:41.663373 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1658f2-2b7f-41f3-9bd4-5e812de71516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:41.664123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1658f2-2b7f-41f3-9bd4-5e812de71516 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.664453 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1658f2-2b7f-41f3-9bd4-5e812de71516 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.669248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1658f2-2b7f-41f3-9bd4-5e812de71516 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.669248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1658f2-2b7f-41f3-9bd4-5e812de71516 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:41.669248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1658f2-2b7f-41f3-9bd4-5e812de71516 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:41.669248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1658f2-2b7f-41f3-9bd4-5e812de71516 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:41.711838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 479/960] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 2 13:36:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:41.713304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 482/961] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:41.736846 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1658f2-2b7f-41f3-9bd4-5e812de71516 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:41.764842 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:41.858580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1658f2-2b7f-41f3-9bd4-5e812de71516 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:41.899362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2418c-11c2-4a4b-ac07-249085219cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:41.900077 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2418c-11c2-4a4b-ac07-249085219cfb None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.900357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2418c-11c2-4a4b-ac07-249085219cfb None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.900623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2418c-11c2-4a4b-ac07-249085219cfb None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.901367 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2418c-11c2-4a4b-ac07-249085219cfb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:41.902757 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2418c-11c2-4a4b-ac07-249085219cfb None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:42.009808 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 480/962] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 2 13:36:41 2022] POST /identity/v3/services => generated 242 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:42.776840 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45f9d4-0bc4-4270-a636-64b6e543e565 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:42.777406 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45f9d4-0bc4-4270-a636-64b6e543e565 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:42.777406 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45f9d4-0bc4-4270-a636-64b6e543e565 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:42.779087 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 483/963] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:42.785461 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357a72-cbe1-423b-be7f-c86e21218fc4 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:42.786099 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357a72-cbe1-423b-be7f-c86e21218fc4 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:42.786099 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357a72-cbe1-423b-be7f-c86e21218fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:42.804498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-cf357a72-cbe1-423b-be7f-c86e21218fc4 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:42.805995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-cf357a72-cbe1-423b-be7f-c86e21218fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:42.903605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 481/964] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:42.921322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45f9d4-0bc4-4270-a636-64b6e543e565 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:43.006564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:43.028587 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45f9d4-0bc4-4270-a636-64b6e543e565 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:43.067476 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba06c85-fcb7-425a-b203-59770372790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:43.067476 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba06c85-fcb7-425a-b203-59770372790f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:43.067476 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba06c85-fcb7-425a-b203-59770372790f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:43.067476 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba06c85-fcb7-425a-b203-59770372790f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:43.067903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba06c85-fcb7-425a-b203-59770372790f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:43.069570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba06c85-fcb7-425a-b203-59770372790f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-eba06c85-fcb7-425a-b203-59770372790f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:43.083474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:43.084548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:43.085416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:43.085416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:43.085416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:43.085416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:43.085416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:43.085416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:43.085416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:43.085416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:43.085416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:43.085416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:43.085416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:43.085416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:43.085416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:43.085416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:43.091495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 484/965] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 2 13:36:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:43.091639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf357a72-cbe1-423b-be7f-c86e21218fc4 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:43.098793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:43.206055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf357a72-cbe1-423b-be7f-c86e21218fc4 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:43.241084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910558f-f9f9-4eb1-b0d4-74ecb62f7da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:43.241661 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910558f-f9f9-4eb1-b0d4-74ecb62f7da0 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:43.241943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910558f-f9f9-4eb1-b0d4-74ecb62f7da0 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:43.242218 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910558f-f9f9-4eb1-b0d4-74ecb62f7da0 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:43.242940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910558f-f9f9-4eb1-b0d4-74ecb62f7da0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:43.243234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910558f-f9f9-4eb1-b0d4-74ecb62f7da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:43.244641 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910558f-f9f9-4eb1-b0d4-74ecb62f7da0 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:43.250862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 482/966] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 2 13:36:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:43.258293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba06c85-fcb7-425a-b203-59770372790f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:43.369614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba06c85-fcb7-425a-b203-59770372790f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:43.406003 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d40da-e0cc-4a81-a2a9-f1dfa0f2f33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:43.406675 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d40da-e0cc-4a81-a2a9-f1dfa0f2f33c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:43.406956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d40da-e0cc-4a81-a2a9-f1dfa0f2f33c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:43.407281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d40da-e0cc-4a81-a2a9-f1dfa0f2f33c None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:43.408038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d40da-e0cc-4a81-a2a9-f1dfa0f2f33c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:43.408391 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d40da-e0cc-4a81-a2a9-f1dfa0f2f33c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:43.409759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d40da-e0cc-4a81-a2a9-f1dfa0f2f33c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:43.419296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 485/967] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 2 13:36:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:43.420663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910558f-f9f9-4eb1-b0d4-74ecb62f7da0 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:43.500462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:43.531069 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910558f-f9f9-4eb1-b0d4-74ecb62f7da0 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:43.567578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4eb90-d83e-45b0-8f66-483b719503a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:43.568237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4eb90-d83e-45b0-8f66-483b719503a6 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:43.568521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4eb90-d83e-45b0-8f66-483b719503a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:43.568799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4eb90-d83e-45b0-8f66-483b719503a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:43.569534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4eb90-d83e-45b0-8f66-483b719503a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:43.570904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4eb90-d83e-45b0-8f66-483b719503a6 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:43.654994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 483/968] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 2 13:36:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:43.947236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928d106-9340-4aa5-b22e-fda582b713d7 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:43.947826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928d106-9340-4aa5-b22e-fda582b713d7 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:43.947826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928d106-9340-4aa5-b22e-fda582b713d7 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:43.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 486/969] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:43.954630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e2357-ec79-4cb5-89de-33ad626ca3d8 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:43.955023 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e2357-ec79-4cb5-89de-33ad626ca3d8 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:43.955211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e2357-ec79-4cb5-89de-33ad626ca3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:43.972999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-c29e2357-ec79-4cb5-89de-33ad626ca3d8 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:43.974245 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c29e2357-ec79-4cb5-89de-33ad626ca3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:44.052262 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 484/970] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:44.075473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928d106-9340-4aa5-b22e-fda582b713d7 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.087261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:44.180692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928d106-9340-4aa5-b22e-fda582b713d7 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.214842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a05d4-beaa-4cde-aa3c-115bbea77b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.215148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a05d4-beaa-4cde-aa3c-115bbea77b7f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.215407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a05d4-beaa-4cde-aa3c-115bbea77b7f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.215708 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a05d4-beaa-4cde-aa3c-115bbea77b7f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.227561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a05d4-beaa-4cde-aa3c-115bbea77b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-975a05d4-beaa-4cde-aa3c-115bbea77b7f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:44.236452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:44.237388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:44.238242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:44.238242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:44.238242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:44.238242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:44.238242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:44.238242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:44.238242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:44.238242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:44.238242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:44.238242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:44.238242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:36:44.238242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:44.239528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 487/971] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 2 13:36:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:44.243769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e2357-ec79-4cb5-89de-33ad626ca3d8 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.305255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:44.320903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdbbcb-57ba-495e-b74d-14165b449df0 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.321195 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdbbcb-57ba-495e-b74d-14165b449df0 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.321471 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdbbcb-57ba-495e-b74d-14165b449df0 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.322982 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 488/972] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:36:44.328638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e63a5-8ccd-43e6-8644-f649029e5fdf None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.328905 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e63a5-8ccd-43e6-8644-f649029e5fdf None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.329189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e63a5-8ccd-43e6-8644-f649029e5fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.347183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d53e63a5-8ccd-43e6-8644-f649029e5fdf None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:44.348150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d53e63a5-8ccd-43e6-8644-f649029e5fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:44.356284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e2357-ec79-4cb5-89de-33ad626ca3d8 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.392639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f09e-45d9-48bd-9f4e-4101476d60d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.393312 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f09e-45d9-48bd-9f4e-4101476d60d9 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.393594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f09e-45d9-48bd-9f4e-4101476d60d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.393867 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f09e-45d9-48bd-9f4e-4101476d60d9 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.394610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3f09e-45d9-48bd-9f4e-4101476d60d9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:44.395355 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3f09e-45d9-48bd-9f4e-4101476d60d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:44.396763 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3f09e-45d9-48bd-9f4e-4101476d60d9 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:44.406531 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 485/973] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 2 13:36:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:44.411859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f09e-45d9-48bd-9f4e-4101476d60d9 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.419243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:44.426017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 489/974] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:44.448401 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e63a5-8ccd-43e6-8644-f649029e5fdf None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.519332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f09e-45d9-48bd-9f4e-4101476d60d9 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.534319 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:44.555535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e63a5-8ccd-43e6-8644-f649029e5fdf None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.555961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560d940-0f9c-40fe-8a2b-78b8bad8097c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.556753 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560d940-0f9c-40fe-8a2b-78b8bad8097c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.557042 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560d940-0f9c-40fe-8a2b-78b8bad8097c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.558761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560d940-0f9c-40fe-8a2b-78b8bad8097c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.569359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560d940-0f9c-40fe-8a2b-78b8bad8097c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:44.570825 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560d940-0f9c-40fe-8a2b-78b8bad8097c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-9560d940-0f9c-40fe-8a2b-78b8bad8097c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:44.589491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:44.590408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:44.591284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:44.591284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:44.591284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:44.591284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:44.591284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 486/975] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:44.595433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdc681-17a6-41b2-a47a-0dcb3ac2ed91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.596255 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc681-17a6-41b2-a47a-0dcb3ac2ed91 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.596539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc681-17a6-41b2-a47a-0dcb3ac2ed91 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.596814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc681-17a6-41b2-a47a-0dcb3ac2ed91 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.596923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560d940-0f9c-40fe-8a2b-78b8bad8097c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.597472 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdc681-17a6-41b2-a47a-0dcb3ac2ed91 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:44.598865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdc681-17a6-41b2-a47a-0dcb3ac2ed91 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-09fdc681-17a6-41b2-a47a-0dcb3ac2ed91 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:44.611603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:44.618595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:44.619802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 490/976] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:44.622082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdc681-17a6-41b2-a47a-0dcb3ac2ed91 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.693909 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:44.702388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560d940-0f9c-40fe-8a2b-78b8bad8097c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.737480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c2cdf-83b1-4d3a-a788-da31132dedc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.738147 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c2cdf-83b1-4d3a-a788-da31132dedc7 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.738436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c2cdf-83b1-4d3a-a788-da31132dedc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.738710 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c2cdf-83b1-4d3a-a788-da31132dedc7 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.739418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c2cdf-83b1-4d3a-a788-da31132dedc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:44.739755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c2cdf-83b1-4d3a-a788-da31132dedc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:44.741114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c2cdf-83b1-4d3a-a788-da31132dedc7 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:44.746766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdc681-17a6-41b2-a47a-0dcb3ac2ed91 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.753983 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 487/977] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:44.759292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c2cdf-83b1-4d3a-a788-da31132dedc7 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.785861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259607c-0e00-48f2-a9b5-d96cdbe0df10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.786205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259607c-0e00-48f2-a9b5-d96cdbe0df10 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.786470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259607c-0e00-48f2-a9b5-d96cdbe0df10 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.786743 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259607c-0e00-48f2-a9b5-d96cdbe0df10 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.787495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259607c-0e00-48f2-a9b5-d96cdbe0df10 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:44.787815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259607c-0e00-48f2-a9b5-d96cdbe0df10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:44.789031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:44.789230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259607c-0e00-48f2-a9b5-d96cdbe0df10 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:44.799495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 491/978] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 2 13:36:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:44.800864 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259607c-0e00-48f2-a9b5-d96cdbe0df10 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.865539 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c2cdf-83b1-4d3a-a788-da31132dedc7 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.903162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b85980-d5ca-4a37-87ed-d659f25ec2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.904039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b85980-d5ca-4a37-87ed-d659f25ec2c3 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.904320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b85980-d5ca-4a37-87ed-d659f25ec2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.904628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b85980-d5ca-4a37-87ed-d659f25ec2c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.910564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259607c-0e00-48f2-a9b5-d96cdbe0df10 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.912235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b85980-d5ca-4a37-87ed-d659f25ec2c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:44.913670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b85980-d5ca-4a37-87ed-d659f25ec2c3 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-84b85980-d5ca-4a37-87ed-d659f25ec2c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:44.929193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:44.930313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:44.931265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:44.931265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:44.931265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:44.931265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:44.931265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:44.931265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:44.931265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:44.931265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:44.931265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:36:44.931265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:44.931265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 488/979] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 2 13:36:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:44.936616 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b85980-d5ca-4a37-87ed-d659f25ec2c3 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.939700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:44.950521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35930f51-5b9e-4b51-8989-bbffde079295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.962681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930f51-5b9e-4b51-8989-bbffde079295 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.962681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930f51-5b9e-4b51-8989-bbffde079295 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.962681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930f51-5b9e-4b51-8989-bbffde079295 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.962681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930f51-5b9e-4b51-8989-bbffde079295 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:44.962681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930f51-5b9e-4b51-8989-bbffde079295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:44.962681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930f51-5b9e-4b51-8989-bbffde079295 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:44.963203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 492/980] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 2 13:36:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:44.965352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35930f51-5b9e-4b51-8989-bbffde079295 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:45.037834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:45.052802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b85980-d5ca-4a37-87ed-d659f25ec2c3 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.070397 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35930f51-5b9e-4b51-8989-bbffde079295 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.087157 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863f4b2-3935-4529-9862-526d46c82f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.088040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863f4b2-3935-4529-9862-526d46c82f03 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.088492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863f4b2-3935-4529-9862-526d46c82f03 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.089142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863f4b2-3935-4529-9862-526d46c82f03 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.090053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863f4b2-3935-4529-9862-526d46c82f03 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:45.090370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863f4b2-3935-4529-9862-526d46c82f03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.091837 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863f4b2-3935-4529-9862-526d46c82f03 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.108441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75528944-2b24-49dd-a2fe-934f9ec17755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.109098 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75528944-2b24-49dd-a2fe-934f9ec17755 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.109385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75528944-2b24-49dd-a2fe-934f9ec17755 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.109878 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75528944-2b24-49dd-a2fe-934f9ec17755 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.110011 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 489/981] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 2 13:36:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:45.110447 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75528944-2b24-49dd-a2fe-934f9ec17755 None admin] RBAC: Adding query filter params (interface=public, service_id=74a4036b924a44fb9255e25d9b285016, region_id=RegionOne) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:45.110779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75528944-2b24-49dd-a2fe-934f9ec17755 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.112140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75528944-2b24-49dd-a2fe-934f9ec17755 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.115828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863f4b2-3935-4529-9862-526d46c82f03 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:45.122246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 493/982] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 2 13:36:44 2022] GET /identity/v3/endpoints?service_id=74a4036b924a44fb9255e25d9b285016&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:45.123096 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75528944-2b24-49dd-a2fe-934f9ec17755 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:45.187027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:45.222534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863f4b2-3935-4529-9862-526d46c82f03 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.240032 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75528944-2b24-49dd-a2fe-934f9ec17755 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.265050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3caacc-e09c-4a84-83a3-55856e6912cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.265706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3caacc-e09c-4a84-83a3-55856e6912cd None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.265987 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3caacc-e09c-4a84-83a3-55856e6912cd None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.266258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3caacc-e09c-4a84-83a3-55856e6912cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.281859 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2335f4b-6515-438b-af6c-0bb125e37850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.282541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335f4b-6515-438b-af6c-0bb125e37850 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.282824 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335f4b-6515-438b-af6c-0bb125e37850 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.283402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335f4b-6515-438b-af6c-0bb125e37850 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.284123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2335f4b-6515-438b-af6c-0bb125e37850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.285504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2335f4b-6515-438b-af6c-0bb125e37850 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.285727 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:45.294757 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 494/983] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 2 13:36:45 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:36:45.353637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3caacc-e09c-4a84-83a3-55856e6912cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.355130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3caacc-e09c-4a84-83a3-55856e6912cd None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.465843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 490/984] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:45 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:36:45.472233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2335f4b-6515-438b-af6c-0bb125e37850 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:45.580904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2335f4b-6515-438b-af6c-0bb125e37850 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.598865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:45.618469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2f7f3-1983-4cb0-9898-f9e061a9fedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.619287 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f7f3-1983-4cb0-9898-f9e061a9fedb None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.619592 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f7f3-1983-4cb0-9898-f9e061a9fedb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.619867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f7f3-1983-4cb0-9898-f9e061a9fedb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.633551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2f7f3-1983-4cb0-9898-f9e061a9fedb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.635052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2f7f3-1983-4cb0-9898-f9e061a9fedb None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-a4f2f7f3-1983-4cb0-9898-f9e061a9fedb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:45.653868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:45.656058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:45.656945 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:45.656945 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:45.656945 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:45.656945 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:45.656945 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 495/985] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:45.662807 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3caacc-e09c-4a84-83a3-55856e6912cd None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:45.710202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:45.766244 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3caacc-e09c-4a84-83a3-55856e6912cd None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.800880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7612f39-ad5a-4a4f-bf17-a3b251e77845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.801689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7612f39-ad5a-4a4f-bf17-a3b251e77845 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.802071 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7612f39-ad5a-4a4f-bf17-a3b251e77845 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.802444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7612f39-ad5a-4a4f-bf17-a3b251e77845 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.803266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7612f39-ad5a-4a4f-bf17-a3b251e77845 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:45.803699 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7612f39-ad5a-4a4f-bf17-a3b251e77845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.805158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7612f39-ad5a-4a4f-bf17-a3b251e77845 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.818074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 491/986] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:45.824070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2f7f3-1983-4cb0-9898-f9e061a9fedb None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:45.929064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2f7f3-1983-4cb0-9898-f9e061a9fedb None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.951319 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c81268-926a-4a3c-a6d6-50a995a8f3e4 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.952193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c81268-926a-4a3c-a6d6-50a995a8f3e4 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.952378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c81268-926a-4a3c-a6d6-50a995a8f3e4 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.954028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 492/987] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:45.959119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceec23-f32e-47f1-b140-3a34930fe5c0 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.959409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceec23-f32e-47f1-b140-3a34930fe5c0 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.959718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceec23-f32e-47f1-b140-3a34930fe5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.965518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be90fb-90db-45c1-8d46-bd7435d01dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.966322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be90fb-90db-45c1-8d46-bd7435d01dba None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.966598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be90fb-90db-45c1-8d46-bd7435d01dba None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.966873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be90fb-90db-45c1-8d46-bd7435d01dba None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.974577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be90fb-90db-45c1-8d46-bd7435d01dba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.976047 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be90fb-90db-45c1-8d46-bd7435d01dba None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.977142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-e5ceec23-f32e-47f1-b140-3a34930fe5c0 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:45.978328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e5ceec23-f32e-47f1-b140-3a34930fe5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-39be90fb-90db-45c1-8d46-bd7435d01dba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:45.990557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:45.991671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:45.992582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:45.992582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:45.992582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:45.992582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:45.992582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:45.992582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:45.992582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:45.992582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:45.992582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 496/988] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:45.997897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be90fb-90db-45c1-8d46-bd7435d01dba None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:46.032445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:46.052033 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 493/989] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:46.074395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ceec23-f32e-47f1-b140-3a34930fe5c0 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:46.104900 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be90fb-90db-45c1-8d46-bd7435d01dba None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:46.108518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:46.142469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8702f-ff32-485a-ab77-0fe145696954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:46.143130 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8702f-ff32-485a-ab77-0fe145696954 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:46.143414 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8702f-ff32-485a-ab77-0fe145696954 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:46.143721 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8702f-ff32-485a-ab77-0fe145696954 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:46.144505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8702f-ff32-485a-ab77-0fe145696954 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:46.144810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8702f-ff32-485a-ab77-0fe145696954 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:46.146245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8702f-ff32-485a-ab77-0fe145696954 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:46.158918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 497/990] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:46.164569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8702f-ff32-485a-ab77-0fe145696954 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:46.180197 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ceec23-f32e-47f1-b140-3a34930fe5c0 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:46.217599 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003c52d-195d-4a84-9db2-d61655d56378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:46.218759 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003c52d-195d-4a84-9db2-d61655d56378 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:46.219254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003c52d-195d-4a84-9db2-d61655d56378 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:46.219744 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003c52d-195d-4a84-9db2-d61655d56378 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:46.220600 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003c52d-195d-4a84-9db2-d61655d56378 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:46.222178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003c52d-195d-4a84-9db2-d61655d56378 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-b003c52d-195d-4a84-9db2-d61655d56378 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:46.234821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:46.236073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:46.237108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:46.237108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:46.237108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:46.237108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:46.237108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:46.237108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:46.237108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:46.237108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:46.237108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:46.237108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:46.237108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:46.237108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:46.237108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:46.237108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:46.238782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 494/991] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 2 13:36:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:46.244316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003c52d-195d-4a84-9db2-d61655d56378 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:46.265615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:46.277692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8702f-ff32-485a-ab77-0fe145696954 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:46.315269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af58fa-ea2c-4d2b-87c4-1a556c9bf58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:46.316460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af58fa-ea2c-4d2b-87c4-1a556c9bf58c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:46.316757 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af58fa-ea2c-4d2b-87c4-1a556c9bf58c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:46.317362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af58fa-ea2c-4d2b-87c4-1a556c9bf58c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:46.318597 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af58fa-ea2c-4d2b-87c4-1a556c9bf58c None admin] RBAC: Adding query filter params (role.id=3613773e53094931b72912bb4cd6a9df, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=70f0634c146244a1a0e91f89493cc076) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:46.318815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af58fa-ea2c-4d2b-87c4-1a556c9bf58c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:46.321033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af58fa-ea2c-4d2b-87c4-1a556c9bf58c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:46.330586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 498/992] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:46 2022] GET /identity/v3/role_assignments?user.id=70f0634c146244a1a0e91f89493cc076&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=3613773e53094931b72912bb4cd6a9df => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:46.359141 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:46.363486 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003c52d-195d-4a84-9db2-d61655d56378 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:46.405027 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd4e53-7469-4623-b90a-64124925ba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:46.406149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd4e53-7469-4623-b90a-64124925ba5e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:46.406573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd4e53-7469-4623-b90a-64124925ba5e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:46.406996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd4e53-7469-4623-b90a-64124925ba5e None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:46.407901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd4e53-7469-4623-b90a-64124925ba5e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:46.408377 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd4e53-7469-4623-b90a-64124925ba5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:46.409928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd4e53-7469-4623-b90a-64124925ba5e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:46.420551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 495/993] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 2 13:36:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:46.422137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af58fa-ea2c-4d2b-87c4-1a556c9bf58c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:46.540629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af58fa-ea2c-4d2b-87c4-1a556c9bf58c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:46.579155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e009096-b9fd-4df6-941b-d0690c4abaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:46.579856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e009096-b9fd-4df6-941b-d0690c4abaac None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:46.580136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e009096-b9fd-4df6-941b-d0690c4abaac None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:46.580410 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e009096-b9fd-4df6-941b-d0690c4abaac None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:46.581118 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e009096-b9fd-4df6-941b-d0690c4abaac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:46.581418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e009096-b9fd-4df6-941b-d0690c4abaac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:46.582787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e009096-b9fd-4df6-941b-d0690c4abaac None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:46.588704 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 499/994] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 2 13:36:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:46.594964 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd4e53-7469-4623-b90a-64124925ba5e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:46.699560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd4e53-7469-4623-b90a-64124925ba5e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:46.735031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6959b3-eb9e-4892-acd0-87778dcf9588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:46.735721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6959b3-eb9e-4892-acd0-87778dcf9588 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:46.736001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6959b3-eb9e-4892-acd0-87778dcf9588 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:46.736326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6959b3-eb9e-4892-acd0-87778dcf9588 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:46.737174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6959b3-eb9e-4892-acd0-87778dcf9588 None admin] RBAC: Adding query filter params (interface=admin, service_id=d8e08726102b4fe19980bcd0c0fa8116, region_id=RegionOne) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:46.737616 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6959b3-eb9e-4892-acd0-87778dcf9588 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:46.738979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6959b3-eb9e-4892-acd0-87778dcf9588 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:46.749452 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 496/995] 10.222.0.39 () {56 vars in 1249 bytes} [Thu Jun 2 13:36:46 2022] GET /identity/v3/endpoints?service_id=d8e08726102b4fe19980bcd0c0fa8116&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:46.750671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e009096-b9fd-4df6-941b-d0690c4abaac None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:46.770364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:46.853892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e009096-b9fd-4df6-941b-d0690c4abaac None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:46.888134 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d60c8-fd21-4adf-a2fc-ea6468dfbf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:46.888794 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d60c8-fd21-4adf-a2fc-ea6468dfbf07 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:46.889124 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d60c8-fd21-4adf-a2fc-ea6468dfbf07 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:46.889399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d60c8-fd21-4adf-a2fc-ea6468dfbf07 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:46.890070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d60c8-fd21-4adf-a2fc-ea6468dfbf07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:46.891557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d60c8-fd21-4adf-a2fc-ea6468dfbf07 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:46.903479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 500/996] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 2 13:36:46 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:47.590186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4064d-fea7-4024-996a-a95fe7fa2b65 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:47.590762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4064d-fea7-4024-996a-a95fe7fa2b65 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:47.590762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4064d-fea7-4024-996a-a95fe7fa2b65 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:47.592729 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 497/997] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:47.597939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be9ca-d30f-4c73-961a-3a278d6b42a4 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:47.607241 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be9ca-d30f-4c73-961a-3a278d6b42a4 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:47.607241 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be9ca-d30f-4c73-961a-3a278d6b42a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:47.616393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-401be9ca-d30f-4c73-961a-3a278d6b42a4 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:47.617599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-401be9ca-d30f-4c73-961a-3a278d6b42a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:47.690045 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 501/998] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:47.713687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4064d-fea7-4024-996a-a95fe7fa2b65 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:47.741671 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:47.819724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4064d-fea7-4024-996a-a95fe7fa2b65 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:47.854994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58722d-13ae-4df0-86f3-357db4568f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:47.855739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58722d-13ae-4df0-86f3-357db4568f43 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:47.856026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58722d-13ae-4df0-86f3-357db4568f43 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:47.856303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58722d-13ae-4df0-86f3-357db4568f43 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:47.856959 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58722d-13ae-4df0-86f3-357db4568f43 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:47.858536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58722d-13ae-4df0-86f3-357db4568f43 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-5c58722d-13ae-4df0-86f3-357db4568f43 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:47.870615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:47.872261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:47.873219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:47.873219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:47.873219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:47.873219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:47.873219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:47.873219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:47.873219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:47.873219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:47.873219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:47.873219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:47.873219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:47.873219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:47.873219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:36:47.873219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:47.875208 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 498/999] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:47.878710 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401be9ca-d30f-4c73-961a-3a278d6b42a4 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:47.894184 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:47.995073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401be9ca-d30f-4c73-961a-3a278d6b42a4 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:48.030365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8107e0-a856-41c4-9201-1fd271e2f4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:48.031031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8107e0-a856-41c4-9201-1fd271e2f4c3 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:48.031318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8107e0-a856-41c4-9201-1fd271e2f4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:48.031638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8107e0-a856-41c4-9201-1fd271e2f4c3 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:48.032335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8107e0-a856-41c4-9201-1fd271e2f4c3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:48.032643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8107e0-a856-41c4-9201-1fd271e2f4c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:48.034073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8107e0-a856-41c4-9201-1fd271e2f4c3 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:48.043853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 502/1000] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 2 13:36:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:48.045062 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58722d-13ae-4df0-86f3-357db4568f43 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:48.142174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:48.152607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58722d-13ae-4df0-86f3-357db4568f43 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:48.188325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba236392-b7f4-4b3f-baf4-9763f2307375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:48.189170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba236392-b7f4-4b3f-baf4-9763f2307375 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:48.189538 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba236392-b7f4-4b3f-baf4-9763f2307375 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:48.189885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba236392-b7f4-4b3f-baf4-9763f2307375 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:48.190669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba236392-b7f4-4b3f-baf4-9763f2307375 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:48.191049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba236392-b7f4-4b3f-baf4-9763f2307375 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:48.192579 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba236392-b7f4-4b3f-baf4-9763f2307375 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:48.203108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 499/1001] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 2 13:36:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:48.204381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8107e0-a856-41c4-9201-1fd271e2f4c3 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:48.292847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:48.315837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8107e0-a856-41c4-9201-1fd271e2f4c3 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:48.357289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f830326-d4b2-4b16-b282-8b6fdddd9b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:48.357976 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f830326-d4b2-4b16-b282-8b6fdddd9b40 None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:48.358263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f830326-d4b2-4b16-b282-8b6fdddd9b40 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:48.358537 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f830326-d4b2-4b16-b282-8b6fdddd9b40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:48.359439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f830326-d4b2-4b16-b282-8b6fdddd9b40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:48.360916 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f830326-d4b2-4b16-b282-8b6fdddd9b40 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:48.506010 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 503/1002] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 2 13:36:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:48.701720 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ed007-be11-4a86-a976-85ef939594ca None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:48.702274 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ed007-be11-4a86-a976-85ef939594ca None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:48.702274 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ed007-be11-4a86-a976-85ef939594ca None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:48.703954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 500/1003] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:36:48.710079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf129ca-dc0a-40e1-b7ac-2704ec182131 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:48.710823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf129ca-dc0a-40e1-b7ac-2704ec182131 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:48.710989 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf129ca-dc0a-40e1-b7ac-2704ec182131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:48.729094 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-caf129ca-dc0a-40e1-b7ac-2704ec182131 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:48.730321 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-caf129ca-dc0a-40e1-b7ac-2704ec182131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:48.811051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 504/1004] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:48 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:48.834200 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ed007-be11-4a86-a976-85ef939594ca None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:48.943741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ed007-be11-4a86-a976-85ef939594ca None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:48.979551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6efa1-5b06-4cd6-8191-4f81650b86cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:48.980354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6efa1-5b06-4cd6-8191-4f81650b86cd None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:48.980628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6efa1-5b06-4cd6-8191-4f81650b86cd None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:48.980900 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6efa1-5b06-4cd6-8191-4f81650b86cd None admin] PATH_INFO: `/v3/services/image` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:48.981551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6efa1-5b06-4cd6-8191-4f81650b86cd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:48.983112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6efa1-5b06-4cd6-8191-4f81650b86cd None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-dda6efa1-5b06-4cd6-8191-4f81650b86cd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:48.995096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:48.996605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:48.997493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 501/1005] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jun 2 13:36:48 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:49.002591 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf129ca-dc0a-40e1-b7ac-2704ec182131 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:49.064182 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:49.105965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf129ca-dc0a-40e1-b7ac-2704ec182131 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:49.143023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206d896-ac65-455a-aac4-4a2a5ec488b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:49.143725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d896-ac65-455a-aac4-4a2a5ec488b7 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:49.144009 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d896-ac65-455a-aac4-4a2a5ec488b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:49.144283 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d896-ac65-455a-aac4-4a2a5ec488b7 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:49.145069 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206d896-ac65-455a-aac4-4a2a5ec488b7 None admin] RBAC: Adding query filter params (name=image) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:49.145386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206d896-ac65-455a-aac4-4a2a5ec488b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:49.146754 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206d896-ac65-455a-aac4-4a2a5ec488b7 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:49.152019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 505/1006] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:49.157797 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6efa1-5b06-4cd6-8191-4f81650b86cd None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:49.178189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:49.259828 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f82a4-9b30-4564-beb4-5cd2094a7ba5 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:49.260132 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f82a4-9b30-4564-beb4-5cd2094a7ba5 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:49.260394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f82a4-9b30-4564-beb4-5cd2094a7ba5 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:49.262030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 506/1007] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:36:49.267875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb64e6d-4de1-41e7-aad0-b4cff7bfbf97 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:49.267875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb64e6d-4de1-41e7-aad0-b4cff7bfbf97 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:49.268145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6efa1-5b06-4cd6-8191-4f81650b86cd None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:49.268240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb64e6d-4de1-41e7-aad0-b4cff7bfbf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:49.288986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-cbb64e6d-4de1-41e7-aad0-b4cff7bfbf97 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:49.290294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-cbb64e6d-4de1-41e7-aad0-b4cff7bfbf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:49.307008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e1f7e-873a-4078-a762-7c00bb696e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:49.307703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e1f7e-873a-4078-a762-7c00bb696e86 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:49.308097 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e1f7e-873a-4078-a762-7c00bb696e86 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:49.308374 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e1f7e-873a-4078-a762-7c00bb696e86 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:49.309196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e1f7e-873a-4078-a762-7c00bb696e86 None admin] RBAC: Adding query filter params (type=image) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:49.309501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e1f7e-873a-4078-a762-7c00bb696e86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:49.311419 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e1f7e-873a-4078-a762-7c00bb696e86 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:49.327622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 502/1008] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:49.369260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 507/1009] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:49 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:49.393378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e1f7e-873a-4078-a762-7c00bb696e86 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:49.488676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:49.509280 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e1f7e-873a-4078-a762-7c00bb696e86 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:49.547973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319a191-b0a9-4ef1-9e8f-d15af298b582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:49.549034 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319a191-b0a9-4ef1-9e8f-d15af298b582 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:49.549310 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319a191-b0a9-4ef1-9e8f-d15af298b582 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:49.559897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319a191-b0a9-4ef1-9e8f-d15af298b582 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:49.559897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319a191-b0a9-4ef1-9e8f-d15af298b582 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:49.559897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319a191-b0a9-4ef1-9e8f-d15af298b582 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-3319a191-b0a9-4ef1-9e8f-d15af298b582 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:49.564700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:49.566039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:49.567001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 503/1010] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 2 13:36:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:49.574501 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb64e6d-4de1-41e7-aad0-b4cff7bfbf97 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:49.631422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:49.678844 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb64e6d-4de1-41e7-aad0-b4cff7bfbf97 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:49.714252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187c6f5-884a-4ad9-a782-86a2c5abe069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:49.714905 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187c6f5-884a-4ad9-a782-86a2c5abe069 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:49.715181 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187c6f5-884a-4ad9-a782-86a2c5abe069 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:49.715470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187c6f5-884a-4ad9-a782-86a2c5abe069 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:49.716194 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187c6f5-884a-4ad9-a782-86a2c5abe069 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:49.716502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187c6f5-884a-4ad9-a782-86a2c5abe069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:49.717912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187c6f5-884a-4ad9-a782-86a2c5abe069 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:49.722906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 508/1011] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 2 13:36:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:49.728822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319a191-b0a9-4ef1-9e8f-d15af298b582 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:49.845188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319a191-b0a9-4ef1-9e8f-d15af298b582 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:49.883372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf7d15-3d91-4a17-ad97-e866609496b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:49.883993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf7d15-3d91-4a17-ad97-e866609496b2 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:49.884277 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf7d15-3d91-4a17-ad97-e866609496b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:49.884552 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf7d15-3d91-4a17-ad97-e866609496b2 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:49.885262 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf7d15-3d91-4a17-ad97-e866609496b2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:49.885566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf7d15-3d91-4a17-ad97-e866609496b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:49.886939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf7d15-3d91-4a17-ad97-e866609496b2 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:49.897047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 504/1012] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 2 13:36:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:49.898072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187c6f5-884a-4ad9-a782-86a2c5abe069 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:50.001920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187c6f5-884a-4ad9-a782-86a2c5abe069 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:50.022860 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:50.044393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3891b-d7d1-4489-a954-44f61ab1662b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:50.045805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3891b-d7d1-4489-a954-44f61ab1662b None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:50.046123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3891b-d7d1-4489-a954-44f61ab1662b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:50.046400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3891b-d7d1-4489-a954-44f61ab1662b None admin] PATH_INFO: `/v3/endpoints` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:50.047203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3891b-d7d1-4489-a954-44f61ab1662b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:50.048621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3891b-d7d1-4489-a954-44f61ab1662b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:50.150763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 509/1013] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 2 13:36:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:50.936742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f2a1a-66bf-4260-a630-81c431f394d8 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:50.937384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f2a1a-66bf-4260-a630-81c431f394d8 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:50.937384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f2a1a-66bf-4260-a630-81c431f394d8 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:50.938790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 505/1014] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:50.944560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e8150-6aac-4067-b5b2-2a8d504baf4d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:50.945023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e8150-6aac-4067-b5b2-2a8d504baf4d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:50.945120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e8150-6aac-4067-b5b2-2a8d504baf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:50.962244 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-432e8150-6aac-4067-b5b2-2a8d504baf4d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:50.963437 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-432e8150-6aac-4067-b5b2-2a8d504baf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:51.048286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 510/1015] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:50 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:51.071604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f2a1a-66bf-4260-a630-81c431f394d8 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.084925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:51.175151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f2a1a-66bf-4260-a630-81c431f394d8 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:51.208902 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c559260-96d0-4670-8fe4-2513107c6fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:51.209639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c559260-96d0-4670-8fe4-2513107c6fbc None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.209921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c559260-96d0-4670-8fe4-2513107c6fbc None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.210193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c559260-96d0-4670-8fe4-2513107c6fbc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.221176 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c559260-96d0-4670-8fe4-2513107c6fbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-5c559260-96d0-4670-8fe4-2513107c6fbc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:51.229407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:51.230346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:51.231225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:51.231225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:51.231225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:51.231225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:51.231225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:51.231225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:51.231225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:51.231225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:51.231225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:51.231225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:51.231225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:36:51.231225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:51.235765 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 506/1016] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 2 13:36:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:51.237175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e8150-6aac-4067-b5b2-2a8d504baf4d None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.358098 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e8150-6aac-4067-b5b2-2a8d504baf4d None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:51.360189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:51.396258 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df11e1b-a7f2-4615-a736-40dc946b2488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:51.397419 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df11e1b-a7f2-4615-a736-40dc946b2488 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.398281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df11e1b-a7f2-4615-a736-40dc946b2488 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.398619 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df11e1b-a7f2-4615-a736-40dc946b2488 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.399318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df11e1b-a7f2-4615-a736-40dc946b2488 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:51.399904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df11e1b-a7f2-4615-a736-40dc946b2488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:51.401327 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df11e1b-a7f2-4615-a736-40dc946b2488 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:51.414614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 511/1017] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 2 13:36:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:51.416056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c559260-96d0-4670-8fe4-2513107c6fbc None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.492227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:51.524590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c559260-96d0-4670-8fe4-2513107c6fbc None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:51.559462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a73d6d-0758-4ee9-99af-d129c1e98525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:51.561622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a73d6d-0758-4ee9-99af-d129c1e98525 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.561622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a73d6d-0758-4ee9-99af-d129c1e98525 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.561622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a73d6d-0758-4ee9-99af-d129c1e98525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.571918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a73d6d-0758-4ee9-99af-d129c1e98525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:51.573421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a73d6d-0758-4ee9-99af-d129c1e98525 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-f2a73d6d-0758-4ee9-99af-d129c1e98525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:51.592704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:51.593896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:51.594789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:51.594789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:51.594789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:51.594789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:51.598962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 507/1018] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:51.600023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df11e1b-a7f2-4615-a736-40dc946b2488 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.631522 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35488537-8279-4ed3-adbe-bd9be1f1a6fe None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.631828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35488537-8279-4ed3-adbe-bd9be1f1a6fe None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.632082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35488537-8279-4ed3-adbe-bd9be1f1a6fe None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.633582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 508/1019] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:36:51.638838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61315d27-e8d0-4a06-bf68-3410d7a6bdd4 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.639351 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61315d27-e8d0-4a06-bf68-3410d7a6bdd4 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.639631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61315d27-e8d0-4a06-bf68-3410d7a6bdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.657011 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-61315d27-e8d0-4a06-bf68-3410d7a6bdd4 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:51.658213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-61315d27-e8d0-4a06-bf68-3410d7a6bdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:51.712087 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df11e1b-a7f2-4615-a736-40dc946b2488 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:51.731620 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 509/1020] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:51 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:51.750106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f27cfd-391f-4786-8655-84c7feb98f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:51.750695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f27cfd-391f-4786-8655-84c7feb98f69 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.750979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f27cfd-391f-4786-8655-84c7feb98f69 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.751252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f27cfd-391f-4786-8655-84c7feb98f69 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.752005 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f27cfd-391f-4786-8655-84c7feb98f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:51.752308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f27cfd-391f-4786-8655-84c7feb98f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:51.753679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f27cfd-391f-4786-8655-84c7feb98f69 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:51.753803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61315d27-e8d0-4a06-bf68-3410d7a6bdd4 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.767417 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 512/1021] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:51.772882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f27cfd-391f-4786-8655-84c7feb98f69 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.801812 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:51.820408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:51.871022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61315d27-e8d0-4a06-bf68-3410d7a6bdd4 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:51.885083 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f27cfd-391f-4786-8655-84c7feb98f69 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:51.907528 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0a4d6-43f8-4ff6-b701-e8d6f8fec8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:51.908199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0a4d6-43f8-4ff6-b701-e8d6f8fec8ef None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.908483 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0a4d6-43f8-4ff6-b701-e8d6f8fec8ef None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.908756 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0a4d6-43f8-4ff6-b701-e8d6f8fec8ef None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.909472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0a4d6-43f8-4ff6-b701-e8d6f8fec8ef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:51.910847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0a4d6-43f8-4ff6-b701-e8d6f8fec8ef None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:51.924097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c00524-c48a-48c1-9204-b5c81672c113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:51.924895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c00524-c48a-48c1-9204-b5c81672c113 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.925205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c00524-c48a-48c1-9204-b5c81672c113 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.925504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c00524-c48a-48c1-9204-b5c81672c113 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.933149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c00524-c48a-48c1-9204-b5c81672c113 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:51.934617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c00524-c48a-48c1-9204-b5c81672c113 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-14c00524-c48a-48c1-9204-b5c81672c113 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:51.949538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:51.951103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:51.952671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:51.952671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:51.952671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:51.952671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:51.952671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:51.952671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:51.952671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:51.952671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:51.952671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:36:51.952671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:51.952671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 513/1022] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 2 13:36:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:51.956942 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c00524-c48a-48c1-9204-b5c81672c113 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.998042 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 510/1023] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 2 13:36:51 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:36:52.054648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:52.073032 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c00524-c48a-48c1-9204-b5c81672c113 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.122465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08ba7f-cdff-424f-81eb-0eda6173facb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.123174 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ba7f-cdff-424f-81eb-0eda6173facb None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.124088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ba7f-cdff-424f-81eb-0eda6173facb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.124360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ba7f-cdff-424f-81eb-0eda6173facb None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.125323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08ba7f-cdff-424f-81eb-0eda6173facb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:52.125639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08ba7f-cdff-424f-81eb-0eda6173facb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.127154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08ba7f-cdff-424f-81eb-0eda6173facb None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:52.153594 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 514/1024] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 2 13:36:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:52.155933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0a4d6-43f8-4ff6-b701-e8d6f8fec8ef None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:52.264037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0a4d6-43f8-4ff6-b701-e8d6f8fec8ef None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.278064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:52.298674 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfd61a-1dfa-41ec-835b-e702359834cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.299329 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfd61a-1dfa-41ec-835b-e702359834cc None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.299645 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfd61a-1dfa-41ec-835b-e702359834cc None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.299924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfd61a-1dfa-41ec-835b-e702359834cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.369242 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfd61a-1dfa-41ec-835b-e702359834cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.370605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfd61a-1dfa-41ec-835b-e702359834cc None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:52.469799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3b6b5-4edb-48ad-805e-ec61a1d5b439 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.470082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3b6b5-4edb-48ad-805e-ec61a1d5b439 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.470369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3b6b5-4edb-48ad-805e-ec61a1d5b439 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.472052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 515/1025] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:52.474098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 511/1026] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:52 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:36:52.476746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5f7da-4063-40c4-b621-fd71c07377c7 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.477037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5f7da-4063-40c4-b621-fd71c07377c7 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.477315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5f7da-4063-40c4-b621-fd71c07377c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.479904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfd61a-1dfa-41ec-835b-e702359834cc None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:52.495799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-b0f5f7da-4063-40c4-b621-fd71c07377c7 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:52.497120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:52.497307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b0f5f7da-4063-40c4-b621-fd71c07377c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:52.583412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 516/1027] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jun 02 13:36:52.589697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfd61a-1dfa-41ec-835b-e702359834cc None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.606652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5f7da-4063-40c4-b621-fd71c07377c7 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:52.632349 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0ffc1-bf4e-4c85-a63e-79ff96fbfb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.633148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0ffc1-bf4e-4c85-a63e-79ff96fbfb6d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.633436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0ffc1-bf4e-4c85-a63e-79ff96fbfb6d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.633716 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0ffc1-bf4e-4c85-a63e-79ff96fbfb6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.644097 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0ffc1-bf4e-4c85-a63e-79ff96fbfb6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.645645 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0ffc1-bf4e-4c85-a63e-79ff96fbfb6d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-9cd0ffc1-bf4e-4c85-a63e-79ff96fbfb6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:52.664324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:52.665315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:52.666436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:52.666436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:52.666436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:52.666436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:52.666436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 512/1028] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:52.671813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0ffc1-bf4e-4c85-a63e-79ff96fbfb6d None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:52.685212 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:52.722420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5f7da-4063-40c4-b621-fd71c07377c7 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.735676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:52.762950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358cb44-b3ac-4af1-8dc5-c569cf2b5742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.764082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358cb44-b3ac-4af1-8dc5-c569cf2b5742 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.764376 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358cb44-b3ac-4af1-8dc5-c569cf2b5742 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.764650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358cb44-b3ac-4af1-8dc5-c569cf2b5742 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.765872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358cb44-b3ac-4af1-8dc5-c569cf2b5742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.767494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358cb44-b3ac-4af1-8dc5-c569cf2b5742 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:52.769158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 517/1029] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:52.774961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358cb44-b3ac-4af1-8dc5-c569cf2b5742 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:52.779765 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0ffc1-bf4e-4c85-a63e-79ff96fbfb6d None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.821034 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1ea97-e9e1-4c7a-a89d-150f2923d566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.821708 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1ea97-e9e1-4c7a-a89d-150f2923d566 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.822431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1ea97-e9e1-4c7a-a89d-150f2923d566 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.822717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1ea97-e9e1-4c7a-a89d-150f2923d566 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.823440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1ea97-e9e1-4c7a-a89d-150f2923d566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:52.823774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1ea97-e9e1-4c7a-a89d-150f2923d566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.826081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1ea97-e9e1-4c7a-a89d-150f2923d566 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:52.842849 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 513/1030] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:52.845086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1ea97-e9e1-4c7a-a89d-150f2923d566 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:52.895058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358cb44-b3ac-4af1-8dc5-c569cf2b5742 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.932652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f5d4d-54bd-4b21-b4e7-ce94c2764a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.933318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f5d4d-54bd-4b21-b4e7-ce94c2764a4c None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.933606 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f5d4d-54bd-4b21-b4e7-ce94c2764a4c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.933885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f5d4d-54bd-4b21-b4e7-ce94c2764a4c None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.934587 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f5d4d-54bd-4b21-b4e7-ce94c2764a4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.936086 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f5d4d-54bd-4b21-b4e7-ce94c2764a4c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:52.940410 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:52.950593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1ea97-e9e1-4c7a-a89d-150f2923d566 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.974825 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:52.986034 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c5748-04ce-426c-8d6b-af1af87fc63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.986828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c5748-04ce-426c-8d6b-af1af87fc63f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.987112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c5748-04ce-426c-8d6b-af1af87fc63f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.987387 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c5748-04ce-426c-8d6b-af1af87fc63f None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.994704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c5748-04ce-426c-8d6b-af1af87fc63f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.996523 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c5748-04ce-426c-8d6b-af1af87fc63f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-ab3c5748-04ce-426c-8d6b-af1af87fc63f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:53.010859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:53.012285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:53.013762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:53.013762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:53.013762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:53.013762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:53.013762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:53.013762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:53.013762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:53.013762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:53.013762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 514/1031] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:53.017724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c5748-04ce-426c-8d6b-af1af87fc63f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:53.039698 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 518/1032] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 2 13:36:52 2022] POST /identity/v3/projects => generated 311 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:53.128267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c5748-04ce-426c-8d6b-af1af87fc63f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:53.165833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180794dd-0708-4ce9-a811-64289c9304db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:53.166440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180794dd-0708-4ce9-a811-64289c9304db None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:53.166724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180794dd-0708-4ce9-a811-64289c9304db None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:53.167000 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180794dd-0708-4ce9-a811-64289c9304db None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:53.167861 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180794dd-0708-4ce9-a811-64289c9304db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:53.168174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180794dd-0708-4ce9-a811-64289c9304db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:53.169686 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180794dd-0708-4ce9-a811-64289c9304db None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:53.189004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 515/1033] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:53.190352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f5d4d-54bd-4b21-b4e7-ce94c2764a4c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:53.312416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f5d4d-54bd-4b21-b4e7-ce94c2764a4c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:53.349322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83505aeb-616f-44a0-a790-78c228f66f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:53.349995 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83505aeb-616f-44a0-a790-78c228f66f17 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:53.350283 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83505aeb-616f-44a0-a790-78c228f66f17 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:53.350560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83505aeb-616f-44a0-a790-78c228f66f17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:53.351413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83505aeb-616f-44a0-a790-78c228f66f17 None admin] RBAC: Adding query filter params (role.id=3613773e53094931b72912bb4cd6a9df, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=b9971f2bf0f2400b90168f6032a0e226) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:53.351795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83505aeb-616f-44a0-a790-78c228f66f17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:53.353282 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83505aeb-616f-44a0-a790-78c228f66f17 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:53.359581 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 519/1034] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:53 2022] GET /identity/v3/role_assignments?user.id=b9971f2bf0f2400b90168f6032a0e226&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=3613773e53094931b72912bb4cd6a9df => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:54.308472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0eb79-1813-4bff-b539-c4018556fbb6 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:54.309005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0eb79-1813-4bff-b539-c4018556fbb6 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:54.309005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0eb79-1813-4bff-b539-c4018556fbb6 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:54.310380 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 516/1035] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:54.316249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b9662-bef6-4594-bd41-7dd106408f37 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:54.316665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b9662-bef6-4594-bd41-7dd106408f37 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:54.316847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b9662-bef6-4594-bd41-7dd106408f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:54.333264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-eb9b9662-bef6-4594-bd41-7dd106408f37 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:54.334427 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-eb9b9662-bef6-4594-bd41-7dd106408f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:54.384057 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:54.407494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 520/1036] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:54.428372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0eb79-1813-4bff-b539-c4018556fbb6 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:54.479301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:54.535476 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0eb79-1813-4bff-b539-c4018556fbb6 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:54.576430 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddbf00-dc41-48c5-b18f-999d3983c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:54.577225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddbf00-dc41-48c5-b18f-999d3983c487 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:54.577506 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddbf00-dc41-48c5-b18f-999d3983c487 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:54.577782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddbf00-dc41-48c5-b18f-999d3983c487 None admin] PATH_INFO: `/v3/services/image` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:54.578427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddbf00-dc41-48c5-b18f-999d3983c487 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:54.579811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddbf00-dc41-48c5-b18f-999d3983c487 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-f8ddbf00-dc41-48c5-b18f-999d3983c487 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:54.591607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:54.593133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:54.593980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 517/1037] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jun 2 13:36:54 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:54.601514 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b9662-bef6-4594-bd41-7dd106408f37 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:54.702542 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b9662-bef6-4594-bd41-7dd106408f37 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:54.738869 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4fa5e-8aa6-411a-9cca-0d20af852074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:54.739553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4fa5e-8aa6-411a-9cca-0d20af852074 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:54.739837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4fa5e-8aa6-411a-9cca-0d20af852074 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:54.740102 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4fa5e-8aa6-411a-9cca-0d20af852074 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:54.740802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4fa5e-8aa6-411a-9cca-0d20af852074 None admin] RBAC: Adding query filter params (name=image) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:54.741099 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4fa5e-8aa6-411a-9cca-0d20af852074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:54.742462 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4fa5e-8aa6-411a-9cca-0d20af852074 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:54.752075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 521/1038] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:54.753296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddbf00-dc41-48c5-b18f-999d3983c487 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:54.856076 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddbf00-dc41-48c5-b18f-999d3983c487 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:54.865068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:54.890924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1edc6-e2f2-4517-9ed6-f4726324e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:54.891619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1edc6-e2f2-4517-9ed6-f4726324e706 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:54.891906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1edc6-e2f2-4517-9ed6-f4726324e706 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:54.892180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1edc6-e2f2-4517-9ed6-f4726324e706 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:54.892880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1edc6-e2f2-4517-9ed6-f4726324e706 None admin] RBAC: Adding query filter params (type=image) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:54.893186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1edc6-e2f2-4517-9ed6-f4726324e706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:54.894569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1edc6-e2f2-4517-9ed6-f4726324e706 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:54.903609 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 518/1039] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:54.906039 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4fa5e-8aa6-411a-9cca-0d20af852074 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:54.955642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:55.010380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4fa5e-8aa6-411a-9cca-0d20af852074 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:55.049897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d4363-2a9f-4f50-bdd9-6f84703e9759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.050584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d4363-2a9f-4f50-bdd9-6f84703e9759 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.050867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d4363-2a9f-4f50-bdd9-6f84703e9759 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.051143 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d4363-2a9f-4f50-bdd9-6f84703e9759 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.051985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d4363-2a9f-4f50-bdd9-6f84703e9759 None admin] RBAC: Adding query filter params (interface=public, service_id=f2be1fa58c2941caa097cbad0f0b6860, region_id=RegionOne) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:55.052299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d4363-2a9f-4f50-bdd9-6f84703e9759 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:55.053727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d4363-2a9f-4f50-bdd9-6f84703e9759 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:55.064455 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 522/1040] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 2 13:36:54 2022] GET /identity/v3/endpoints?service_id=f2be1fa58c2941caa097cbad0f0b6860&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:55.065704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1edc6-e2f2-4517-9ed6-f4726324e706 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:55.168028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1edc6-e2f2-4517-9ed6-f4726324e706 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:55.202403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c023d21-092f-4998-a082-4ab2da3cff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.203066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c023d21-092f-4998-a082-4ab2da3cff60 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.203348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c023d21-092f-4998-a082-4ab2da3cff60 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.203649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c023d21-092f-4998-a082-4ab2da3cff60 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.204322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c023d21-092f-4998-a082-4ab2da3cff60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:55.205685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c023d21-092f-4998-a082-4ab2da3cff60 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:55.219485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 519/1041] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 2 13:36:55 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:55.378290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e4063-d6e4-47fd-86e0-6b300705f5d4 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.378887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e4063-d6e4-47fd-86e0-6b300705f5d4 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.378887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e4063-d6e4-47fd-86e0-6b300705f5d4 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.380548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 523/1042] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:55.386053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18763e0b-969a-4a1b-a9da-23acae532446 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.386560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18763e0b-969a-4a1b-a9da-23acae532446 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.386640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18763e0b-969a-4a1b-a9da-23acae532446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.405008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-18763e0b-969a-4a1b-a9da-23acae532446 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:55.406209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-18763e0b-969a-4a1b-a9da-23acae532446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:55.438809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:55.477972 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 520/1043] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:55.503961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e4063-d6e4-47fd-86e0-6b300705f5d4 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:55.606845 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e4063-d6e4-47fd-86e0-6b300705f5d4 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:55.613970 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2013-e894-4e1f-82ee-5f824721a346 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.614251 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2013-e894-4e1f-82ee-5f824721a346 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.614537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2013-e894-4e1f-82ee-5f824721a346 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.616086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 521/1044] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:36:55.618909 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:55.620878 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b00a9-1ffa-4deb-8020-6bd3e8091ada None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.621431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b00a9-1ffa-4deb-8020-6bd3e8091ada None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.621711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b00a9-1ffa-4deb-8020-6bd3e8091ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.638713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-9f8b00a9-1ffa-4deb-8020-6bd3e8091ada None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:55.639953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9f8b00a9-1ffa-4deb-8020-6bd3e8091ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:55.646933 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd5a60-a900-4c05-8f6c-4111b3db864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.648137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5a60-a900-4c05-8f6c-4111b3db864c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.648426 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5a60-a900-4c05-8f6c-4111b3db864c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.648697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5a60-a900-4c05-8f6c-4111b3db864c None admin] PATH_INFO: `/v3/domains/default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.650247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd5a60-a900-4c05-8f6c-4111b3db864c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:55.652309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd5a60-a900-4c05-8f6c-4111b3db864c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:55.659276 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 524/1045] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:55.660484 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd5a60-a900-4c05-8f6c-4111b3db864c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:55.711662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 522/1046] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:55.734973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b00a9-1ffa-4deb-8020-6bd3e8091ada None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:55.773780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd5a60-a900-4c05-8f6c-4111b3db864c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:55.811579 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfadc4b-6fe2-41fd-b69b-0d73806d396a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.812253 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfadc4b-6fe2-41fd-b69b-0d73806d396a None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.812531 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfadc4b-6fe2-41fd-b69b-0d73806d396a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.812798 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfadc4b-6fe2-41fd-b69b-0d73806d396a None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.813496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfadc4b-6fe2-41fd-b69b-0d73806d396a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:55.814920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfadc4b-6fe2-41fd-b69b-0d73806d396a None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:55.833830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:55.839556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b00a9-1ffa-4deb-8020-6bd3e8091ada None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:55.874584 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17245964-020e-4c87-9361-2080beae8db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.875439 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17245964-020e-4c87-9361-2080beae8db0 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.875771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17245964-020e-4c87-9361-2080beae8db0 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.876095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17245964-020e-4c87-9361-2080beae8db0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.886161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17245964-020e-4c87-9361-2080beae8db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-17245964-020e-4c87-9361-2080beae8db0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:55.894462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:55.895718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:55.896782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:55.896782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:55.896782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:55.896782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:55.896782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:55.896782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:55.896782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:55.896782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:55.896782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:55.896782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:55.896782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:36:55.896782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:55.896782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 523/1047] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 2 13:36:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:55.905084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17245964-020e-4c87-9361-2080beae8db0 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:55.941076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 525/1048] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:36:55 2022] POST /identity/v3/users => generated 285 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:56.019676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17245964-020e-4c87-9361-2080beae8db0 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:56.057890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7424c-2949-4e30-8834-a3d9e7402e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:56.058578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7424c-2949-4e30-8834-a3d9e7402e81 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:56.058863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7424c-2949-4e30-8834-a3d9e7402e81 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:56.059147 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7424c-2949-4e30-8834-a3d9e7402e81 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:56.059947 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7424c-2949-4e30-8834-a3d9e7402e81 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:56.060261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7424c-2949-4e30-8834-a3d9e7402e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:56.061697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7424c-2949-4e30-8834-a3d9e7402e81 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:56.071046 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 524/1049] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 2 13:36:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:56.077020 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfadc4b-6fe2-41fd-b69b-0d73806d396a None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:56.115203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:56.188135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfadc4b-6fe2-41fd-b69b-0d73806d396a None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:56.224123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d10f5-83e2-4cd1-aab3-eb0f6972bbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:56.224917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d10f5-83e2-4cd1-aab3-eb0f6972bbf5 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:56.225284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d10f5-83e2-4cd1-aab3-eb0f6972bbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:56.225556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d10f5-83e2-4cd1-aab3-eb0f6972bbf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:56.237776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d10f5-83e2-4cd1-aab3-eb0f6972bbf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:56.239251 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d10f5-83e2-4cd1-aab3-eb0f6972bbf5 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-9e2d10f5-83e2-4cd1-aab3-eb0f6972bbf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:56.257078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:56.257966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:56.260114 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:56.260114 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:56.260114 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:56.260114 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:56.260114 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 526/1050] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:56.265237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7424c-2949-4e30-8834-a3d9e7402e81 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:56.288294 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:56.369359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7424c-2949-4e30-8834-a3d9e7402e81 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:56.408552 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01520d-efed-423b-b677-75a215d37c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:56.409310 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01520d-efed-423b-b677-75a215d37c0a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:56.409486 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01520d-efed-423b-b677-75a215d37c0a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:56.409758 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01520d-efed-423b-b677-75a215d37c0a None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:56.410475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01520d-efed-423b-b677-75a215d37c0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:56.410778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01520d-efed-423b-b677-75a215d37c0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:56.412203 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01520d-efed-423b-b677-75a215d37c0a None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:56.424520 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 525/1051] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:56.429865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d10f5-83e2-4cd1-aab3-eb0f6972bbf5 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:56.523717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:56.542440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d10f5-83e2-4cd1-aab3-eb0f6972bbf5 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:56.573989 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496f40a-f62e-499e-83d6-9f722ef4daad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:56.575079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496f40a-f62e-499e-83d6-9f722ef4daad None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:56.575576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496f40a-f62e-499e-83d6-9f722ef4daad None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:56.576098 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496f40a-f62e-499e-83d6-9f722ef4daad None admin] PATH_INFO: `/v3/users/nova` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:56.585341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496f40a-f62e-499e-83d6-9f722ef4daad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:56.587011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496f40a-f62e-499e-83d6-9f722ef4daad None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-b496f40a-f62e-499e-83d6-9f722ef4daad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:56.601959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:56.602940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:56.603908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:56.603908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:56.603908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:56.603908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:56.603908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:56.603908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:56.603908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:56.603908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:56.603908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:36:56.603908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:56.604979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 527/1052] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 2 13:36:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:56.610802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01520d-efed-423b-b677-75a215d37c0a None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:56.690732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:56.714038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01520d-efed-423b-b677-75a215d37c0a None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:56.750730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935d2a7-5054-4696-9b1c-cc533d3f23a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:56.751393 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935d2a7-5054-4696-9b1c-cc533d3f23a7 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:56.751709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935d2a7-5054-4696-9b1c-cc533d3f23a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:56.751970 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935d2a7-5054-4696-9b1c-cc533d3f23a7 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:56.752795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935d2a7-5054-4696-9b1c-cc533d3f23a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:56.753099 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935d2a7-5054-4696-9b1c-cc533d3f23a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:56.754516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935d2a7-5054-4696-9b1c-cc533d3f23a7 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:56.776941 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 526/1053] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 2 13:36:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:56.778215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496f40a-f62e-499e-83d6-9f722ef4daad None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:56.883482 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496f40a-f62e-499e-83d6-9f722ef4daad None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:56.917258 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1159ce3-c3c5-4a48-876d-7fa766d0994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:56.918055 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1159ce3-c3c5-4a48-876d-7fa766d0994f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:56.918338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1159ce3-c3c5-4a48-876d-7fa766d0994f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:56.918613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1159ce3-c3c5-4a48-876d-7fa766d0994f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:56.929462 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1159ce3-c3c5-4a48-876d-7fa766d0994f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:56.930917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1159ce3-c3c5-4a48-876d-7fa766d0994f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:56.937875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-e1159ce3-c3c5-4a48-876d-7fa766d0994f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:56.949342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:56.956641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:56.957551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:56.957551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:56.957551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:56.957551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:56.957551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 528/1054] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:56.959357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935d2a7-5054-4696-9b1c-cc533d3f23a7 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:57.064510 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935d2a7-5054-4696-9b1c-cc533d3f23a7 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:57.099049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752fe26-e8cc-4536-aba2-012a8be68c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:57.099733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752fe26-e8cc-4536-aba2-012a8be68c2f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:57.100016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752fe26-e8cc-4536-aba2-012a8be68c2f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:57.100289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752fe26-e8cc-4536-aba2-012a8be68c2f None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:57.101004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752fe26-e8cc-4536-aba2-012a8be68c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:57.101308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752fe26-e8cc-4536-aba2-012a8be68c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:57.102665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752fe26-e8cc-4536-aba2-012a8be68c2f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:57.105086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:57.115595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 527/1055] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:57.121080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1159ce3-c3c5-4a48-876d-7fa766d0994f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:57.232562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1159ce3-c3c5-4a48-876d-7fa766d0994f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:57.273403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd94ce-1d08-403e-9f44-eb207b196883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:57.274223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd94ce-1d08-403e-9f44-eb207b196883 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:57.274515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd94ce-1d08-403e-9f44-eb207b196883 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:57.274792 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd94ce-1d08-403e-9f44-eb207b196883 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:57.282311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd94ce-1d08-403e-9f44-eb207b196883 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:57.283802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd94ce-1d08-403e-9f44-eb207b196883 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-16cd94ce-1d08-403e-9f44-eb207b196883 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:57.298974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:57.300166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:57.301116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:57.301116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:57.301116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:57.301116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:57.301116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:57.301116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:57.301116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:57.301116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:57.301116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 529/1056] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:57.306577 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752fe26-e8cc-4536-aba2-012a8be68c2f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:57.411723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752fe26-e8cc-4536-aba2-012a8be68c2f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:57.446898 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded4a49-75eb-48b5-8563-a2eaaf779649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:57.447586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4a49-75eb-48b5-8563-a2eaaf779649 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:57.447874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4a49-75eb-48b5-8563-a2eaaf779649 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:57.448150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4a49-75eb-48b5-8563-a2eaaf779649 None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:57.448929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded4a49-75eb-48b5-8563-a2eaaf779649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:57.449237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded4a49-75eb-48b5-8563-a2eaaf779649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:57.450704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded4a49-75eb-48b5-8563-a2eaaf779649 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:57.464672 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 528/1057] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:57.471060 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd94ce-1d08-403e-9f44-eb207b196883 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:57.532073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:57.534369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8d229-c33c-4934-a808-d063512dfffa None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:57.534667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8d229-c33c-4934-a808-d063512dfffa None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:57.534960 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8d229-c33c-4934-a808-d063512dfffa None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:57.536548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 529/1058] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:57.541296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302fb3c-460b-4b55-9d6e-569889e43aa1 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:57.544056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302fb3c-460b-4b55-9d6e-569889e43aa1 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:57.544056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302fb3c-460b-4b55-9d6e-569889e43aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:57.559627 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-9302fb3c-460b-4b55-9d6e-569889e43aa1 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:57.560830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9302fb3c-460b-4b55-9d6e-569889e43aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:57.575064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd94ce-1d08-403e-9f44-eb207b196883 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:57.616458 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1ecf3-810d-4d57-88cf-ced55aeee40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:57.617344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1ecf3-810d-4d57-88cf-ced55aeee40a None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:57.617630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1ecf3-810d-4d57-88cf-ced55aeee40a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:57.617903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1ecf3-810d-4d57-88cf-ced55aeee40a None admin] PATH_INFO: `/v3/projects/8deff8fec8614da6997a32993c033fd8/users/b9971f2bf0f2400b90168f6032a0e226/roles/3613773e53094931b72912bb4cd6a9df` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:57.620155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1ecf3-810d-4d57-88cf-ced55aeee40a None admin] RBAC: Authorizing `identity:create_grant(project_id=8deff8fec8614da6997a32993c033fd8, user_id=b9971f2bf0f2400b90168f6032a0e226, role_id=3613773e53094931b72912bb4cd6a9df)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:57.621872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1ecf3-810d-4d57-88cf-ced55aeee40a None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:57.622278 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:57.639019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 530/1059] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:57.661940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302fb3c-460b-4b55-9d6e-569889e43aa1 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:57.723433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 530/1060] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:36:57 2022] PUT /identity/v3/projects/8deff8fec8614da6997a32993c033fd8/users/b9971f2bf0f2400b90168f6032a0e226/roles/3613773e53094931b72912bb4cd6a9df => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:57.778544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302fb3c-460b-4b55-9d6e-569889e43aa1 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:57.817687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4aa8ce-c8e6-45c8-b077-4218665a1bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:57.818587 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa8ce-c8e6-45c8-b077-4218665a1bbc None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:57.818698 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa8ce-c8e6-45c8-b077-4218665a1bbc None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:57.818959 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa8ce-c8e6-45c8-b077-4218665a1bbc None admin] PATH_INFO: `/v3/services/image` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:57.819706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4aa8ce-c8e6-45c8-b077-4218665a1bbc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:57.821068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4aa8ce-c8e6-45c8-b077-4218665a1bbc None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-7e4aa8ce-c8e6-45c8-b077-4218665a1bbc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:57.834475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:57.835955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:36:57.837287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 531/1061] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jun 2 13:36:57 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:57.843504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1ecf3-810d-4d57-88cf-ced55aeee40a None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:57.955230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1ecf3-810d-4d57-88cf-ced55aeee40a None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:57.973896 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:57.993345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd6e11-c879-4a82-a05e-eaed4730a4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:57.994047 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd6e11-c879-4a82-a05e-eaed4730a4ea None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:57.994330 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd6e11-c879-4a82-a05e-eaed4730a4ea None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:57.994603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd6e11-c879-4a82-a05e-eaed4730a4ea None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:57.995343 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd6e11-c879-4a82-a05e-eaed4730a4ea None admin] RBAC: Adding query filter params (name=image) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:57.995702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd6e11-c879-4a82-a05e-eaed4730a4ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:57.997381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd6e11-c879-4a82-a05e-eaed4730a4ea None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:58.007480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 531/1062] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:58.010071 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4aa8ce-c8e6-45c8-b077-4218665a1bbc None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:58.062015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:58.111988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4aa8ce-c8e6-45c8-b077-4218665a1bbc None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:58.147215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61254d8-7f00-401d-8942-be36c7b4fb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:58.147905 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61254d8-7f00-401d-8942-be36c7b4fb5a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:58.148187 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61254d8-7f00-401d-8942-be36c7b4fb5a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:58.148463 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61254d8-7f00-401d-8942-be36c7b4fb5a None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:58.149162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61254d8-7f00-401d-8942-be36c7b4fb5a None admin] RBAC: Adding query filter params (type=image) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:58.149464 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61254d8-7f00-401d-8942-be36c7b4fb5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:58.150821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61254d8-7f00-401d-8942-be36c7b4fb5a None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:58.156099 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 532/1063] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:58.161832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd6e11-c879-4a82-a05e-eaed4730a4ea None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:58.276585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd6e11-c879-4a82-a05e-eaed4730a4ea None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:58.310684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0beb63-1b97-40df-9fc9-6ffe99cd9429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:58.311961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0beb63-1b97-40df-9fc9-6ffe99cd9429 None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:58.312240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0beb63-1b97-40df-9fc9-6ffe99cd9429 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:58.312508 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0beb63-1b97-40df-9fc9-6ffe99cd9429 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:58.313251 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0beb63-1b97-40df-9fc9-6ffe99cd9429 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:58.314614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0beb63-1b97-40df-9fc9-6ffe99cd9429 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:58.323123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa55bd-efb0-4fb3-80d1-2421387cea4f None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:58.323418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa55bd-efb0-4fb3-80d1-2421387cea4f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:58.323741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa55bd-efb0-4fb3-80d1-2421387cea4f None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:58.325105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 533/1064] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:58.330918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292745a-126b-4b8d-9e4c-e8fd867edea6 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:58.331228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292745a-126b-4b8d-9e4c-e8fd867edea6 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:58.331532 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292745a-126b-4b8d-9e4c-e8fd867edea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:58.351574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-7292745a-126b-4b8d-9e4c-e8fd867edea6 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:58.352802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7292745a-126b-4b8d-9e4c-e8fd867edea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:58.420521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 532/1065] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 2 13:36:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:36:58.428914 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 534/1066] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:58.456762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0beb63-1b97-40df-9fc9-6ffe99cd9429 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:58.504200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:58.573235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0beb63-1b97-40df-9fc9-6ffe99cd9429 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:58.611957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93ae6e-03ed-400c-8e2e-8bd9476c34dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:58.613069 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93ae6e-03ed-400c-8e2e-8bd9476c34dd None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:58.613509 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93ae6e-03ed-400c-8e2e-8bd9476c34dd None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:58.613953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93ae6e-03ed-400c-8e2e-8bd9476c34dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:58.627218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93ae6e-03ed-400c-8e2e-8bd9476c34dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-4c93ae6e-03ed-400c-8e2e-8bd9476c34dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:58.635050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:58.636097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:58.637053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:58.637053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:58.637053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:58.637053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:58.637053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:58.637053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:58.637053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:58.637053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:58.637053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:58.637053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:58.637053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:58.637053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:36:58.637053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 533/1067] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:58.642683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292745a-126b-4b8d-9e4c-e8fd867edea6 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:58.686569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:58.743714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292745a-126b-4b8d-9e4c-e8fd867edea6 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:58.779185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885898d-1ac0-485e-81df-4e760af3df80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:58.779947 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885898d-1ac0-485e-81df-4e760af3df80 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:58.780227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885898d-1ac0-485e-81df-4e760af3df80 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:58.780502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885898d-1ac0-485e-81df-4e760af3df80 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:58.781243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885898d-1ac0-485e-81df-4e760af3df80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:58.781545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885898d-1ac0-485e-81df-4e760af3df80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:58.782903 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885898d-1ac0-485e-81df-4e760af3df80 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:58.791275 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 535/1068] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:36:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:58.797700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93ae6e-03ed-400c-8e2e-8bd9476c34dd None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:58.900372 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:58.905336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93ae6e-03ed-400c-8e2e-8bd9476c34dd None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:58.939707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec383b58-0d0f-46cc-9c9e-53beebf6e5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:58.940495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec383b58-0d0f-46cc-9c9e-53beebf6e5cb None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:58.940772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec383b58-0d0f-46cc-9c9e-53beebf6e5cb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:58.941043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec383b58-0d0f-46cc-9c9e-53beebf6e5cb None admin] PATH_INFO: `/v3/users/04a1b0cfd34e41179f777b6444832241` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:58.955463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec383b58-0d0f-46cc-9c9e-53beebf6e5cb None admin] RBAC: Authorizing `identity:get_user(user_id=04a1b0cfd34e41179f777b6444832241)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:58.956912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec383b58-0d0f-46cc-9c9e-53beebf6e5cb None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:58.958775 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 534/1069] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:36:58 2022] GET /identity/v3/users/04a1b0cfd34e41179f777b6444832241 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:58.965108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885898d-1ac0-485e-81df-4e760af3df80 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:59.067664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885898d-1ac0-485e-81df-4e760af3df80 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:59.069228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:59.102483 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad32e0-841c-4686-b2ef-187167dc3750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:59.103208 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad32e0-841c-4686-b2ef-187167dc3750 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:59.103898 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad32e0-841c-4686-b2ef-187167dc3750 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:59.104524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad32e0-841c-4686-b2ef-187167dc3750 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:59.173535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad32e0-841c-4686-b2ef-187167dc3750 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:59.174987 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad32e0-841c-4686-b2ef-187167dc3750 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:59.281671 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 536/1070] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:36:59.287580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec383b58-0d0f-46cc-9c9e-53beebf6e5cb None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:59.390969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec383b58-0d0f-46cc-9c9e-53beebf6e5cb None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:59.427178 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603e2c6-f99a-4020-b70c-43e8f531b8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:59.428063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603e2c6-f99a-4020-b70c-43e8f531b8cd None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:59.428347 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603e2c6-f99a-4020-b70c-43e8f531b8cd None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:59.428617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603e2c6-f99a-4020-b70c-43e8f531b8cd None admin] PATH_INFO: `/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:59.429814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603e2c6-f99a-4020-b70c-43e8f531b8cd None admin] RBAC: Authorizing `identity:get_project(project_id=125f521f9ff84112b6f3e5af8ce2e52d)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:59.431295 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603e2c6-f99a-4020-b70c-43e8f531b8cd None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:59.433188 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 535/1071] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:36:59 2022] GET /identity/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:59.439283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad32e0-841c-4686-b2ef-187167dc3750 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:59.441606 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:59.542785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad32e0-841c-4686-b2ef-187167dc3750 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:59.580076 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901759ca-2453-4132-856b-27945f538088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:59.580752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901759ca-2453-4132-856b-27945f538088 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:59.581038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901759ca-2453-4132-856b-27945f538088 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:59.581318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901759ca-2453-4132-856b-27945f538088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:59.582236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901759ca-2453-4132-856b-27945f538088 None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=125f521f9ff84112b6f3e5af8ce2e52d, user.id=04a1b0cfd34e41179f777b6444832241) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:59.582558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901759ca-2453-4132-856b-27945f538088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:59.584084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901759ca-2453-4132-856b-27945f538088 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:59.595481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 537/1072] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:59 2022] GET /identity/v3/role_assignments?user.id=04a1b0cfd34e41179f777b6444832241&scope.project.id=125f521f9ff84112b6f3e5af8ce2e52d&role.id=c5632345c9274d348669482f1f7414c8 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:00.026977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59e175-5fda-4131-b1d7-196034e42a45 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.027735 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59e175-5fda-4131-b1d7-196034e42a45 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.027735 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59e175-5fda-4131-b1d7-196034e42a45 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.029096 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 536/1073] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:00.034215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad07cf-5e2c-4bfc-a4be-3ab524eb2929 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.034505 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad07cf-5e2c-4bfc-a4be-3ab524eb2929 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.034787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad07cf-5e2c-4bfc-a4be-3ab524eb2929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.052046 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-32ad07cf-5e2c-4bfc-a4be-3ab524eb2929 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:00.053284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-32ad07cf-5e2c-4bfc-a4be-3ab524eb2929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:00.114914 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:00.123222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 538/1074] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:00.147660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59e175-5fda-4131-b1d7-196034e42a45 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:00.175610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:00.258861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59e175-5fda-4131-b1d7-196034e42a45 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:00.300165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072ff03-3ce0-4457-a594-cb5f64790909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:00.300898 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072ff03-3ce0-4457-a594-cb5f64790909 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.301175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072ff03-3ce0-4457-a594-cb5f64790909 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.301449 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072ff03-3ce0-4457-a594-cb5f64790909 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.312936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072ff03-3ce0-4457-a594-cb5f64790909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-5072ff03-3ce0-4457-a594-cb5f64790909 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:37:00.321245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:00.322183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:00.328063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:00.328063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:00.328063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:00.328063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:00.328063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:37:00.328063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:37:00.328063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:37:00.328063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:37:00.328063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:37:00.328063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:37:00.328063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:37:00.328063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:37:00.328063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 537/1075] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 2 13:37:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:37:00.328799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad07cf-5e2c-4bfc-a4be-3ab524eb2929 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:00.439432 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad07cf-5e2c-4bfc-a4be-3ab524eb2929 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:00.477018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92426d-adfb-46e9-9e03-1dce6eb05b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:00.477685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92426d-adfb-46e9-9e03-1dce6eb05b6c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.477966 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92426d-adfb-46e9-9e03-1dce6eb05b6c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.478242 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92426d-adfb-46e9-9e03-1dce6eb05b6c None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.478976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92426d-adfb-46e9-9e03-1dce6eb05b6c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:00.479281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92426d-adfb-46e9-9e03-1dce6eb05b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:00.480847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92426d-adfb-46e9-9e03-1dce6eb05b6c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:00.494441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 539/1076] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 2 13:37:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:00.495741 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072ff03-3ce0-4457-a594-cb5f64790909 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:00.583855 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:00.600335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072ff03-3ce0-4457-a594-cb5f64790909 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:00.635140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad972d7-4545-4376-9a24-973e7eb8403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:00.635958 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad972d7-4545-4376-9a24-973e7eb8403b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.636240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad972d7-4545-4376-9a24-973e7eb8403b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.636512 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad972d7-4545-4376-9a24-973e7eb8403b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.647157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad972d7-4545-4376-9a24-973e7eb8403b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:00.648641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad972d7-4545-4376-9a24-973e7eb8403b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-9ad972d7-4545-4376-9a24-973e7eb8403b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:37:00.666131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:00.667049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:00.668564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:37:00.668564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:37:00.668564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:37:00.668564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:37:00.671807 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 538/1077] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:37:00.673529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92426d-adfb-46e9-9e03-1dce6eb05b6c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:00.726989 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e7987-8d89-4342-b241-f5b8a9ce8362 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.727304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e7987-8d89-4342-b241-f5b8a9ce8362 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.727689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e7987-8d89-4342-b241-f5b8a9ce8362 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.729205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 539/1078] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:00.734960 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b889ac-d28b-4959-a1c9-a4fabd4806e8 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.735637 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b889ac-d28b-4959-a1c9-a4fabd4806e8 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.736441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b889ac-d28b-4959-a1c9-a4fabd4806e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.738348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:00.757744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-e5b889ac-d28b-4959-a1c9-a4fabd4806e8 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:00.758958 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e5b889ac-d28b-4959-a1c9-a4fabd4806e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:00.782621 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92426d-adfb-46e9-9e03-1dce6eb05b6c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:00.819138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207453e-099e-4505-ba6a-061af8c6ded3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:00.819834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207453e-099e-4505-ba6a-061af8c6ded3 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.820121 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207453e-099e-4505-ba6a-061af8c6ded3 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.820399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207453e-099e-4505-ba6a-061af8c6ded3 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.821124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207453e-099e-4505-ba6a-061af8c6ded3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:00.821422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207453e-099e-4505-ba6a-061af8c6ded3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:00.822788 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207453e-099e-4505-ba6a-061af8c6ded3 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:00.835437 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 540/1079] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:00.840808 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207453e-099e-4505-ba6a-061af8c6ded3 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:00.841728 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 540/1080] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:37:00.864217 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b889ac-d28b-4959-a1c9-a4fabd4806e8 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:00.931468 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:00.947291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207453e-099e-4505-ba6a-061af8c6ded3 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:00.966107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:00.966533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b889ac-d28b-4959-a1c9-a4fabd4806e8 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:00.985839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8cae9-68f3-486f-8b5a-02294986280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:00.986707 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8cae9-68f3-486f-8b5a-02294986280e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.986996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8cae9-68f3-486f-8b5a-02294986280e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.987273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8cae9-68f3-486f-8b5a-02294986280e None admin] PATH_INFO: `/v3/users/nova` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.995239 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8cae9-68f3-486f-8b5a-02294986280e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:00.996948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8cae9-68f3-486f-8b5a-02294986280e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:01.003424 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33bacb-6099-432e-af81-baee447a85cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:01.004095 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33bacb-6099-432e-af81-baee447a85cb None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:01.004379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33bacb-6099-432e-af81-baee447a85cb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:01.004650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33bacb-6099-432e-af81-baee447a85cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-37f8cae9-68f3-486f-8b5a-02294986280e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:37:01.013593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:01.015100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:01.016677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:01.016677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:01.016677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:37:01.016677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:37:01.016677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:37:01.016677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:37:01.016677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:37:01.016677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:37:01.016677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:37:01.016677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:37:01.016677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 541/1081] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 2 13:37:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:37:01.021014 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8cae9-68f3-486f-8b5a-02294986280e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:01.084266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33bacb-6099-432e-af81-baee447a85cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:01.086210 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33bacb-6099-432e-af81-baee447a85cb None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:01.120423 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8cae9-68f3-486f-8b5a-02294986280e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:01.153707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:01.157005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bad2-5cd8-4e7b-9f89-215e32a4a223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:01.157937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bad2-5cd8-4e7b-9f89-215e32a4a223 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:01.158651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bad2-5cd8-4e7b-9f89-215e32a4a223 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:01.159138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bad2-5cd8-4e7b-9f89-215e32a4a223 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:01.160177 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027bad2-5cd8-4e7b-9f89-215e32a4a223 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:01.166705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027bad2-5cd8-4e7b-9f89-215e32a4a223 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:01.166705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027bad2-5cd8-4e7b-9f89-215e32a4a223 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:01.180171 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 542/1082] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 2 13:37:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:37:01.185423 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bad2-5cd8-4e7b-9f89-215e32a4a223 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:01.199493 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 541/1083] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:37:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:37:01.202675 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33bacb-6099-432e-af81-baee447a85cb None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:01.229409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:01.306394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bad2-5cd8-4e7b-9f89-215e32a4a223 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:01.320512 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33bacb-6099-432e-af81-baee447a85cb None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:01.345370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3359c55-ea84-46d1-b427-f97acbc4255b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:01.346377 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3359c55-ea84-46d1-b427-f97acbc4255b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:01.346909 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3359c55-ea84-46d1-b427-f97acbc4255b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:01.347501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3359c55-ea84-46d1-b427-f97acbc4255b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:01.356953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974d638-ac41-48e3-8a94-5dbd4e3fadc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:01.357775 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974d638-ac41-48e3-8a94-5dbd4e3fadc2 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:01.358062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974d638-ac41-48e3-8a94-5dbd4e3fadc2 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:01.358342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974d638-ac41-48e3-8a94-5dbd4e3fadc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:01.368750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974d638-ac41-48e3-8a94-5dbd4e3fadc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:01.370239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974d638-ac41-48e3-8a94-5dbd4e3fadc2 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-0974d638-ac41-48e3-8a94-5dbd4e3fadc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:37:01.388716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:01.390238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:01.391137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:37:01.391137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:37:01.391137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:37:01.391137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:37:01.391137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 542/1084] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:37:01.396401 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974d638-ac41-48e3-8a94-5dbd4e3fadc2 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:01.415747 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:01.429389 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3359c55-ea84-46d1-b427-f97acbc4255b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:01.430850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3359c55-ea84-46d1-b427-f97acbc4255b None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:01.467554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:01.505647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974d638-ac41-48e3-8a94-5dbd4e3fadc2 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:01.540919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 543/1085] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:37:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:37:01.547389 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3359c55-ea84-46d1-b427-f97acbc4255b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:01.549050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bc941-72b6-4d4f-9229-5fa37593c5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:01.549806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bc941-72b6-4d4f-9229-5fa37593c5e7 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:01.550028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bc941-72b6-4d4f-9229-5fa37593c5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:01.550383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bc941-72b6-4d4f-9229-5fa37593c5e7 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:01.550998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bc941-72b6-4d4f-9229-5fa37593c5e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:01.551298 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bc941-72b6-4d4f-9229-5fa37593c5e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:01.552738 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bc941-72b6-4d4f-9229-5fa37593c5e7 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:01.575480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 543/1086] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:37:01.671703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3359c55-ea84-46d1-b427-f97acbc4255b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:01.708017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a385cb5-885f-45cd-8f4b-2a82cbe8d132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:01.708834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a385cb5-885f-45cd-8f4b-2a82cbe8d132 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:01.709118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a385cb5-885f-45cd-8f4b-2a82cbe8d132 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:01.709392 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a385cb5-885f-45cd-8f4b-2a82cbe8d132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:01.712647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:01.722663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a385cb5-885f-45cd-8f4b-2a82cbe8d132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:01.727744 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a385cb5-885f-45cd-8f4b-2a82cbe8d132 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-0a385cb5-885f-45cd-8f4b-2a82cbe8d132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:37:01.743570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:01.744591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:01.745987 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:37:01.745987 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:37:01.745987 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:37:01.745987 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:37:01.745987 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 544/1087] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:37:01.752753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bc941-72b6-4d4f-9229-5fa37593c5e7 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:01.839857 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:01.864579 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bc941-72b6-4d4f-9229-5fa37593c5e7 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:01.869421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d1802-bd02-4d6f-a9f2-101f2848ff3b None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:01.869712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d1802-bd02-4d6f-a9f2-101f2848ff3b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:01.870001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d1802-bd02-4d6f-a9f2-101f2848ff3b None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:01.871821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 545/1088] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:37:01.877839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bc11c-6e57-4a58-800b-764e11da86ff None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:01.878132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bc11c-6e57-4a58-800b-764e11da86ff None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:01.878408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bc11c-6e57-4a58-800b-764e11da86ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:01.899413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-5a5bc11c-6e57-4a58-800b-764e11da86ff None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:01.900650 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5a5bc11c-6e57-4a58-800b-764e11da86ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:01.907000 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30a449-9a74-4292-95b7-53e426456c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:01.907708 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30a449-9a74-4292-95b7-53e426456c40 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:01.908063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30a449-9a74-4292-95b7-53e426456c40 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:01.908264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30a449-9a74-4292-95b7-53e426456c40 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:01.908977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30a449-9a74-4292-95b7-53e426456c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:01.909278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30a449-9a74-4292-95b7-53e426456c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:01.910640 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30a449-9a74-4292-95b7-53e426456c40 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:01.923845 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 544/1089] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:37:01.929266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30a449-9a74-4292-95b7-53e426456c40 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:01.969937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 546/1090] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:37:01.993474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bc11c-6e57-4a58-800b-764e11da86ff None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:02.027431 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30a449-9a74-4292-95b7-53e426456c40 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:02.063139 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecfcba-07a0-4814-b61f-2d907cd0873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:02.063964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecfcba-07a0-4814-b61f-2d907cd0873b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:02.064250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecfcba-07a0-4814-b61f-2d907cd0873b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:02.064524 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecfcba-07a0-4814-b61f-2d907cd0873b None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:02.071384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecfcba-07a0-4814-b61f-2d907cd0873b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:02.073037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecfcba-07a0-4814-b61f-2d907cd0873b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:02.074986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-12ecfcba-07a0-4814-b61f-2d907cd0873b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:37:02.088833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:02.090306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:02.091203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:37:02.091203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:37:02.091203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:37:02.091203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:37:02.091203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:37:02.091203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:37:02.091203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:37:02.091203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:37:02.091203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 545/1091] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:37:02.093538 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bc11c-6e57-4a58-800b-764e11da86ff None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:02.096396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecfcba-07a0-4814-b61f-2d907cd0873b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:02.111635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:02.128705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc519fd2-730d-43de-b193-c9fb13658cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:02.129440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc519fd2-730d-43de-b193-c9fb13658cb6 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:02.129718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc519fd2-730d-43de-b193-c9fb13658cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:02.129993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc519fd2-730d-43de-b193-c9fb13658cb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:02.140192 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc519fd2-730d-43de-b193-c9fb13658cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-fc519fd2-730d-43de-b193-c9fb13658cb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:37:02.147833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:02.148969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:02.149943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:02.149943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:02.149943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:02.149943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:02.149943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:37:02.149943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:37:02.149943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:37:02.149943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:37:02.149943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:37:02.149943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:37:02.149943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:02.149943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:37:02.149943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 547/1092] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:37:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:37:02.155599 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc519fd2-730d-43de-b193-c9fb13658cb6 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:02.199226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecfcba-07a0-4814-b61f-2d907cd0873b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:02.235182 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2d6c1-4f67-4be3-88cf-47e53e36aed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:02.235874 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2d6c1-4f67-4be3-88cf-47e53e36aed2 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:02.236159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2d6c1-4f67-4be3-88cf-47e53e36aed2 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:02.236433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2d6c1-4f67-4be3-88cf-47e53e36aed2 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:02.237214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2d6c1-4f67-4be3-88cf-47e53e36aed2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:02.237518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2d6c1-4f67-4be3-88cf-47e53e36aed2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:02.238950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2d6c1-4f67-4be3-88cf-47e53e36aed2 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:02.250536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 546/1093] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:37:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:37:02.255346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc519fd2-730d-43de-b193-c9fb13658cb6 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:02.256625 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2d6c1-4f67-4be3-88cf-47e53e36aed2 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:02.290319 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198979ca-ba42-4aa5-b50f-8788baab3e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:02.291079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198979ca-ba42-4aa5-b50f-8788baab3e63 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:02.291619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198979ca-ba42-4aa5-b50f-8788baab3e63 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:02.291745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198979ca-ba42-4aa5-b50f-8788baab3e63 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:02.292420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198979ca-ba42-4aa5-b50f-8788baab3e63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:02.292733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198979ca-ba42-4aa5-b50f-8788baab3e63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:02.294086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198979ca-ba42-4aa5-b50f-8788baab3e63 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:02.302027 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 548/1094] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:37:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:37:02.307832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198979ca-ba42-4aa5-b50f-8788baab3e63 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:02.321334 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:02.349357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:02.363744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2d6c1-4f67-4be3-88cf-47e53e36aed2 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:02.400967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfd1de-6199-4cea-b388-48ec3a437fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:02.401615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd1de-6199-4cea-b388-48ec3a437fc4 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:02.401898 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd1de-6199-4cea-b388-48ec3a437fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:02.402180 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd1de-6199-4cea-b388-48ec3a437fc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:02.402999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfd1de-6199-4cea-b388-48ec3a437fc4 None admin] RBAC: Adding query filter params (role.id=3613773e53094931b72912bb4cd6a9df, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=b9971f2bf0f2400b90168f6032a0e226) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:02.403310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfd1de-6199-4cea-b388-48ec3a437fc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:02.405324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfd1de-6199-4cea-b388-48ec3a437fc4 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:02.408397 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198979ca-ba42-4aa5-b50f-8788baab3e63 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:02.411273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 547/1095] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:37:02 2022] GET /identity/v3/role_assignments?user.id=b9971f2bf0f2400b90168f6032a0e226&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=3613773e53094931b72912bb4cd6a9df => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:37:02.444990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958e8d5-c21c-44af-aa97-76a310e4ad68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:02.445886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958e8d5-c21c-44af-aa97-76a310e4ad68 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:02.446168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958e8d5-c21c-44af-aa97-76a310e4ad68 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:02.446449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958e8d5-c21c-44af-aa97-76a310e4ad68 None admin] PATH_INFO: `/v3/users/04a1b0cfd34e41179f777b6444832241` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:02.447763 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958e8d5-c21c-44af-aa97-76a310e4ad68 None admin] RBAC: Authorizing `identity:get_user(user_id=04a1b0cfd34e41179f777b6444832241)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:02.449288 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958e8d5-c21c-44af-aa97-76a310e4ad68 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:02.450943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 549/1096] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:37:02 2022] GET /identity/v3/users/04a1b0cfd34e41179f777b6444832241 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:37:02.457456 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfd1de-6199-4cea-b388-48ec3a437fc4 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:02.566622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfd1de-6199-4cea-b388-48ec3a437fc4 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:02.591034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:02.603062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9c77c-481a-4872-8921-af4da5f15eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:02.603957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c77c-481a-4872-8921-af4da5f15eca None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:02.604239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c77c-481a-4872-8921-af4da5f15eca None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:02.604511 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c77c-481a-4872-8921-af4da5f15eca None admin] PATH_INFO: `/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:02.605696 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9c77c-481a-4872-8921-af4da5f15eca None admin] RBAC: Authorizing `identity:get_project(project_id=125f521f9ff84112b6f3e5af8ce2e52d)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:02.607179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9c77c-481a-4872-8921-af4da5f15eca None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:02.608945 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 548/1097] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:37:02 2022] GET /identity/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:02.614893 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958e8d5-c21c-44af-aa97-76a310e4ad68 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:02.720527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958e8d5-c21c-44af-aa97-76a310e4ad68 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:02.729940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:02.755620 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f332-9b8c-47c8-9f98-75dc6a5faff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:02.756521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f332-9b8c-47c8-9f98-75dc6a5faff4 None admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:02.756800 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f332-9b8c-47c8-9f98-75dc6a5faff4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:02.757073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f332-9b8c-47c8-9f98-75dc6a5faff4 None admin] PATH_INFO: `/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d/users/04a1b0cfd34e41179f777b6444832241/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:02.759069 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5f332-9b8c-47c8-9f98-75dc6a5faff4 None admin] RBAC: Authorizing `identity:create_grant(project_id=125f521f9ff84112b6f3e5af8ce2e52d, user_id=04a1b0cfd34e41179f777b6444832241, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:02.760558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5f332-9b8c-47c8-9f98-75dc6a5faff4 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:02.842932 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 550/1098] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:37:02 2022] PUT /identity/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d/users/04a1b0cfd34e41179f777b6444832241/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:05.069264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49e59b-e7b0-44f8-9a33-d2f216a557a7 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:05.069788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49e59b-e7b0-44f8-9a33-d2f216a557a7 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:05.069788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49e59b-e7b0-44f8-9a33-d2f216a557a7 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:05.071185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 549/1099] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:05.077292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba279de-3224-4cb8-a814-ddaa3647804f None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:05.077808 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba279de-3224-4cb8-a814-ddaa3647804f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:05.077897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba279de-3224-4cb8-a814-ddaa3647804f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:05.095070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-7ba279de-3224-4cb8-a814-ddaa3647804f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:05.096326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7ba279de-3224-4cb8-a814-ddaa3647804f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:05.172873 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 551/1100] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:05.197370 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49e59b-e7b0-44f8-9a33-d2f216a557a7 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:05.300294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49e59b-e7b0-44f8-9a33-d2f216a557a7 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:05.333810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87df26d-247e-45cc-8178-967f41922eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:05.334521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df26d-247e-45cc-8178-967f41922eca None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:05.334807 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df26d-247e-45cc-8178-967f41922eca None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:05.335089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df26d-247e-45cc-8178-967f41922eca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:05.345541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87df26d-247e-45cc-8178-967f41922eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-e87df26d-247e-45cc-8178-967f41922eca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:37:05.353169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:05.354233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:05.355172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:05.355172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:05.355172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:05.355172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:05.355172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:37:05.355172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:37:05.355172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:37:05.355172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:37:05.355172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:37:05.355172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:37:05.355172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:05.355172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:37:05.355172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 550/1101] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:37:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:37:05.361026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba279de-3224-4cb8-a814-ddaa3647804f None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:05.456202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:05.460078 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba279de-3224-4cb8-a814-ddaa3647804f None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:05.493493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e66b3-4b2f-468a-8966-e86f343c414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:05.494258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e66b3-4b2f-468a-8966-e86f343c414f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:05.494585 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e66b3-4b2f-468a-8966-e86f343c414f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:05.495190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e66b3-4b2f-468a-8966-e86f343c414f None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:05.496004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e66b3-4b2f-468a-8966-e86f343c414f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:05.496560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e66b3-4b2f-468a-8966-e86f343c414f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:05.497920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e66b3-4b2f-468a-8966-e86f343c414f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:05.505675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 552/1102] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:37:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:05.511537 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87df26d-247e-45cc-8178-967f41922eca None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:05.561631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:05.610822 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87df26d-247e-45cc-8178-967f41922eca None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:05.645421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9caaf-13a4-4e3c-ada7-4ce796c8dd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:05.646287 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9caaf-13a4-4e3c-ada7-4ce796c8dd45 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:05.646571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9caaf-13a4-4e3c-ada7-4ce796c8dd45 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:05.646847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9caaf-13a4-4e3c-ada7-4ce796c8dd45 None admin] PATH_INFO: `/v3/users/04a1b0cfd34e41179f777b6444832241` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:05.648087 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9caaf-13a4-4e3c-ada7-4ce796c8dd45 None admin] RBAC: Authorizing `identity:get_user(user_id=04a1b0cfd34e41179f777b6444832241)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:05.649523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9caaf-13a4-4e3c-ada7-4ce796c8dd45 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:05.651153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 551/1103] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:37:05 2022] GET /identity/v3/users/04a1b0cfd34e41179f777b6444832241 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:05.657009 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e66b3-4b2f-468a-8966-e86f343c414f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:05.753029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e66b3-4b2f-468a-8966-e86f343c414f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:05.785272 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf9246-81d5-4fd1-839b-76e3455c8d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:05.785907 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9246-81d5-4fd1-839b-76e3455c8d13 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:05.786183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9246-81d5-4fd1-839b-76e3455c8d13 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:05.786451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9246-81d5-4fd1-839b-76e3455c8d13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:05.813222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:05.850749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf9246-81d5-4fd1-839b-76e3455c8d13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:05.852207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf9246-81d5-4fd1-839b-76e3455c8d13 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:05.947024 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 553/1104] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:37:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:37:05.953647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9caaf-13a4-4e3c-ada7-4ce796c8dd45 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:06.051662 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9caaf-13a4-4e3c-ada7-4ce796c8dd45 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:06.068991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:06.085041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc996e61-54a4-4783-ac67-71c5a0502b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:06.085888 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996e61-54a4-4783-ac67-71c5a0502b4c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:06.086167 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996e61-54a4-4783-ac67-71c5a0502b4c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:06.086439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996e61-54a4-4783-ac67-71c5a0502b4c None admin] PATH_INFO: `/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:06.087642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc996e61-54a4-4783-ac67-71c5a0502b4c None admin] RBAC: Authorizing `identity:get_project(project_id=125f521f9ff84112b6f3e5af8ce2e52d)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:06.089071 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc996e61-54a4-4783-ac67-71c5a0502b4c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:06.090826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 552/1105] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:37:05 2022] GET /identity/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:06.097169 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf9246-81d5-4fd1-839b-76e3455c8d13 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:06.154764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:06.194447 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf9246-81d5-4fd1-839b-76e3455c8d13 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:06.226644 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fa92b-a56c-462b-8dcc-51185549c5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:06.227232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fa92b-a56c-462b-8dcc-51185549c5b1 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:06.227547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fa92b-a56c-462b-8dcc-51185549c5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:06.227828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fa92b-a56c-462b-8dcc-51185549c5b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:06.228649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fa92b-a56c-462b-8dcc-51185549c5b1 None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=125f521f9ff84112b6f3e5af8ce2e52d, user.id=04a1b0cfd34e41179f777b6444832241) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:06.228963 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fa92b-a56c-462b-8dcc-51185549c5b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:06.230388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fa92b-a56c-462b-8dcc-51185549c5b1 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:06.236649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 554/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:37:06 2022] GET /identity/v3/role_assignments?user.id=04a1b0cfd34e41179f777b6444832241&scope.project.id=125f521f9ff84112b6f3e5af8ce2e52d&role.id=c5632345c9274d348669482f1f7414c8 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:08.484063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f69e-0834-486a-a0af-33b1705bf327 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.484627 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f69e-0834-486a-a0af-33b1705bf327 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.484627 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f69e-0834-486a-a0af-33b1705bf327 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.485964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 553/1107] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:08.491209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2edfa8-959c-418c-82cb-4dfbdb83264b None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.491612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2edfa8-959c-418c-82cb-4dfbdb83264b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.491794 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2edfa8-959c-418c-82cb-4dfbdb83264b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.509085 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-fc2edfa8-959c-418c-82cb-4dfbdb83264b None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:08.510173 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-fc2edfa8-959c-418c-82cb-4dfbdb83264b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:08.573604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 555/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:08.598214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2f69e-0834-486a-a0af-33b1705bf327 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:08.699476 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2f69e-0834-486a-a0af-33b1705bf327 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:08.733999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991eb76e-2ac5-48e4-83bc-5419201fbb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:08.734780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991eb76e-2ac5-48e4-83bc-5419201fbb09 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.735063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991eb76e-2ac5-48e4-83bc-5419201fbb09 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.735342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991eb76e-2ac5-48e4-83bc-5419201fbb09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.736546 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991eb76e-2ac5-48e4-83bc-5419201fbb09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:08.737977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991eb76e-2ac5-48e4-83bc-5419201fbb09 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:08.739609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 554/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:37:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:08.745578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2edfa8-959c-418c-82cb-4dfbdb83264b None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:08.799440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:08.841898 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2edfa8-959c-418c-82cb-4dfbdb83264b None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:08.876288 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0a4cd-d030-46e3-b218-87fafdf92bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:08.876945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0a4cd-d030-46e3-b218-87fafdf92bc7 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.877227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0a4cd-d030-46e3-b218-87fafdf92bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.877500 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0a4cd-d030-46e3-b218-87fafdf92bc7 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.878199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0a4cd-d030-46e3-b218-87fafdf92bc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:08.879646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0a4cd-d030-46e3-b218-87fafdf92bc7 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:08.979588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 556/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:37:08 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:11.250210 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9b5d6-e008-499d-8fe2-83ee7cfb792f None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.250774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9b5d6-e008-499d-8fe2-83ee7cfb792f None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.250774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9b5d6-e008-499d-8fe2-83ee7cfb792f None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.252161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 555/1111] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:11.257591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3926-6d33-4978-ab48-6aa9d50ce2f6 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.257953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3926-6d33-4978-ab48-6aa9d50ce2f6 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.258155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3926-6d33-4978-ab48-6aa9d50ce2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.275552 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-e98c3926-6d33-4978-ab48-6aa9d50ce2f6 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:11.276778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e98c3926-6d33-4978-ab48-6aa9d50ce2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:11.341902 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 557/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:11.365960 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9b5d6-e008-499d-8fe2-83ee7cfb792f None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:11.422955 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:11.469957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9b5d6-e008-499d-8fe2-83ee7cfb792f None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:11.502959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a35341-ce50-4422-83af-4f87e592cfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:11.503818 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35341-ce50-4422-83af-4f87e592cfbe None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.504048 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35341-ce50-4422-83af-4f87e592cfbe None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.504317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35341-ce50-4422-83af-4f87e592cfbe None admin] PATH_INFO: `/v3/roles/e97885113c774466b7432083b511fa58` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.505778 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35341-ce50-4422-83af-4f87e592cfbe None admin] RBAC: Authorizing `identity:get_role(role_id=e97885113c774466b7432083b511fa58)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:11.507136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35341-ce50-4422-83af-4f87e592cfbe None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:11.508515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 556/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:37:11 2022] GET /identity/v3/roles/e97885113c774466b7432083b511fa58 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:11.514897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c3926-6d33-4978-ab48-6aa9d50ce2f6 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:11.555116 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:11.611266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c3926-6d33-4978-ab48-6aa9d50ce2f6 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:11.734289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad84bce-dad2-4489-a365-64d94a564157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:11.735152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad84bce-dad2-4489-a365-64d94a564157 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.735433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad84bce-dad2-4489-a365-64d94a564157 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.735737 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad84bce-dad2-4489-a365-64d94a564157 None admin] PATH_INFO: `/v3/users/a84d5690228644a49c3822d96f987969` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.749384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad84bce-dad2-4489-a365-64d94a564157 None admin] RBAC: Authorizing `identity:get_user(user_id=a84d5690228644a49c3822d96f987969)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:11.755762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad84bce-dad2-4489-a365-64d94a564157 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:11.755762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 558/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:37:11 2022] GET /identity/v3/users/a84d5690228644a49c3822d96f987969 => generated 286 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:11.758304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a35341-ce50-4422-83af-4f87e592cfbe None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:11.855859 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a35341-ce50-4422-83af-4f87e592cfbe None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:11.878946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:11.890861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719c381-d4c3-42f4-a96f-4cb84ab4b90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:11.891535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719c381-d4c3-42f4-a96f-4cb84ab4b90a None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.891820 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719c381-d4c3-42f4-a96f-4cb84ab4b90a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.892092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719c381-d4c3-42f4-a96f-4cb84ab4b90a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.958531 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719c381-d4c3-42f4-a96f-4cb84ab4b90a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:11.960011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719c381-d4c3-42f4-a96f-4cb84ab4b90a None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:12.055340 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 557/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:37:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:37:12.061806 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad84bce-dad2-4489-a365-64d94a564157 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:12.155302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:12.159066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad84bce-dad2-4489-a365-64d94a564157 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:12.192587 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677640c0-ec90-4362-a26a-55d91fa07b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:12.193427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677640c0-ec90-4362-a26a-55d91fa07b25 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:12.193713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677640c0-ec90-4362-a26a-55d91fa07b25 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:12.193990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677640c0-ec90-4362-a26a-55d91fa07b25 None admin] PATH_INFO: `/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:12.195158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677640c0-ec90-4362-a26a-55d91fa07b25 None admin] RBAC: Authorizing `identity:get_project(project_id=125f521f9ff84112b6f3e5af8ce2e52d)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:12.196627 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677640c0-ec90-4362-a26a-55d91fa07b25 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:12.198308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 559/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:37:12 2022] GET /identity/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:12.204510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719c381-d4c3-42f4-a96f-4cb84ab4b90a None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:12.227721 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:12.302902 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719c381-d4c3-42f4-a96f-4cb84ab4b90a None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:12.336559 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684076a-fd15-4a4f-8cff-4ede384e9e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:12.337165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684076a-fd15-4a4f-8cff-4ede384e9e39 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:12.337450 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684076a-fd15-4a4f-8cff-4ede384e9e39 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:12.337725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684076a-fd15-4a4f-8cff-4ede384e9e39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:12.338548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684076a-fd15-4a4f-8cff-4ede384e9e39 None admin] RBAC: Adding query filter params (role.id=e97885113c774466b7432083b511fa58, scope.project.id=125f521f9ff84112b6f3e5af8ce2e52d, user.id=a84d5690228644a49c3822d96f987969) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:12.338860 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684076a-fd15-4a4f-8cff-4ede384e9e39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:12.340325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684076a-fd15-4a4f-8cff-4ede384e9e39 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:12.346139 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 558/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:37:12 2022] GET /identity/v3/role_assignments?user.id=a84d5690228644a49c3822d96f987969&scope.project.id=125f521f9ff84112b6f3e5af8ce2e52d&role.id=e97885113c774466b7432083b511fa58 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:14.555059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b911f10-48be-4ad3-aeab-c21f561ab21a None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.555615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b911f10-48be-4ad3-aeab-c21f561ab21a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.555615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b911f10-48be-4ad3-aeab-c21f561ab21a None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.556929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 560/1118] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:14.562101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa09fe4-f1ae-4fd8-beaf-d80d2f4ce909 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.562484 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa09fe4-f1ae-4fd8-beaf-d80d2f4ce909 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.562670 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa09fe4-f1ae-4fd8-beaf-d80d2f4ce909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.580106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-caa09fe4-f1ae-4fd8-beaf-d80d2f4ce909 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:14.581300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-caa09fe4-f1ae-4fd8-beaf-d80d2f4ce909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:14.648464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 559/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:14.670735 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b911f10-48be-4ad3-aeab-c21f561ab21a None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:14.770210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b911f10-48be-4ad3-aeab-c21f561ab21a None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:14.801948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f084a0-e77f-4bb8-a1a8-ff606aad2755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:14.802784 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f084a0-e77f-4bb8-a1a8-ff606aad2755 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.803062 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f084a0-e77f-4bb8-a1a8-ff606aad2755 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.803331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f084a0-e77f-4bb8-a1a8-ff606aad2755 None admin] PATH_INFO: `/v3/roles/e97885113c774466b7432083b511fa58` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.804822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f084a0-e77f-4bb8-a1a8-ff606aad2755 None admin] RBAC: Authorizing `identity:get_role(role_id=e97885113c774466b7432083b511fa58)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:14.806234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f084a0-e77f-4bb8-a1a8-ff606aad2755 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:14.807556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 561/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:37:14 2022] GET /identity/v3/roles/e97885113c774466b7432083b511fa58 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:14.813876 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa09fe4-f1ae-4fd8-beaf-d80d2f4ce909 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:14.831607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:14.910322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa09fe4-f1ae-4fd8-beaf-d80d2f4ce909 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:14.943332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64579b7-733b-4f4e-adcb-ffdad0247474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:14.944218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64579b7-733b-4f4e-adcb-ffdad0247474 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.944499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64579b7-733b-4f4e-adcb-ffdad0247474 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.944771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64579b7-733b-4f4e-adcb-ffdad0247474 None admin] PATH_INFO: `/v3/users/a84d5690228644a49c3822d96f987969` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.945957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64579b7-733b-4f4e-adcb-ffdad0247474 None admin] RBAC: Authorizing `identity:get_user(user_id=a84d5690228644a49c3822d96f987969)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:14.947406 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64579b7-733b-4f4e-adcb-ffdad0247474 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:14.949048 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 560/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:37:14 2022] GET /identity/v3/users/a84d5690228644a49c3822d96f987969 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:14.955386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f084a0-e77f-4bb8-a1a8-ff606aad2755 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:14.988292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:15.051443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f084a0-e77f-4bb8-a1a8-ff606aad2755 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:15.084033 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650566af-b9de-456d-89ab-7c80c67f1986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:15.084814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650566af-b9de-456d-89ab-7c80c67f1986 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:15.085096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650566af-b9de-456d-89ab-7c80c67f1986 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:15.085372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650566af-b9de-456d-89ab-7c80c67f1986 None admin] PATH_INFO: `/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:15.086539 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650566af-b9de-456d-89ab-7c80c67f1986 None admin] RBAC: Authorizing `identity:get_project(project_id=125f521f9ff84112b6f3e5af8ce2e52d)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:15.087999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650566af-b9de-456d-89ab-7c80c67f1986 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:15.089675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 562/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:37:14 2022] GET /identity/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:15.095686 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64579b7-733b-4f4e-adcb-ffdad0247474 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:15.177046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:15.192509 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64579b7-733b-4f4e-adcb-ffdad0247474 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:15.226103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2f64c-4c42-4a4b-83f8-30315ba4e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:15.226969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2f64c-4c42-4a4b-83f8-30315ba4e503 None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:15.227248 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2f64c-4c42-4a4b-83f8-30315ba4e503 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:15.227546 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2f64c-4c42-4a4b-83f8-30315ba4e503 None admin] PATH_INFO: `/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d/users/a84d5690228644a49c3822d96f987969/roles/e97885113c774466b7432083b511fa58` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:15.229695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2f64c-4c42-4a4b-83f8-30315ba4e503 None admin] RBAC: Authorizing `identity:create_grant(project_id=125f521f9ff84112b6f3e5af8ce2e52d, user_id=a84d5690228644a49c3822d96f987969, role_id=e97885113c774466b7432083b511fa58)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:15.231120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2f64c-4c42-4a4b-83f8-30315ba4e503 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:15.340153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 561/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:37:15 2022] PUT /identity/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d/users/a84d5690228644a49c3822d96f987969/roles/e97885113c774466b7432083b511fa58 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:17.550588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ac11-5572-4b58-8afd-86826150f48d None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:17.551106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ac11-5572-4b58-8afd-86826150f48d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:17.551106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ac11-5572-4b58-8afd-86826150f48d None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:17.552457 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 563/1124] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:17.557740 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8a801-83bb-420e-8b78-66dcdb39a32b None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:17.558151 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8a801-83bb-420e-8b78-66dcdb39a32b None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:17.558299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8a801-83bb-420e-8b78-66dcdb39a32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:17.575470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-54a8a801-83bb-420e-8b78-66dcdb39a32b None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:17.576794 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-54a8a801-83bb-420e-8b78-66dcdb39a32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:17.642073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 562/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:17.665871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044ac11-5572-4b58-8afd-86826150f48d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:17.764313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044ac11-5572-4b58-8afd-86826150f48d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:17.765817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:17.798558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387c8bc-aa17-4e6a-bcd8-02e9337a600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:17.799395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387c8bc-aa17-4e6a-bcd8-02e9337a600c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:17.799702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387c8bc-aa17-4e6a-bcd8-02e9337a600c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:17.799973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387c8bc-aa17-4e6a-bcd8-02e9337a600c None admin] PATH_INFO: `/v3/roles/e97885113c774466b7432083b511fa58` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:17.801486 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387c8bc-aa17-4e6a-bcd8-02e9337a600c None admin] RBAC: Authorizing `identity:get_role(role_id=e97885113c774466b7432083b511fa58)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:17.802798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387c8bc-aa17-4e6a-bcd8-02e9337a600c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:17.804193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 564/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:37:17 2022] GET /identity/v3/roles/e97885113c774466b7432083b511fa58 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:17.810063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8a801-83bb-420e-8b78-66dcdb39a32b None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:17.882746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:17.907368 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8a801-83bb-420e-8b78-66dcdb39a32b None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:17.941331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32e33b-14cf-4e24-826f-c444184881e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:17.942199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32e33b-14cf-4e24-826f-c444184881e0 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:17.942483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32e33b-14cf-4e24-826f-c444184881e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:17.942759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32e33b-14cf-4e24-826f-c444184881e0 None admin] PATH_INFO: `/v3/users/a84d5690228644a49c3822d96f987969` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:17.944074 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32e33b-14cf-4e24-826f-c444184881e0 None admin] RBAC: Authorizing `identity:get_user(user_id=a84d5690228644a49c3822d96f987969)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:17.945513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32e33b-14cf-4e24-826f-c444184881e0 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:17.947130 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 563/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:37:17 2022] GET /identity/v3/users/a84d5690228644a49c3822d96f987969 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:17.952907 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387c8bc-aa17-4e6a-bcd8-02e9337a600c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:18.049276 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387c8bc-aa17-4e6a-bcd8-02e9337a600c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:18.081830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811c4ea-65fe-496a-965b-43a36ff6dbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:18.082404 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811c4ea-65fe-496a-965b-43a36ff6dbab None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:18.082687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811c4ea-65fe-496a-965b-43a36ff6dbab None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:18.082962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811c4ea-65fe-496a-965b-43a36ff6dbab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:18.120274 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:18.147698 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811c4ea-65fe-496a-965b-43a36ff6dbab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:18.149133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811c4ea-65fe-496a-965b-43a36ff6dbab None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:18.246871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 565/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:37:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:37:18.253606 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32e33b-14cf-4e24-826f-c444184881e0 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:18.352281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32e33b-14cf-4e24-826f-c444184881e0 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:18.386281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99942fa-7bc2-4290-a033-a2bc8635520c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:18.387137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99942fa-7bc2-4290-a033-a2bc8635520c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:18.387420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99942fa-7bc2-4290-a033-a2bc8635520c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:18.387736 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99942fa-7bc2-4290-a033-a2bc8635520c None admin] PATH_INFO: `/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:18.388917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99942fa-7bc2-4290-a033-a2bc8635520c None admin] RBAC: Authorizing `identity:get_project(project_id=125f521f9ff84112b6f3e5af8ce2e52d)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:18.390950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99942fa-7bc2-4290-a033-a2bc8635520c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:18.392690 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 564/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:37:18 2022] GET /identity/v3/projects/125f521f9ff84112b6f3e5af8ce2e52d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:37:18.398880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811c4ea-65fe-496a-965b-43a36ff6dbab None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:18.467866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:18.497813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811c4ea-65fe-496a-965b-43a36ff6dbab None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:18.531443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dacbf-c006-4993-9589-c783be49454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:18.532113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dacbf-c006-4993-9589-c783be49454f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:18.532396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dacbf-c006-4993-9589-c783be49454f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:18.532672 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dacbf-c006-4993-9589-c783be49454f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:18.533493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dacbf-c006-4993-9589-c783be49454f None admin] RBAC: Adding query filter params (role.id=e97885113c774466b7432083b511fa58, scope.project.id=125f521f9ff84112b6f3e5af8ce2e52d, user.id=a84d5690228644a49c3822d96f987969) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:18.533803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dacbf-c006-4993-9589-c783be49454f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:18.535230 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dacbf-c006-4993-9589-c783be49454f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:18.541124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 566/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:37:18 2022] GET /identity/v3/role_assignments?user.id=a84d5690228644a49c3822d96f987969&scope.project.id=125f521f9ff84112b6f3e5af8ce2e52d&role.id=e97885113c774466b7432083b511fa58 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:20.778878 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab0de0-33aa-434a-9626-e7629c233bb7 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:20.779430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab0de0-33aa-434a-9626-e7629c233bb7 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:20.779430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab0de0-33aa-434a-9626-e7629c233bb7 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:20.781486 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 565/1131] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:20.786639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b24579-47d7-438c-b315-c2c1516e39c0 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:20.787077 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b24579-47d7-438c-b315-c2c1516e39c0 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:20.787183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b24579-47d7-438c-b315-c2c1516e39c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:20.804623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-92b24579-47d7-438c-b315-c2c1516e39c0 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:20.805793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-92b24579-47d7-438c-b315-c2c1516e39c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:20.870082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 567/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:20.893610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab0de0-33aa-434a-9626-e7629c233bb7 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:20.906284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:20.993643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab0de0-33aa-434a-9626-e7629c233bb7 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:21.027591 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b776ed7-ae1e-4048-b89e-9446f4c37a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:21.028368 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b776ed7-ae1e-4048-b89e-9446f4c37a14 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:21.028652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b776ed7-ae1e-4048-b89e-9446f4c37a14 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:21.028977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b776ed7-ae1e-4048-b89e-9446f4c37a14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:21.030709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b776ed7-ae1e-4048-b89e-9446f4c37a14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:21.032183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b776ed7-ae1e-4048-b89e-9446f4c37a14 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:21.033784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 566/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:37:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:21.039707 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b24579-47d7-438c-b315-c2c1516e39c0 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:21.098965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:21.134803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b24579-47d7-438c-b315-c2c1516e39c0 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:21.168506 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99452c4-a89e-48a1-9bc6-6d864111f6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:21.169148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99452c4-a89e-48a1-9bc6-6d864111f6e3 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:21.169422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99452c4-a89e-48a1-9bc6-6d864111f6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:21.169691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99452c4-a89e-48a1-9bc6-6d864111f6e3 None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:21.170410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99452c4-a89e-48a1-9bc6-6d864111f6e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:21.171877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99452c4-a89e-48a1-9bc6-6d864111f6e3 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:21.290088 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 568/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 2 13:37:21 2022] POST /identity/v3/projects => generated 311 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:23.546896 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939450f1-5887-41bf-b60a-cb0af004a26e None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:23.547412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939450f1-5887-41bf-b60a-cb0af004a26e None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:23.547412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939450f1-5887-41bf-b60a-cb0af004a26e None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:23.548852 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 567/1135] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:23.554257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03182b-a868-463a-af41-28d20101e40b None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:23.554678 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03182b-a868-463a-af41-28d20101e40b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:23.554814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03182b-a868-463a-af41-28d20101e40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:23.571207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-ab03182b-a868-463a-af41-28d20101e40b None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:23.572421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ab03182b-a868-463a-af41-28d20101e40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:23.637171 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 569/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:37:23.662098 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939450f1-5887-41bf-b60a-cb0af004a26e None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:23.738791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:23.761302 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939450f1-5887-41bf-b60a-cb0af004a26e None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:23.795185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475157b-df6e-4ece-8538-c23d3acee129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:23.796032 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475157b-df6e-4ece-8538-c23d3acee129 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:23.796311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475157b-df6e-4ece-8538-c23d3acee129 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:23.796584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475157b-df6e-4ece-8538-c23d3acee129 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:23.797820 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475157b-df6e-4ece-8538-c23d3acee129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:23.799202 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475157b-df6e-4ece-8538-c23d3acee129 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:23.800854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 568/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:37:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:23.806594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03182b-a868-463a-af41-28d20101e40b None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:23.852091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:23.904685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03182b-a868-463a-af41-28d20101e40b None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:23.938226 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e5e6d-7af4-4375-82e8-322d5866a736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:23.938880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5e6d-7af4-4375-82e8-322d5866a736 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:23.939162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5e6d-7af4-4375-82e8-322d5866a736 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:23.939435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5e6d-7af4-4375-82e8-322d5866a736 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:23.940157 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e5e6d-7af4-4375-82e8-322d5866a736 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:23.941579 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e5e6d-7af4-4375-82e8-322d5866a736 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:24.048427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 570/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:37:23 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:26.315760 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980603a5-5f19-42a6-99ad-ff8bc642ffb2 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:26.316292 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980603a5-5f19-42a6-99ad-ff8bc642ffb2 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:26.316292 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980603a5-5f19-42a6-99ad-ff8bc642ffb2 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:26.317664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 569/1139] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:26.322942 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee989a5-8543-4227-b3f4-dd1abe6b8069 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:26.323334 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee989a5-8543-4227-b3f4-dd1abe6b8069 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:26.323536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee989a5-8543-4227-b3f4-dd1abe6b8069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:26.339950 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-bee989a5-8543-4227-b3f4-dd1abe6b8069 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:26.341134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-bee989a5-8543-4227-b3f4-dd1abe6b8069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:26.406213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 571/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:26.430231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980603a5-5f19-42a6-99ad-ff8bc642ffb2 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:26.529668 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980603a5-5f19-42a6-99ad-ff8bc642ffb2 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:26.562633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f474e-df02-42e4-afde-482e996189d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:26.571534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f474e-df02-42e4-afde-482e996189d7 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:26.571534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f474e-df02-42e4-afde-482e996189d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:26.571534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f474e-df02-42e4-afde-482e996189d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:26.573947 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f474e-df02-42e4-afde-482e996189d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-833f474e-df02-42e4-afde-482e996189d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:37:26.582179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:26.583309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:26.584438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:26.584438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:26.584438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:26.584438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:26.584438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:37:26.584438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:37:26.584438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:37:26.584438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:37:26.584438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:37:26.584438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:37:26.584438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:26.584438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:37:26.584438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 570/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:37:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:37:26.589432 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee989a5-8543-4227-b3f4-dd1abe6b8069 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:26.619296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:26.684196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee989a5-8543-4227-b3f4-dd1abe6b8069 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:26.717680 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7ffdf-01ad-42b6-a4f7-9bff44ae07ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:26.718334 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7ffdf-01ad-42b6-a4f7-9bff44ae07ab None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:26.718612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7ffdf-01ad-42b6-a4f7-9bff44ae07ab None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:26.718881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7ffdf-01ad-42b6-a4f7-9bff44ae07ab None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:26.719643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7ffdf-01ad-42b6-a4f7-9bff44ae07ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:26.719947 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7ffdf-01ad-42b6-a4f7-9bff44ae07ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:26.721294 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7ffdf-01ad-42b6-a4f7-9bff44ae07ab None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:26.729271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 572/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:37:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:26.735314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f474e-df02-42e4-afde-482e996189d7 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:26.744496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:26.833177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f474e-df02-42e4-afde-482e996189d7 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:26.864835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54401d02-5c8d-4365-8534-ec5f4f905861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:26.865692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54401d02-5c8d-4365-8534-ec5f4f905861 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:26.865970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54401d02-5c8d-4365-8534-ec5f4f905861 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:26.866239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54401d02-5c8d-4365-8534-ec5f4f905861 None admin] PATH_INFO: `/v3/users/0ace8d13a8a245b480a847834ef32ff2` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:26.880578 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54401d02-5c8d-4365-8534-ec5f4f905861 None admin] RBAC: Authorizing `identity:get_user(user_id=0ace8d13a8a245b480a847834ef32ff2)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:26.882028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54401d02-5c8d-4365-8534-ec5f4f905861 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:26.883723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 571/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:37:26 2022] GET /identity/v3/users/0ace8d13a8a245b480a847834ef32ff2 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:26.890055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7ffdf-01ad-42b6-a4f7-9bff44ae07ab None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:26.980117 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:26.987130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7ffdf-01ad-42b6-a4f7-9bff44ae07ab None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:27.020124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddcea8-e167-4072-b973-2ff7b5f854c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:27.020769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddcea8-e167-4072-b973-2ff7b5f854c1 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:27.021052 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddcea8-e167-4072-b973-2ff7b5f854c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:27.021331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddcea8-e167-4072-b973-2ff7b5f854c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:27.087230 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddcea8-e167-4072-b973-2ff7b5f854c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:27.088634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddcea8-e167-4072-b973-2ff7b5f854c1 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:27.176817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:27.183883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 573/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:37:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:37:27.190302 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54401d02-5c8d-4365-8534-ec5f4f905861 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:27.250585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:27.286656 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54401d02-5c8d-4365-8534-ec5f4f905861 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:27.320987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ea79e-fd29-4672-a1ac-389d5d28332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:27.321839 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ea79e-fd29-4672-a1ac-389d5d28332f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:27.322122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ea79e-fd29-4672-a1ac-389d5d28332f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:27.322397 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ea79e-fd29-4672-a1ac-389d5d28332f None admin] PATH_INFO: `/v3/projects/892dff0ec78841a3a6da31c0f82e8676` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:27.323583 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ea79e-fd29-4672-a1ac-389d5d28332f None admin] RBAC: Authorizing `identity:get_project(project_id=892dff0ec78841a3a6da31c0f82e8676)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:27.325019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ea79e-fd29-4672-a1ac-389d5d28332f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:27.326707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 572/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:37:27 2022] GET /identity/v3/projects/892dff0ec78841a3a6da31c0f82e8676 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:27.332750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddcea8-e167-4072-b973-2ff7b5f854c1 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:27.438880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddcea8-e167-4072-b973-2ff7b5f854c1 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:27.473449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5ca2c-a767-4f83-a12f-b3604a433377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:27.474093 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ca2c-a767-4f83-a12f-b3604a433377 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:27.474371 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ca2c-a767-4f83-a12f-b3604a433377 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:27.474637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ca2c-a767-4f83-a12f-b3604a433377 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:27.475444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5ca2c-a767-4f83-a12f-b3604a433377 None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=892dff0ec78841a3a6da31c0f82e8676, user.id=0ace8d13a8a245b480a847834ef32ff2) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:27.475785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5ca2c-a767-4f83-a12f-b3604a433377 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:27.477197 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5ca2c-a767-4f83-a12f-b3604a433377 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:27.482577 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 574/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:37:27 2022] GET /identity/v3/role_assignments?user.id=0ace8d13a8a245b480a847834ef32ff2&scope.project.id=892dff0ec78841a3a6da31c0f82e8676&role.id=c5632345c9274d348669482f1f7414c8 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:29.679413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb20fc-5fca-4fa3-884f-22a23c02159c None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:29.679938 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb20fc-5fca-4fa3-884f-22a23c02159c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:29.680052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb20fc-5fca-4fa3-884f-22a23c02159c None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:29.681375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 573/1147] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:29.687074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7e607-b2dc-454c-a0a4-d74d792369ca None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:29.687540 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7e607-b2dc-454c-a0a4-d74d792369ca None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:29.687643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7e607-b2dc-454c-a0a4-d74d792369ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:29.704587 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-a3c7e607-b2dc-454c-a0a4-d74d792369ca None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:29.705788 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a3c7e607-b2dc-454c-a0a4-d74d792369ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:29.757163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:29.770910 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 575/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:29.793548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb20fc-5fca-4fa3-884f-22a23c02159c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:29.893951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb20fc-5fca-4fa3-884f-22a23c02159c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:29.922100 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:29.926661 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219173f-1900-4290-aca6-307d3306711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:29.927440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219173f-1900-4290-aca6-307d3306711d None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:29.927746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219173f-1900-4290-aca6-307d3306711d None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:29.928020 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219173f-1900-4290-aca6-307d3306711d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:29.944394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219173f-1900-4290-aca6-307d3306711d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-f219173f-1900-4290-aca6-307d3306711d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:37:29.945953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:29.947044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:29.948342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:29.948342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:29.948342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:29.948342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:29.948342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:37:29.948342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:37:29.948342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:37:29.948342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:37:29.948342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:37:29.948342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:37:29.948342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:29.948342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:37:29.948342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 574/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:37:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:37:29.953722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7e607-b2dc-454c-a0a4-d74d792369ca None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:30.047637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7e607-b2dc-454c-a0a4-d74d792369ca None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:30.079707 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7df132-127b-4836-9c47-6179ed1f645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:30.080350 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7df132-127b-4836-9c47-6179ed1f645e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:30.080629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7df132-127b-4836-9c47-6179ed1f645e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:30.080897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7df132-127b-4836-9c47-6179ed1f645e None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:30.081623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7df132-127b-4836-9c47-6179ed1f645e None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:30.081921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7df132-127b-4836-9c47-6179ed1f645e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:30.083264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7df132-127b-4836-9c47-6179ed1f645e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:30.090924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 576/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:37:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:30.096804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219173f-1900-4290-aca6-307d3306711d None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:30.198132 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219173f-1900-4290-aca6-307d3306711d None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:30.232190 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c359f-ee3d-4925-8cb2-869636a77676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:30.233569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c359f-ee3d-4925-8cb2-869636a77676 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:30.233852 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c359f-ee3d-4925-8cb2-869636a77676 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:30.234125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c359f-ee3d-4925-8cb2-869636a77676 None admin] PATH_INFO: `/v3/users/0ace8d13a8a245b480a847834ef32ff2` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:30.235319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c359f-ee3d-4925-8cb2-869636a77676 None admin] RBAC: Authorizing `identity:get_user(user_id=0ace8d13a8a245b480a847834ef32ff2)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:30.236836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c359f-ee3d-4925-8cb2-869636a77676 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:30.238477 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 575/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:37:30 2022] GET /identity/v3/users/0ace8d13a8a245b480a847834ef32ff2 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:30.244207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7df132-127b-4836-9c47-6179ed1f645e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:30.297235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:30.348803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7df132-127b-4836-9c47-6179ed1f645e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:30.382826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0ffc7-84a0-451e-b928-6e74009d993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:30.383721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0ffc7-84a0-451e-b928-6e74009d993f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:30.384012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0ffc7-84a0-451e-b928-6e74009d993f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:30.384285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0ffc7-84a0-451e-b928-6e74009d993f None admin] PATH_INFO: `/v3/projects/892dff0ec78841a3a6da31c0f82e8676` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:30.385456 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0ffc7-84a0-451e-b928-6e74009d993f None admin] RBAC: Authorizing `identity:get_project(project_id=892dff0ec78841a3a6da31c0f82e8676)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:30.386901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0ffc7-84a0-451e-b928-6e74009d993f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:30.388624 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 577/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:37:30 2022] GET /identity/v3/projects/892dff0ec78841a3a6da31c0f82e8676 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:30.394612 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c359f-ee3d-4925-8cb2-869636a77676 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:30.469194 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:30.509789 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c359f-ee3d-4925-8cb2-869636a77676 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:30.544638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62851a3-d463-46f4-882c-a302faa7e74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:30.546077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62851a3-d463-46f4-882c-a302faa7e74b None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:30.546371 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62851a3-d463-46f4-882c-a302faa7e74b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:30.546645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62851a3-d463-46f4-882c-a302faa7e74b None admin] PATH_INFO: `/v3/projects/892dff0ec78841a3a6da31c0f82e8676/users/0ace8d13a8a245b480a847834ef32ff2/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:30.548632 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62851a3-d463-46f4-882c-a302faa7e74b None admin] RBAC: Authorizing `identity:create_grant(project_id=892dff0ec78841a3a6da31c0f82e8676, user_id=0ace8d13a8a245b480a847834ef32ff2, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:30.550065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62851a3-d463-46f4-882c-a302faa7e74b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:30.648782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 576/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:37:30 2022] PUT /identity/v3/projects/892dff0ec78841a3a6da31c0f82e8676/users/0ace8d13a8a245b480a847834ef32ff2/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:32.871547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c908c-6cf9-49e7-acf0-b975889cb4cb None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:32.872360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c908c-6cf9-49e7-acf0-b975889cb4cb None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:32.872360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c908c-6cf9-49e7-acf0-b975889cb4cb None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:32.873733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 578/1154] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:32.879012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc7d8f-5b6e-4b1a-a878-f68496472bcf None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:32.879404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc7d8f-5b6e-4b1a-a878-f68496472bcf None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:32.879604 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc7d8f-5b6e-4b1a-a878-f68496472bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:32.896114 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-01fc7d8f-5b6e-4b1a-a878-f68496472bcf None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:32.897278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-01fc7d8f-5b6e-4b1a-a878-f68496472bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:32.963773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 577/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:32.988111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c908c-6cf9-49e7-acf0-b975889cb4cb None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:33.087558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c908c-6cf9-49e7-acf0-b975889cb4cb None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:33.104016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:33.119857 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc43e24-3d92-4cfa-8ff6-ee34fe40af21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:33.121017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc43e24-3d92-4cfa-8ff6-ee34fe40af21 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:33.121017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc43e24-3d92-4cfa-8ff6-ee34fe40af21 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:33.121366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc43e24-3d92-4cfa-8ff6-ee34fe40af21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:33.131557 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc43e24-3d92-4cfa-8ff6-ee34fe40af21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-6bc43e24-3d92-4cfa-8ff6-ee34fe40af21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:37:33.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:33.140919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:33.141795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:33.141795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:33.141795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:33.141795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:33.141795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:37:33.141795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:37:33.141795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:37:33.141795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:37:33.141795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:37:33.141795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:37:33.141795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:33.141795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:37:33.143413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 579/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:37:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:37:33.147364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc7d8f-5b6e-4b1a-a878-f68496472bcf None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:33.195517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:33.244671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc7d8f-5b6e-4b1a-a878-f68496472bcf None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:33.278997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6043450-1e39-4a15-84aa-61b190dce90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:33.279699 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6043450-1e39-4a15-84aa-61b190dce90f None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:33.280550 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6043450-1e39-4a15-84aa-61b190dce90f None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:33.280826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6043450-1e39-4a15-84aa-61b190dce90f None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:33.281573 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6043450-1e39-4a15-84aa-61b190dce90f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:33.281881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6043450-1e39-4a15-84aa-61b190dce90f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:33.283257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6043450-1e39-4a15-84aa-61b190dce90f None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:33.291305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 578/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:37:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:33.297318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc43e24-3d92-4cfa-8ff6-ee34fe40af21 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:33.395353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc43e24-3d92-4cfa-8ff6-ee34fe40af21 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:33.427855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f4aac-c7b5-4c3b-adfe-6c1a7f32b7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:33.428719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f4aac-c7b5-4c3b-adfe-6c1a7f32b7af None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:33.428999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f4aac-c7b5-4c3b-adfe-6c1a7f32b7af None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:33.429273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f4aac-c7b5-4c3b-adfe-6c1a7f32b7af None admin] PATH_INFO: `/v3/users/0ace8d13a8a245b480a847834ef32ff2` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:33.430462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f4aac-c7b5-4c3b-adfe-6c1a7f32b7af None admin] RBAC: Authorizing `identity:get_user(user_id=0ace8d13a8a245b480a847834ef32ff2)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:33.431954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f4aac-c7b5-4c3b-adfe-6c1a7f32b7af None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:33.433584 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 580/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:37:33 2022] GET /identity/v3/users/0ace8d13a8a245b480a847834ef32ff2 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:33.441856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6043450-1e39-4a15-84aa-61b190dce90f None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:33.550697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6043450-1e39-4a15-84aa-61b190dce90f None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:33.563714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:33.584252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9310a7-046f-49f9-89d9-58962fa4e6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:33.584901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9310a7-046f-49f9-89d9-58962fa4e6c5 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:33.585180 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9310a7-046f-49f9-89d9-58962fa4e6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:33.585450 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9310a7-046f-49f9-89d9-58962fa4e6c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:33.652391 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9310a7-046f-49f9-89d9-58962fa4e6c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:33.653766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9310a7-046f-49f9-89d9-58962fa4e6c5 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:33.750681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 579/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:37:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:37:33.756676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f4aac-c7b5-4c3b-adfe-6c1a7f32b7af None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:33.801442 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:33.852267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f4aac-c7b5-4c3b-adfe-6c1a7f32b7af None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:33.886047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdad44-5efc-4974-8390-f41bb530be35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:33.886902 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdad44-5efc-4974-8390-f41bb530be35 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:33.887185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdad44-5efc-4974-8390-f41bb530be35 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:33.887484 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdad44-5efc-4974-8390-f41bb530be35 None admin] PATH_INFO: `/v3/projects/892dff0ec78841a3a6da31c0f82e8676` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:33.888660 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdad44-5efc-4974-8390-f41bb530be35 None admin] RBAC: Authorizing `identity:get_project(project_id=892dff0ec78841a3a6da31c0f82e8676)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:33.890119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdad44-5efc-4974-8390-f41bb530be35 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:33.891824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 581/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:37:33 2022] GET /identity/v3/projects/892dff0ec78841a3a6da31c0f82e8676 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:33.897932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9310a7-046f-49f9-89d9-58962fa4e6c5 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:33.911743 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:33.994473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9310a7-046f-49f9-89d9-58962fa4e6c5 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:34.027825 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fff76-2ae4-4f3b-9645-4a6709dbd5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:34.028476 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fff76-2ae4-4f3b-9645-4a6709dbd5c9 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:34.028760 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fff76-2ae4-4f3b-9645-4a6709dbd5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:34.029036 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fff76-2ae4-4f3b-9645-4a6709dbd5c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:34.029860 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fff76-2ae4-4f3b-9645-4a6709dbd5c9 None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=892dff0ec78841a3a6da31c0f82e8676, user.id=0ace8d13a8a245b480a847834ef32ff2) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:34.030172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fff76-2ae4-4f3b-9645-4a6709dbd5c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:34.031644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fff76-2ae4-4f3b-9645-4a6709dbd5c9 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:34.037370 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 580/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:37:33 2022] GET /identity/v3/role_assignments?user.id=0ace8d13a8a245b480a847834ef32ff2&scope.project.id=892dff0ec78841a3a6da31c0f82e8676&role.id=c5632345c9274d348669482f1f7414c8 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:36.282656 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751f8e0-12b8-4b7d-996d-4a8202666a07 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:36.283119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751f8e0-12b8-4b7d-996d-4a8202666a07 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:36.283216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751f8e0-12b8-4b7d-996d-4a8202666a07 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:36.284619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 582/1162] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:36.289849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49645a1-a71e-4bef-bc03-9505af73f722 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:36.290261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49645a1-a71e-4bef-bc03-9505af73f722 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:36.290402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49645a1-a71e-4bef-bc03-9505af73f722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:36.306609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-a49645a1-a71e-4bef-bc03-9505af73f722 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:36.307809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a49645a1-a71e-4bef-bc03-9505af73f722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:36.372065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 581/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:36.395089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751f8e0-12b8-4b7d-996d-4a8202666a07 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:36.494379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751f8e0-12b8-4b7d-996d-4a8202666a07 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:36.509331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:36.528991 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d154-b9b5-47b5-a1b4-4d07b6b9e958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:36.529632 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d154-b9b5-47b5-a1b4-4d07b6b9e958 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:36.529934 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d154-b9b5-47b5-a1b4-4d07b6b9e958 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:36.530206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d154-b9b5-47b5-a1b4-4d07b6b9e958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:36.596017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664d154-b9b5-47b5-a1b4-4d07b6b9e958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:36.597361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664d154-b9b5-47b5-a1b4-4d07b6b9e958 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:36.691522 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 583/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:37:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:37:36.697459 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49645a1-a71e-4bef-bc03-9505af73f722 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:36.705928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:36.793971 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49645a1-a71e-4bef-bc03-9505af73f722 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:36.827290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5456d-8434-4da1-ad87-b407f6b0c0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:36.828111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5456d-8434-4da1-ad87-b407f6b0c0ed None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:36.828398 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5456d-8434-4da1-ad87-b407f6b0c0ed None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:36.828674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5456d-8434-4da1-ad87-b407f6b0c0ed None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:36.835257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5456d-8434-4da1-ad87-b407f6b0c0ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:36.836726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5456d-8434-4da1-ad87-b407f6b0c0ed None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-80d5456d-8434-4da1-ad87-b407f6b0c0ed None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:36.850648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:36.851904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:37:36.852954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 582/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 2 13:37:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:37:36.858572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d154-b9b5-47b5-a1b4-4d07b6b9e958 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:36.873348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:36.954835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d154-b9b5-47b5-a1b4-4d07b6b9e958 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:36.988369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae70b0f-c865-46dd-b4a4-433da0b5b64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:36.989016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae70b0f-c865-46dd-b4a4-433da0b5b64a None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:36.989295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae70b0f-c865-46dd-b4a4-433da0b5b64a None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:36.989567 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae70b0f-c865-46dd-b4a4-433da0b5b64a None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:36.990264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae70b0f-c865-46dd-b4a4-433da0b5b64a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:36.990564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae70b0f-c865-46dd-b4a4-433da0b5b64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:36.991961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae70b0f-c865-46dd-b4a4-433da0b5b64a None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:36.999700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 584/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 2 13:37:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:39.211210 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee6a82-ce32-402f-ac2b-31e6649143b6 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:39.211850 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee6a82-ce32-402f-ac2b-31e6649143b6 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:39.211850 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee6a82-ce32-402f-ac2b-31e6649143b6 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:39.213179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 583/1167] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:39.218338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a76b-aeec-432d-8a9b-08798ff332fd None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:39.218729 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a76b-aeec-432d-8a9b-08798ff332fd None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:39.218896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a76b-aeec-432d-8a9b-08798ff332fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:39.235860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-2883a76b-aeec-432d-8a9b-08798ff332fd None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:39.237035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2883a76b-aeec-432d-8a9b-08798ff332fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:39.301531 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 585/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:39.324876 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee6a82-ce32-402f-ac2b-31e6649143b6 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:39.390436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:39.426310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee6a82-ce32-402f-ac2b-31e6649143b6 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:39.461714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43f2e2-a27e-4334-a760-e5ebafddc140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:39.462291 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43f2e2-a27e-4334-a760-e5ebafddc140 None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:39.462577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43f2e2-a27e-4334-a760-e5ebafddc140 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:39.462856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43f2e2-a27e-4334-a760-e5ebafddc140 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:39.463631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43f2e2-a27e-4334-a760-e5ebafddc140 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:39.465040 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43f2e2-a27e-4334-a760-e5ebafddc140 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:39.547291 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 584/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Thu Jun 2 13:37:39 2022] POST /identity/v3/domains => generated 267 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:41.798590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015e75f-1c04-4758-b4ee-821fab20a200 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:41.799137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015e75f-1c04-4758-b4ee-821fab20a200 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:41.799137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015e75f-1c04-4758-b4ee-821fab20a200 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:41.800557 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 586/1170] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:41.805834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9607da-2a82-40e8-9052-4c3f0e5a69ca None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:41.806264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9607da-2a82-40e8-9052-4c3f0e5a69ca None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:41.806384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9607da-2a82-40e8-9052-4c3f0e5a69ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:41.829002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-7d9607da-2a82-40e8-9052-4c3f0e5a69ca None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:41.830182 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-7d9607da-2a82-40e8-9052-4c3f0e5a69ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:41.895785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 585/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:41.919320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015e75f-1c04-4758-b4ee-821fab20a200 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:41.930125 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:42.018881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015e75f-1c04-4758-b4ee-821fab20a200 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:42.052044 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f86f2-17d0-4392-b736-c6dff568d43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:42.052826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f86f2-17d0-4392-b736-c6dff568d43d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:42.053111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f86f2-17d0-4392-b736-c6dff568d43d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:42.053381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f86f2-17d0-4392-b736-c6dff568d43d None admin] PATH_INFO: `/v3/domains/4d52c3534f2646a19649a7d731b7b9e8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:42.064222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f86f2-17d0-4392-b736-c6dff568d43d None admin] RBAC: Authorizing `identity:get_domain(domain_id=4d52c3534f2646a19649a7d731b7b9e8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:42.065668 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f86f2-17d0-4392-b736-c6dff568d43d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:42.067289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 587/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Thu Jun 2 13:37:41 2022] GET /identity/v3/domains/4d52c3534f2646a19649a7d731b7b9e8 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:42.073115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9607da-2a82-40e8-9052-4c3f0e5a69ca None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:42.128331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:42.169260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9607da-2a82-40e8-9052-4c3f0e5a69ca None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:42.203866 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05deff-5d98-46c8-8cdd-0e0c2601add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:42.204512 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05deff-5d98-46c8-8cdd-0e0c2601add7 None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:42.204793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05deff-5d98-46c8-8cdd-0e0c2601add7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:42.205066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05deff-5d98-46c8-8cdd-0e0c2601add7 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:42.205765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05deff-5d98-46c8-8cdd-0e0c2601add7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:42.207240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05deff-5d98-46c8-8cdd-0e0c2601add7 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:42.295322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 586/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 2 13:37:42 2022] POST /identity/v3/projects => generated 361 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:44.556703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468cd41-366b-4427-883e-64c91469fa07 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:44.557219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468cd41-366b-4427-883e-64c91469fa07 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:44.557219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468cd41-366b-4427-883e-64c91469fa07 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:44.558523 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 588/1174] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:44.563871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb99c-e0a3-4938-a36c-2cb72b973420 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:44.564276 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb99c-e0a3-4938-a36c-2cb72b973420 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:44.564434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb99c-e0a3-4938-a36c-2cb72b973420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:44.581358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d8bfb99c-e0a3-4938-a36c-2cb72b973420 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:44.582539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d8bfb99c-e0a3-4938-a36c-2cb72b973420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:44.648400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 587/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:44.673117 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468cd41-366b-4427-883e-64c91469fa07 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:44.739165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:44.773913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468cd41-366b-4427-883e-64c91469fa07 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:44.806178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d020ed-cd61-4f57-b1c0-b06a7b2a1566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:44.807080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d020ed-cd61-4f57-b1c0-b06a7b2a1566 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:44.807310 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d020ed-cd61-4f57-b1c0-b06a7b2a1566 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:44.807615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d020ed-cd61-4f57-b1c0-b06a7b2a1566 None admin] PATH_INFO: `/v3/domains/4d52c3534f2646a19649a7d731b7b9e8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:44.808786 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d020ed-cd61-4f57-b1c0-b06a7b2a1566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4d52c3534f2646a19649a7d731b7b9e8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:44.810225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d020ed-cd61-4f57-b1c0-b06a7b2a1566 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:44.811866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 589/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Thu Jun 2 13:37:44 2022] GET /identity/v3/domains/4d52c3534f2646a19649a7d731b7b9e8 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:44.818111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfb99c-e0a3-4938-a36c-2cb72b973420 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:44.856626 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:44.914708 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfb99c-e0a3-4938-a36c-2cb72b973420 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:44.948204 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559478b5-4f5e-443e-9a87-ffa5fc3ebe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:44.948868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559478b5-4f5e-443e-9a87-ffa5fc3ebe1d None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:44.949152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559478b5-4f5e-443e-9a87-ffa5fc3ebe1d None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:44.949419 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559478b5-4f5e-443e-9a87-ffa5fc3ebe1d None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:44.950116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559478b5-4f5e-443e-9a87-ffa5fc3ebe1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:44.951563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559478b5-4f5e-443e-9a87-ffa5fc3ebe1d None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:45.048688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 588/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:37:44 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:47.311571 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1d0f4-9c9a-4a59-a82f-0137b19ee1a2 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:47.312055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1d0f4-9c9a-4a59-a82f-0137b19ee1a2 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:47.312148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1d0f4-9c9a-4a59-a82f-0137b19ee1a2 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:47.313523 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 590/1178] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:47.318937 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afdd7c-bef1-4c57-a585-b29381d67bda None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:47.319379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afdd7c-bef1-4c57-a585-b29381d67bda None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:47.319527 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afdd7c-bef1-4c57-a585-b29381d67bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:47.336800 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-a2afdd7c-bef1-4c57-a585-b29381d67bda None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:47.338002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a2afdd7c-bef1-4c57-a585-b29381d67bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:47.405010 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 589/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:47.429259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1d0f4-9c9a-4a59-a82f-0137b19ee1a2 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:47.529979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1d0f4-9c9a-4a59-a82f-0137b19ee1a2 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:47.562815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e422bb8-bd55-4359-9599-1038c80d01a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:47.563665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e422bb8-bd55-4359-9599-1038c80d01a6 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:47.563943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e422bb8-bd55-4359-9599-1038c80d01a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:47.564212 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e422bb8-bd55-4359-9599-1038c80d01a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:47.566759 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:47.574509 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e422bb8-bd55-4359-9599-1038c80d01a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-8e422bb8-bd55-4359-9599-1038c80d01a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:37:47.582623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:47.583766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:47.584717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:47.584717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:47.584717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:47.584717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:47.584717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:37:47.584717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:37:47.584717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:37:47.584717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:37:47.584717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:37:47.584717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:37:47.584717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:47.584717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:37:47.584717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 591/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:37:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:37:47.589911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afdd7c-bef1-4c57-a585-b29381d67bda None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:47.614294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:47.686086 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afdd7c-bef1-4c57-a585-b29381d67bda None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:47.720245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a990e9-a53b-4674-bbd7-7476f13a4010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:47.720245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a990e9-a53b-4674-bbd7-7476f13a4010 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:47.720789 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a990e9-a53b-4674-bbd7-7476f13a4010 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:47.720936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a990e9-a53b-4674-bbd7-7476f13a4010 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:47.721679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a990e9-a53b-4674-bbd7-7476f13a4010 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:47.721983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a990e9-a53b-4674-bbd7-7476f13a4010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:47.723354 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a990e9-a53b-4674-bbd7-7476f13a4010 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:47.731412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 590/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:37:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:47.737265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e422bb8-bd55-4359-9599-1038c80d01a6 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:47.834136 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e422bb8-bd55-4359-9599-1038c80d01a6 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:47.866351 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672d39e-522b-4b71-a546-281a72950dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:47.867219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672d39e-522b-4b71-a546-281a72950dd8 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:47.867525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672d39e-522b-4b71-a546-281a72950dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:47.867804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672d39e-522b-4b71-a546-281a72950dd8 None admin] PATH_INFO: `/v3/users/b9a726d92f3b4aa48f4cec8a7e94a0d1` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:47.882519 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672d39e-522b-4b71-a546-281a72950dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=b9a726d92f3b4aa48f4cec8a7e94a0d1)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:47.883993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672d39e-522b-4b71-a546-281a72950dd8 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:47.885647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 592/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:37:47 2022] GET /identity/v3/users/b9a726d92f3b4aa48f4cec8a7e94a0d1 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:47.892090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a990e9-a53b-4674-bbd7-7476f13a4010 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:47.975325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:47.990068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a990e9-a53b-4674-bbd7-7476f13a4010 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.023618 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1630415-2c5f-48ed-a8e2-0fcc883b60d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.024259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1630415-2c5f-48ed-a8e2-0fcc883b60d7 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.024544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1630415-2c5f-48ed-a8e2-0fcc883b60d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.024820 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1630415-2c5f-48ed-a8e2-0fcc883b60d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.089969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1630415-2c5f-48ed-a8e2-0fcc883b60d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:48.091360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1630415-2c5f-48ed-a8e2-0fcc883b60d7 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:48.175274 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:48.190749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 591/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:37:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:37:48.196655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672d39e-522b-4b71-a546-281a72950dd8 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:48.252416 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:48.296254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672d39e-522b-4b71-a546-281a72950dd8 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.330890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a89334-67f1-465e-a5ea-d3be58fc0161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.331756 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a89334-67f1-465e-a5ea-d3be58fc0161 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.332031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a89334-67f1-465e-a5ea-d3be58fc0161 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.332301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a89334-67f1-465e-a5ea-d3be58fc0161 None admin] PATH_INFO: `/v3/projects/8404de31dec3486286dc68341b3ee088` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.333455 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a89334-67f1-465e-a5ea-d3be58fc0161 None admin] RBAC: Authorizing `identity:get_project(project_id=8404de31dec3486286dc68341b3ee088)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:48.334897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a89334-67f1-465e-a5ea-d3be58fc0161 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:48.336789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 593/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:37:48 2022] GET /identity/v3/projects/8404de31dec3486286dc68341b3ee088 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:48.342816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1630415-2c5f-48ed-a8e2-0fcc883b60d7 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:48.448475 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1630415-2c5f-48ed-a8e2-0fcc883b60d7 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.492385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429bbeb-a85e-4210-b13d-a9655187f6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.493076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429bbeb-a85e-4210-b13d-a9655187f6d0 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.493358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429bbeb-a85e-4210-b13d-a9655187f6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.493616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429bbeb-a85e-4210-b13d-a9655187f6d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.494433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429bbeb-a85e-4210-b13d-a9655187f6d0 None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=8404de31dec3486286dc68341b3ee088, user.id=b9a726d92f3b4aa48f4cec8a7e94a0d1) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:48.494949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429bbeb-a85e-4210-b13d-a9655187f6d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:48.497864 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429bbeb-a85e-4210-b13d-a9655187f6d0 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:48.504356 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 592/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:37:48 2022] GET /identity/v3/role_assignments?user.id=b9a726d92f3b4aa48f4cec8a7e94a0d1&scope.project.id=8404de31dec3486286dc68341b3ee088&role.id=c5632345c9274d348669482f1f7414c8 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:50.720359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822ab3d-5973-471c-8a02-0edcddbe1002 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.720939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822ab3d-5973-471c-8a02-0edcddbe1002 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.720939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822ab3d-5973-471c-8a02-0edcddbe1002 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.722264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 594/1186] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:50.727649 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a21fe-8dd1-49ca-9126-370821de4c09 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.728075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a21fe-8dd1-49ca-9126-370821de4c09 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.728209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a21fe-8dd1-49ca-9126-370821de4c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.745375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-016a21fe-8dd1-49ca-9126-370821de4c09 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:50.746566 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-016a21fe-8dd1-49ca-9126-370821de4c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:50.791866 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:50.812447 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 593/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:50.835281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822ab3d-5973-471c-8a02-0edcddbe1002 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:50.933478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822ab3d-5973-471c-8a02-0edcddbe1002 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:50.955674 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:50.966500 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cee5a9-231b-4834-bbd4-c8a5dc0f7afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:50.968105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cee5a9-231b-4834-bbd4-c8a5dc0f7afd None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.968105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cee5a9-231b-4834-bbd4-c8a5dc0f7afd None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.968105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cee5a9-231b-4834-bbd4-c8a5dc0f7afd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.978395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cee5a9-231b-4834-bbd4-c8a5dc0f7afd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-44cee5a9-231b-4834-bbd4-c8a5dc0f7afd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:37:50.986421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:50.987754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:50.989072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:50.989072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:50.989072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:50.989072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:50.989072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:37:50.989072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:37:50.989072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:37:50.989072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:37:50.989072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:37:50.989072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:37:50.989072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:50.989072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:37:50.989072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 595/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:37:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:37:50.993928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a21fe-8dd1-49ca-9126-370821de4c09 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.089304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a21fe-8dd1-49ca-9126-370821de4c09 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.121751 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbd5b5-d88c-4727-881d-007c8d76f26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.122652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbd5b5-d88c-4727-881d-007c8d76f26e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.122928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbd5b5-d88c-4727-881d-007c8d76f26e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.123196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbd5b5-d88c-4727-881d-007c8d76f26e None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.123959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbd5b5-d88c-4727-881d-007c8d76f26e None admin] RBAC: Adding query filter params (name=admin) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:51.124260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbd5b5-d88c-4727-881d-007c8d76f26e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.125639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbd5b5-d88c-4727-881d-007c8d76f26e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.133375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 594/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:37:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:51.139326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cee5a9-231b-4834-bbd4-c8a5dc0f7afd None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.236408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cee5a9-231b-4834-bbd4-c8a5dc0f7afd None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.269385 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cecc59-4159-4ca9-b464-8f40c5bf0c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.270288 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cecc59-4159-4ca9-b464-8f40c5bf0c3b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.270573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cecc59-4159-4ca9-b464-8f40c5bf0c3b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.270842 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cecc59-4159-4ca9-b464-8f40c5bf0c3b None admin] PATH_INFO: `/v3/users/b9a726d92f3b4aa48f4cec8a7e94a0d1` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.272070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cecc59-4159-4ca9-b464-8f40c5bf0c3b None admin] RBAC: Authorizing `identity:get_user(user_id=b9a726d92f3b4aa48f4cec8a7e94a0d1)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.273514 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cecc59-4159-4ca9-b464-8f40c5bf0c3b None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.275141 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 596/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:37:51 2022] GET /identity/v3/users/b9a726d92f3b4aa48f4cec8a7e94a0d1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:51.280883 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbd5b5-d88c-4727-881d-007c8d76f26e None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.324257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:51.380656 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbd5b5-d88c-4727-881d-007c8d76f26e None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.413532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73607c6b-3709-4d57-be93-518a02496621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.414384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73607c6b-3709-4d57-be93-518a02496621 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.414677 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73607c6b-3709-4d57-be93-518a02496621 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.414952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73607c6b-3709-4d57-be93-518a02496621 None admin] PATH_INFO: `/v3/projects/8404de31dec3486286dc68341b3ee088` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.416154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73607c6b-3709-4d57-be93-518a02496621 None admin] RBAC: Authorizing `identity:get_project(project_id=8404de31dec3486286dc68341b3ee088)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.417587 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73607c6b-3709-4d57-be93-518a02496621 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.419280 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 595/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:37:51 2022] GET /identity/v3/projects/8404de31dec3486286dc68341b3ee088 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:51.425417 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cecc59-4159-4ca9-b464-8f40c5bf0c3b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.476376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:51.527007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cecc59-4159-4ca9-b464-8f40c5bf0c3b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.560610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec632f75-4a75-4174-a3be-79e0c516ca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.561490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632f75-4a75-4174-a3be-79e0c516ca1e None admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.561774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632f75-4a75-4174-a3be-79e0c516ca1e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.562047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632f75-4a75-4174-a3be-79e0c516ca1e None admin] PATH_INFO: `/v3/projects/8404de31dec3486286dc68341b3ee088/users/b9a726d92f3b4aa48f4cec8a7e94a0d1/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.564693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec632f75-4a75-4174-a3be-79e0c516ca1e None admin] RBAC: Authorizing `identity:create_grant(project_id=8404de31dec3486286dc68341b3ee088, user_id=b9a726d92f3b4aa48f4cec8a7e94a0d1, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.566143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec632f75-4a75-4174-a3be-79e0c516ca1e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.631337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 597/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:37:51 2022] PUT /identity/v3/projects/8404de31dec3486286dc68341b3ee088/users/b9a726d92f3b4aa48f4cec8a7e94a0d1/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:53.861610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e88f3-ed82-4667-abad-89ed66f54088 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:53.862157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e88f3-ed82-4667-abad-89ed66f54088 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:53.862157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e88f3-ed82-4667-abad-89ed66f54088 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:53.863551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 596/1193] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:37:53.868711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb1fba-9604-46f7-b110-bace8a45827a None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:53.869124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb1fba-9604-46f7-b110-bace8a45827a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:53.869268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb1fba-9604-46f7-b110-bace8a45827a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:53.885936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-76eb1fba-9604-46f7-b110-bace8a45827a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:53.887105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-76eb1fba-9604-46f7-b110-bace8a45827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:53.952234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 598/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:37:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:37:53.976682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e88f3-ed82-4667-abad-89ed66f54088 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.075765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e88f3-ed82-4667-abad-89ed66f54088 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.086103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:54.108901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff83e0c-9648-4372-a7c4-7c3574598450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.109708 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff83e0c-9648-4372-a7c4-7c3574598450 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.109992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff83e0c-9648-4372-a7c4-7c3574598450 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.110301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff83e0c-9648-4372-a7c4-7c3574598450 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.121602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff83e0c-9648-4372-a7c4-7c3574598450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-0ff83e0c-9648-4372-a7c4-7c3574598450 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:37:54.129783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:37:54.130739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:37:54.131614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:37:54.131614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:37:54.131614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:37:54.131614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:37:54.131614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:37:54.131614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:37:54.131614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:37:54.131614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:37:54.131614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:37:54.131614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:37:54.131614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:37:54.131614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:37:54.131614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 597/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:37:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:37:54.137176 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb1fba-9604-46f7-b110-bace8a45827a None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.177583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:54.233308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb1fba-9604-46f7-b110-bace8a45827a None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.267523 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3417d-ace1-42e5-a882-ba46a6b05147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.268193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3417d-ace1-42e5-a882-ba46a6b05147 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.268475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3417d-ace1-42e5-a882-ba46a6b05147 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.268750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3417d-ace1-42e5-a882-ba46a6b05147 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.269482 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3417d-ace1-42e5-a882-ba46a6b05147 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:54.269783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3417d-ace1-42e5-a882-ba46a6b05147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:54.271148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3417d-ace1-42e5-a882-ba46a6b05147 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:54.279503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 599/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:37:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:54.286083 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff83e0c-9648-4372-a7c4-7c3574598450 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.382988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff83e0c-9648-4372-a7c4-7c3574598450 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.416103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97fecf-68fb-45d2-b932-3939d3612a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.416955 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97fecf-68fb-45d2-b932-3939d3612a3c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.417233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97fecf-68fb-45d2-b932-3939d3612a3c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.417503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97fecf-68fb-45d2-b932-3939d3612a3c None admin] PATH_INFO: `/v3/users/b9a726d92f3b4aa48f4cec8a7e94a0d1` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.418681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97fecf-68fb-45d2-b932-3939d3612a3c None admin] RBAC: Authorizing `identity:get_user(user_id=b9a726d92f3b4aa48f4cec8a7e94a0d1)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:54.420151 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97fecf-68fb-45d2-b932-3939d3612a3c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:54.421792 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 598/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 2 13:37:54 2022] GET /identity/v3/users/b9a726d92f3b4aa48f4cec8a7e94a0d1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:37:54.427736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3417d-ace1-42e5-a882-ba46a6b05147 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.525247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3417d-ace1-42e5-a882-ba46a6b05147 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.526778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:54.557891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c4cc0-7e2f-4d0b-89f1-3d6aab628c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.558534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c4cc0-7e2f-4d0b-89f1-3d6aab628c1b None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.558820 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c4cc0-7e2f-4d0b-89f1-3d6aab628c1b None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.559097 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c4cc0-7e2f-4d0b-89f1-3d6aab628c1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.630853 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c4cc0-7e2f-4d0b-89f1-3d6aab628c1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:54.632331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c4cc0-7e2f-4d0b-89f1-3d6aab628c1b None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:54.725238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 600/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:37:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:37:54.731189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97fecf-68fb-45d2-b932-3939d3612a3c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.771014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:54.828470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97fecf-68fb-45d2-b932-3939d3612a3c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.861135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f08a1-575e-4878-ace5-a097723486a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.861998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f08a1-575e-4878-ace5-a097723486a5 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.862540 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f08a1-575e-4878-ace5-a097723486a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.862540 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f08a1-575e-4878-ace5-a097723486a5 None admin] PATH_INFO: `/v3/projects/8404de31dec3486286dc68341b3ee088` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.863710 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f08a1-575e-4878-ace5-a097723486a5 None admin] RBAC: Authorizing `identity:get_project(project_id=8404de31dec3486286dc68341b3ee088)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:54.865135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f08a1-575e-4878-ace5-a097723486a5 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:54.866809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 599/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 2 13:37:54 2022] GET /identity/v3/projects/8404de31dec3486286dc68341b3ee088 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:54.873322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c4cc0-7e2f-4d0b-89f1-3d6aab628c1b None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.876032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:54.968574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c4cc0-7e2f-4d0b-89f1-3d6aab628c1b None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:55.001986 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3237733-0e7b-4ef1-a084-ea9a7bd995f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:55.002576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3237733-0e7b-4ef1-a084-ea9a7bd995f0 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:55.002863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3237733-0e7b-4ef1-a084-ea9a7bd995f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:55.003139 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3237733-0e7b-4ef1-a084-ea9a7bd995f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:55.003996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3237733-0e7b-4ef1-a084-ea9a7bd995f0 None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=8404de31dec3486286dc68341b3ee088, user.id=b9a726d92f3b4aa48f4cec8a7e94a0d1) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:55.004312 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3237733-0e7b-4ef1-a084-ea9a7bd995f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:55.005742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3237733-0e7b-4ef1-a084-ea9a7bd995f0 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:55.011475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 601/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:37:54 2022] GET /identity/v3/role_assignments?user.id=b9a726d92f3b4aa48f4cec8a7e94a0d1&scope.project.id=8404de31dec3486286dc68341b3ee088&role.id=c5632345c9274d348669482f1f7414c8 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:38:04.856565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=47 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:05.008880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=67 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:19.909259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20eb42-f762-4ce4-a1fd-c9299e701da0 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:19.909858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20eb42-f762-4ce4-a1fd-c9299e701da0 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:19.909858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20eb42-f762-4ce4-a1fd-c9299e701da0 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:19.911166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 600/1201] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:39:19.916518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3bc9c-4419-48fd-9576-76f59a396cd2 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:19.916955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3bc9c-4419-48fd-9576-76f59a396cd2 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:19.917083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3bc9c-4419-48fd-9576-76f59a396cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:19.934732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-10f3bc9c-4419-48fd-9576-76f59a396cd2 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:19.935957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-10f3bc9c-4419-48fd-9576-76f59a396cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:20.002752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 602/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:39:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:39:20.027713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20eb42-f762-4ce4-a1fd-c9299e701da0 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:20.127688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20eb42-f762-4ce4-a1fd-c9299e701da0 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:20.160970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a2359-6a8b-4b37-b156-d89073de473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:20.161724 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a2359-6a8b-4b37-b156-d89073de473e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:20.162023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a2359-6a8b-4b37-b156-d89073de473e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:20.162296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a2359-6a8b-4b37-b156-d89073de473e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:20.172903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a2359-6a8b-4b37-b156-d89073de473e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:20.174437 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a2359-6a8b-4b37-b156-d89073de473e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-9f0a2359-6a8b-4b37-b156-d89073de473e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:39:20.191556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:20.196394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:20.197615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:39:20.197615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:39:20.197615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:20.197615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:20.197615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 601/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:20.198866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3bc9c-4419-48fd-9576-76f59a396cd2 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:20.298281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3bc9c-4419-48fd-9576-76f59a396cd2 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:20.328749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:20.334856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409c60c-480f-403e-9e03-df363fca7eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:20.335548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409c60c-480f-403e-9e03-df363fca7eb6 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:20.335827 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409c60c-480f-403e-9e03-df363fca7eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:20.336102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409c60c-480f-403e-9e03-df363fca7eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:20.336816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409c60c-480f-403e-9e03-df363fca7eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:20.337112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409c60c-480f-403e-9e03-df363fca7eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:20.338484 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409c60c-480f-403e-9e03-df363fca7eb6 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:20.350173 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 603/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:20.356601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a2359-6a8b-4b37-b156-d89073de473e None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:20.414024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:20.462301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a2359-6a8b-4b37-b156-d89073de473e None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:20.495908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c3378-78ea-4616-8913-8752bafa986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:20.496573 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c3378-78ea-4616-8913-8752bafa986a None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:20.496856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c3378-78ea-4616-8913-8752bafa986a None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:20.497130 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c3378-78ea-4616-8913-8752bafa986a None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:20.497873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c3378-78ea-4616-8913-8752bafa986a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:20.499573 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c3378-78ea-4616-8913-8752bafa986a None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:20.608478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 602/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 2 13:39:20 2022] POST /identity/v3/users => generated 251 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:22.912896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ed5d1-ca1b-46c6-89a2-ad96bedbc250 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:22.913783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ed5d1-ca1b-46c6-89a2-ad96bedbc250 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:22.913783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ed5d1-ca1b-46c6-89a2-ad96bedbc250 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:22.914826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 604/1206] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:22.920907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc228f1-5df1-4f45-be8a-fcf8cef1cd4e None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:22.921377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc228f1-5df1-4f45-be8a-fcf8cef1cd4e None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:22.921477 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc228f1-5df1-4f45-be8a-fcf8cef1cd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:22.939051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ccc228f1-5df1-4f45-be8a-fcf8cef1cd4e None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:22.940292 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ccc228f1-5df1-4f45-be8a-fcf8cef1cd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:23.007228 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 603/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:39:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:39:23.031841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ed5d1-ca1b-46c6-89a2-ad96bedbc250 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:23.131862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ed5d1-ca1b-46c6-89a2-ad96bedbc250 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:23.164863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32441853-c32f-43f7-9542-04344f899018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:23.165568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441853-c32f-43f7-9542-04344f899018 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:23.165839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441853-c32f-43f7-9542-04344f899018 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:23.166106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441853-c32f-43f7-9542-04344f899018 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:23.176414 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32441853-c32f-43f7-9542-04344f899018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-32441853-c32f-43f7-9542-04344f899018 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:39:23.184068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:23.185229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:23.186153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:23.186153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:23.186153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:23.186153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:23.186153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:39:23.186153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:39:23.186153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:39:23.186153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:39:23.186153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:39:23.186153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:39:23.186153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:39:23.186153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:23.186153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 605/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:39:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:23.191291 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc228f1-5df1-4f45-be8a-fcf8cef1cd4e None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:23.231823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:23.290068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc228f1-5df1-4f45-be8a-fcf8cef1cd4e None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:23.325181 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011f4ec-a5ef-4da3-bc2c-4e6ee5e78b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:23.325841 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011f4ec-a5ef-4da3-bc2c-4e6ee5e78b92 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:23.326119 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011f4ec-a5ef-4da3-bc2c-4e6ee5e78b92 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:23.326384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011f4ec-a5ef-4da3-bc2c-4e6ee5e78b92 None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:23.327118 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011f4ec-a5ef-4da3-bc2c-4e6ee5e78b92 None admin] RBAC: Adding query filter params (name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:23.327416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011f4ec-a5ef-4da3-bc2c-4e6ee5e78b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:23.328816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011f4ec-a5ef-4da3-bc2c-4e6ee5e78b92 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:23.336500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 604/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:39:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:23.342889 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32441853-c32f-43f7-9542-04344f899018 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:23.393605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:23.442783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32441853-c32f-43f7-9542-04344f899018 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:23.476775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67589e65-ab3f-4077-a2f2-c0b581a98666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:23.480428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67589e65-ab3f-4077-a2f2-c0b581a98666 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:23.480428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67589e65-ab3f-4077-a2f2-c0b581a98666 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:23.480428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67589e65-ab3f-4077-a2f2-c0b581a98666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:23.488996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67589e65-ab3f-4077-a2f2-c0b581a98666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:23.490438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67589e65-ab3f-4077-a2f2-c0b581a98666 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-67589e65-ab3f-4077-a2f2-c0b581a98666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:39:23.507472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:23.508590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:23.509741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:39:23.509741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:39:23.509741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:23.509741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:23.509741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 606/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:23.515028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011f4ec-a5ef-4da3-bc2c-4e6ee5e78b92 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:23.609240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:23.612653 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011f4ec-a5ef-4da3-bc2c-4e6ee5e78b92 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:23.646737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66696b1f-c011-4b78-bf12-8250be813026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:23.647398 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66696b1f-c011-4b78-bf12-8250be813026 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:23.647720 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66696b1f-c011-4b78-bf12-8250be813026 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:23.647995 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66696b1f-c011-4b78-bf12-8250be813026 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:23.648731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66696b1f-c011-4b78-bf12-8250be813026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:23.649061 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66696b1f-c011-4b78-bf12-8250be813026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:23.650404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66696b1f-c011-4b78-bf12-8250be813026 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:23.662979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 605/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:23.668637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67589e65-ab3f-4077-a2f2-c0b581a98666 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:23.768205 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67589e65-ab3f-4077-a2f2-c0b581a98666 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:23.769662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:23.800901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc9c5b-61aa-4d1d-ba82-6b38b0e26c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:23.805891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc9c5b-61aa-4d1d-ba82-6b38b0e26c73 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:23.805891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc9c5b-61aa-4d1d-ba82-6b38b0e26c73 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:23.805891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc9c5b-61aa-4d1d-ba82-6b38b0e26c73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:23.809941 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc9c5b-61aa-4d1d-ba82-6b38b0e26c73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:23.811375 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc9c5b-61aa-4d1d-ba82-6b38b0e26c73 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-a7cc9c5b-61aa-4d1d-ba82-6b38b0e26c73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:39:23.826766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:23.827939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:23.829086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:23.829086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:23.829086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:39:23.829086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:39:23.829086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:39:23.829086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:39:23.829086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:39:23.829086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:39:23.829086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:39:23.829086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:23.829086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 607/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:23.833857 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66696b1f-c011-4b78-bf12-8250be813026 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:23.931606 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66696b1f-c011-4b78-bf12-8250be813026 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:23.965892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f718f30-7ef5-475d-b359-8596dfe3bd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:23.966549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f718f30-7ef5-475d-b359-8596dfe3bd55 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:23.966833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f718f30-7ef5-475d-b359-8596dfe3bd55 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:23.967108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f718f30-7ef5-475d-b359-8596dfe3bd55 None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:23.967968 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f718f30-7ef5-475d-b359-8596dfe3bd55 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:23.968299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f718f30-7ef5-475d-b359-8596dfe3bd55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:23.969721 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f718f30-7ef5-475d-b359-8596dfe3bd55 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:23.986365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 606/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 2 13:39:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:23.992502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc9c5b-61aa-4d1d-ba82-6b38b0e26c73 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:24.091851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc9c5b-61aa-4d1d-ba82-6b38b0e26c73 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:24.126782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c8d1d-166a-4b05-b7a4-97fdf897103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:24.127416 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c8d1d-166a-4b05-b7a4-97fdf897103e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:24.127721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c8d1d-166a-4b05-b7a4-97fdf897103e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:24.127995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c8d1d-166a-4b05-b7a4-97fdf897103e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:24.155993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:24.194081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c8d1d-166a-4b05-b7a4-97fdf897103e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:24.195616 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c8d1d-166a-4b05-b7a4-97fdf897103e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:24.294151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 608/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:39:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:39:24.300126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f718f30-7ef5-475d-b359-8596dfe3bd55 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:24.319184 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:24.396051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f718f30-7ef5-475d-b359-8596dfe3bd55 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:24.428917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03d59a-9a98-4208-8945-b3f15b3a359b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:24.429712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03d59a-9a98-4208-8945-b3f15b3a359b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:24.429992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03d59a-9a98-4208-8945-b3f15b3a359b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:24.430262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03d59a-9a98-4208-8945-b3f15b3a359b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:24.441630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03d59a-9a98-4208-8945-b3f15b3a359b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:24.443173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03d59a-9a98-4208-8945-b3f15b3a359b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-4b03d59a-9a98-4208-8945-b3f15b3a359b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:39:24.461872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:24.463014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:24.464177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:39:24.464177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:39:24.464177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:24.464177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:24.464177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 607/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:39:24.469669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c8d1d-166a-4b05-b7a4-97fdf897103e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:24.530333 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:24.568461 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c8d1d-166a-4b05-b7a4-97fdf897103e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:24.602198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505621f0-331e-46a9-b624-9a07bb41dd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:24.602864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505621f0-331e-46a9-b624-9a07bb41dd52 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:24.603149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505621f0-331e-46a9-b624-9a07bb41dd52 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:24.603425 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505621f0-331e-46a9-b624-9a07bb41dd52 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:24.604309 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505621f0-331e-46a9-b624-9a07bb41dd52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:24.604618 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505621f0-331e-46a9-b624-9a07bb41dd52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:24.606046 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505621f0-331e-46a9-b624-9a07bb41dd52 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:24.617818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 609/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:24.624305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03d59a-9a98-4208-8945-b3f15b3a359b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:24.693465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:24.723461 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03d59a-9a98-4208-8945-b3f15b3a359b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:24.757368 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bbdb0-6b86-46f2-8c00-268c962fbf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:24.758149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bbdb0-6b86-46f2-8c00-268c962fbf47 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:24.758429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bbdb0-6b86-46f2-8c00-268c962fbf47 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:24.758702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bbdb0-6b86-46f2-8c00-268c962fbf47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:24.765732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4bbdb0-6b86-46f2-8c00-268c962fbf47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:24.767179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4bbdb0-6b86-46f2-8c00-268c962fbf47 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-bd4bbdb0-6b86-46f2-8c00-268c962fbf47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:39:24.780892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:24.784250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:24.785367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:39:24.785367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:39:24.785367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:39:24.785367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:39:24.785367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:39:24.785367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:39:24.785367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:39:24.785367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:24.785367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 608/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:24.788098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505621f0-331e-46a9-b624-9a07bb41dd52 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:24.885970 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505621f0-331e-46a9-b624-9a07bb41dd52 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:24.911113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:24.922873 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88842ac6-4ac8-41f5-a0dd-86915bb3b156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:24.923566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842ac6-4ac8-41f5-a0dd-86915bb3b156 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:24.923854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842ac6-4ac8-41f5-a0dd-86915bb3b156 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:24.924134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842ac6-4ac8-41f5-a0dd-86915bb3b156 None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:24.924919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88842ac6-4ac8-41f5-a0dd-86915bb3b156 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:24.925229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88842ac6-4ac8-41f5-a0dd-86915bb3b156 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:24.926651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88842ac6-4ac8-41f5-a0dd-86915bb3b156 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:24.938599 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 610/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:24.944672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bbdb0-6b86-46f2-8c00-268c962fbf47 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:25.042848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bbdb0-6b86-46f2-8c00-268c962fbf47 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:25.070948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:25.076619 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56cdbb-a2b1-4cbf-856b-b2fcb545fc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:25.077269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56cdbb-a2b1-4cbf-856b-b2fcb545fc15 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:25.077554 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56cdbb-a2b1-4cbf-856b-b2fcb545fc15 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:25.077830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56cdbb-a2b1-4cbf-856b-b2fcb545fc15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:25.078655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56cdbb-a2b1-4cbf-856b-b2fcb545fc15 None admin] RBAC: Adding query filter params (role.id=a9712a3506694519b4e4945b54539d79, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=b387ad13a6c843d0b9a43bc8f5f7fa13) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:25.078973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56cdbb-a2b1-4cbf-856b-b2fcb545fc15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:25.080429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56cdbb-a2b1-4cbf-856b-b2fcb545fc15 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:25.085772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 609/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:39:24 2022] GET /identity/v3/role_assignments?user.id=b387ad13a6c843d0b9a43bc8f5f7fa13&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=a9712a3506694519b4e4945b54539d79 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:27.316610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0add3-0cfa-4cc0-b98b-c6b508352513 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:27.317152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0add3-0cfa-4cc0-b98b-c6b508352513 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:27.317152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0add3-0cfa-4cc0-b98b-c6b508352513 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:27.318540 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 611/1220] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:27.324327 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1a78d-8690-47e1-96a1-7170139e4a00 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:27.324730 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1a78d-8690-47e1-96a1-7170139e4a00 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:27.324877 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1a78d-8690-47e1-96a1-7170139e4a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:27.342104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-0db1a78d-8690-47e1-96a1-7170139e4a00 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:27.343294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-0db1a78d-8690-47e1-96a1-7170139e4a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:27.409722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 610/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:39:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:39:27.432989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0add3-0cfa-4cc0-b98b-c6b508352513 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:27.534289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0add3-0cfa-4cc0-b98b-c6b508352513 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:27.566945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c697d73-4664-4dd8-9220-180dfa50fd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:27.567754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c697d73-4664-4dd8-9220-180dfa50fd07 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:27.568036 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c697d73-4664-4dd8-9220-180dfa50fd07 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:27.568305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c697d73-4664-4dd8-9220-180dfa50fd07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:27.578651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c697d73-4664-4dd8-9220-180dfa50fd07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-1c697d73-4664-4dd8-9220-180dfa50fd07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:39:27.586269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:27.587290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:27.588185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:27.588185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:27.588185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:27.588185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:27.588185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:39:27.588185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:39:27.588185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:39:27.588185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:39:27.588185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:39:27.588185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:39:27.588185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:39:27.588185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:27.588185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 612/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:27.593722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1a78d-8690-47e1-96a1-7170139e4a00 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:27.691992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1a78d-8690-47e1-96a1-7170139e4a00 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:27.716100 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:27.726739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095141e-0a0e-4929-b75a-ec9704ba9eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:27.727401 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095141e-0a0e-4929-b75a-ec9704ba9eeb None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:27.727716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095141e-0a0e-4929-b75a-ec9704ba9eeb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:27.728054 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095141e-0a0e-4929-b75a-ec9704ba9eeb None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:27.728805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095141e-0a0e-4929-b75a-ec9704ba9eeb None admin] RBAC: Adding query filter params (name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:27.729112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095141e-0a0e-4929-b75a-ec9704ba9eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:27.730511 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095141e-0a0e-4929-b75a-ec9704ba9eeb None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:27.738504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 611/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:39:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:27.744441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c697d73-4664-4dd8-9220-180dfa50fd07 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:27.789637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:27.847679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c697d73-4664-4dd8-9220-180dfa50fd07 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:27.882518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b0549-5233-4f95-b2cc-7b08ee1af7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:27.883301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b0549-5233-4f95-b2cc-7b08ee1af7dd None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:27.883615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b0549-5233-4f95-b2cc-7b08ee1af7dd None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:27.883896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b0549-5233-4f95-b2cc-7b08ee1af7dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:27.894951 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b0549-5233-4f95-b2cc-7b08ee1af7dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:27.896437 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b0549-5233-4f95-b2cc-7b08ee1af7dd None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-db7b0549-5233-4f95-b2cc-7b08ee1af7dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:39:27.913651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:27.916266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:27.917922 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:39:27.917922 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:39:27.917922 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:27.917922 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:27.917922 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 613/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:27.921272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095141e-0a0e-4929-b75a-ec9704ba9eeb None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:28.021231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095141e-0a0e-4929-b75a-ec9704ba9eeb None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:28.056835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbd3ba-1753-4c2f-90ec-b0f88291291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:28.056835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbd3ba-1753-4c2f-90ec-b0f88291291e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:28.056835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbd3ba-1753-4c2f-90ec-b0f88291291e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:28.056835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbd3ba-1753-4c2f-90ec-b0f88291291e None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:28.057285 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbd3ba-1753-4c2f-90ec-b0f88291291e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:28.058669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbd3ba-1753-4c2f-90ec-b0f88291291e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:28.060556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbd3ba-1753-4c2f-90ec-b0f88291291e None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:28.072322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 612/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:28.078015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b0549-5233-4f95-b2cc-7b08ee1af7dd None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:28.171145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:28.177759 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b0549-5233-4f95-b2cc-7b08ee1af7dd None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:28.211166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc5ba5-a005-4e8b-9e09-524d8399468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:28.211991 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc5ba5-a005-4e8b-9e09-524d8399468d None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:28.212275 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc5ba5-a005-4e8b-9e09-524d8399468d None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:28.212547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc5ba5-a005-4e8b-9e09-524d8399468d None admin] PATH_INFO: `/v3/users/placement` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:28.220024 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc5ba5-a005-4e8b-9e09-524d8399468d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:28.221453 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc5ba5-a005-4e8b-9e09-524d8399468d None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-efdc5ba5-a005-4e8b-9e09-524d8399468d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:39:28.236360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:28.237468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:28.238809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:28.238809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:28.238809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:39:28.238809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:39:28.238809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:39:28.238809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:39:28.238809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:39:28.238809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:39:28.238809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:39:28.238809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:28.238809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 614/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:28.243353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbd3ba-1753-4c2f-90ec-b0f88291291e None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:28.290706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:28.342239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbd3ba-1753-4c2f-90ec-b0f88291291e None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:28.375674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbc66b-f789-46d8-bf52-2a1e492a94e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:28.376337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbc66b-f789-46d8-bf52-2a1e492a94e4 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:28.376624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbc66b-f789-46d8-bf52-2a1e492a94e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:28.376900 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbc66b-f789-46d8-bf52-2a1e492a94e4 None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:28.377736 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbc66b-f789-46d8-bf52-2a1e492a94e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:28.378044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbc66b-f789-46d8-bf52-2a1e492a94e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:28.379519 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbc66b-f789-46d8-bf52-2a1e492a94e4 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:28.396966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 613/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 2 13:39:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:28.403217 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc5ba5-a005-4e8b-9e09-524d8399468d None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:28.502375 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc5ba5-a005-4e8b-9e09-524d8399468d None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:28.537151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eee8e-1f36-46c3-8cf7-65ebac810435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:28.543427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eee8e-1f36-46c3-8cf7-65ebac810435 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:28.543427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eee8e-1f36-46c3-8cf7-65ebac810435 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:28.543427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eee8e-1f36-46c3-8cf7-65ebac810435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:28.548991 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3eee8e-1f36-46c3-8cf7-65ebac810435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:28.550455 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3eee8e-1f36-46c3-8cf7-65ebac810435 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-2c3eee8e-1f36-46c3-8cf7-65ebac810435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:39:28.567830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:28.575957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:28.577106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:39:28.577106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:39:28.577106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:28.577106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:28.577106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 615/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:28.577439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbc66b-f789-46d8-bf52-2a1e492a94e4 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:28.673268 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbc66b-f789-46d8-bf52-2a1e492a94e4 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:28.675524 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:28.706173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af8cf2-5cff-4469-b3e0-1d469c6dcffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:28.706838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af8cf2-5cff-4469-b3e0-1d469c6dcffb None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:28.707120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af8cf2-5cff-4469-b3e0-1d469c6dcffb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:28.707395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af8cf2-5cff-4469-b3e0-1d469c6dcffb None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:28.708150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af8cf2-5cff-4469-b3e0-1d469c6dcffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:28.708453 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af8cf2-5cff-4469-b3e0-1d469c6dcffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:28.709826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af8cf2-5cff-4469-b3e0-1d469c6dcffb None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:28.721565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 614/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:28.727324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eee8e-1f36-46c3-8cf7-65ebac810435 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:28.736160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:28.825202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eee8e-1f36-46c3-8cf7-65ebac810435 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:28.859637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e14914-19e7-40c7-8488-0d9ad54d687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:28.860427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14914-19e7-40c7-8488-0d9ad54d687c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:28.861352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14914-19e7-40c7-8488-0d9ad54d687c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:28.861352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14914-19e7-40c7-8488-0d9ad54d687c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:28.867594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e14914-19e7-40c7-8488-0d9ad54d687c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:28.869029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e14914-19e7-40c7-8488-0d9ad54d687c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-15e14914-19e7-40c7-8488-0d9ad54d687c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:39:28.882647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:28.883771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:28.884840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:39:28.884840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:39:28.884840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:39:28.884840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:39:28.884840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:39:28.884840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:39:28.884840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:39:28.884840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:28.884840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 616/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:39:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:28.890248 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af8cf2-5cff-4469-b3e0-1d469c6dcffb None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:28.986664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af8cf2-5cff-4469-b3e0-1d469c6dcffb None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:29.020641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bdff1-a379-4e62-bd24-950d49d18781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:29.037149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bdff1-a379-4e62-bd24-950d49d18781 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:29.037149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bdff1-a379-4e62-bd24-950d49d18781 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:29.037149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bdff1-a379-4e62-bd24-950d49d18781 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:29.037149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bdff1-a379-4e62-bd24-950d49d18781 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:29.037149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bdff1-a379-4e62-bd24-950d49d18781 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:29.037149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bdff1-a379-4e62-bd24-950d49d18781 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:29.037779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 615/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:39:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:39:29.042223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e14914-19e7-40c7-8488-0d9ad54d687c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:29.107141 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:29.141170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e14914-19e7-40c7-8488-0d9ad54d687c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:29.172715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611db8dd-b74c-443e-879b-5507310d9391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:29.173580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611db8dd-b74c-443e-879b-5507310d9391 None admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:29.173862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611db8dd-b74c-443e-879b-5507310d9391 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:29.174137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611db8dd-b74c-443e-879b-5507310d9391 None admin] PATH_INFO: `/v3/projects/8deff8fec8614da6997a32993c033fd8/users/b387ad13a6c843d0b9a43bc8f5f7fa13/roles/a9712a3506694519b4e4945b54539d79` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:29.188369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611db8dd-b74c-443e-879b-5507310d9391 None admin] RBAC: Authorizing `identity:create_grant(project_id=8deff8fec8614da6997a32993c033fd8, user_id=b387ad13a6c843d0b9a43bc8f5f7fa13, role_id=a9712a3506694519b4e4945b54539d79)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:29.189813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611db8dd-b74c-443e-879b-5507310d9391 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:29.307596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 617/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:39:29 2022] PUT /identity/v3/projects/8deff8fec8614da6997a32993c033fd8/users/b387ad13a6c843d0b9a43bc8f5f7fa13/roles/a9712a3506694519b4e4945b54539d79 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:31.544379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997c02-19cc-4941-b439-308fdad7be26 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:31.544888 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997c02-19cc-4941-b439-308fdad7be26 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:31.544888 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997c02-19cc-4941-b439-308fdad7be26 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:31.546265 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 616/1233] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:31.551625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe6edb-b136-4b2b-b933-e190f2b77395 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:31.552144 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe6edb-b136-4b2b-b933-e190f2b77395 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:31.552248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe6edb-b136-4b2b-b933-e190f2b77395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:31.570073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f5fe6edb-b136-4b2b-b933-e190f2b77395 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:31.571265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f5fe6edb-b136-4b2b-b933-e190f2b77395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:31.636850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 618/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:39:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:39:31.660406 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15997c02-19cc-4941-b439-308fdad7be26 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:31.686532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:31.761579 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15997c02-19cc-4941-b439-308fdad7be26 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:31.794928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee955c69-6996-490f-a6e3-b9129a7a24eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:31.795714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee955c69-6996-490f-a6e3-b9129a7a24eb None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:31.799621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee955c69-6996-490f-a6e3-b9129a7a24eb None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:31.799621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee955c69-6996-490f-a6e3-b9129a7a24eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:31.806763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee955c69-6996-490f-a6e3-b9129a7a24eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-ee955c69-6996-490f-a6e3-b9129a7a24eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:39:31.815152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:31.816273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:31.817288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:31.817288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:31.817288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:31.817288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:31.817288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:39:31.817288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:39:31.817288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:39:31.817288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:39:31.817288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:39:31.817288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:39:31.817288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:39:31.817288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:31.817288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 617/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 2 13:39:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:31.822513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe6edb-b136-4b2b-b933-e190f2b77395 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:31.868400 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:31.921200 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe6edb-b136-4b2b-b933-e190f2b77395 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:31.955038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fbd1e-9dd6-44a9-a3cb-904376922094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:31.955786 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fbd1e-9dd6-44a9-a3cb-904376922094 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:31.956071 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fbd1e-9dd6-44a9-a3cb-904376922094 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:31.956348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fbd1e-9dd6-44a9-a3cb-904376922094 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:31.957092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fbd1e-9dd6-44a9-a3cb-904376922094 None admin] RBAC: Adding query filter params (name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:31.957395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fbd1e-9dd6-44a9-a3cb-904376922094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:31.958768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fbd1e-9dd6-44a9-a3cb-904376922094 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:31.967650 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 619/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 2 13:39:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:31.973400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee955c69-6996-490f-a6e3-b9129a7a24eb None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:32.059708 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:32.074670 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee955c69-6996-490f-a6e3-b9129a7a24eb None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:32.108450 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda38da6-1f4c-4242-b3f2-05c50f00b38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:32.109231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda38da6-1f4c-4242-b3f2-05c50f00b38c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:32.109516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda38da6-1f4c-4242-b3f2-05c50f00b38c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:32.109793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda38da6-1f4c-4242-b3f2-05c50f00b38c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:32.120260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda38da6-1f4c-4242-b3f2-05c50f00b38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:32.121823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda38da6-1f4c-4242-b3f2-05c50f00b38c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-cda38da6-1f4c-4242-b3f2-05c50f00b38c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:39:32.138972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:32.139969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:32.141062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:39:32.141062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:39:32.141062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:32.141062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:32.141062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 618/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:32.146568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fbd1e-9dd6-44a9-a3cb-904376922094 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:32.247642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fbd1e-9dd6-44a9-a3cb-904376922094 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:32.256965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:32.282168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5336673-4381-47af-bd1a-aff30f5fb4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:32.282823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5336673-4381-47af-bd1a-aff30f5fb4af None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:32.283100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5336673-4381-47af-bd1a-aff30f5fb4af None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:32.283370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5336673-4381-47af-bd1a-aff30f5fb4af None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:32.284110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5336673-4381-47af-bd1a-aff30f5fb4af None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:32.284411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5336673-4381-47af-bd1a-aff30f5fb4af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:32.285767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5336673-4381-47af-bd1a-aff30f5fb4af None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:32.298143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 620/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:32.303979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda38da6-1f4c-4242-b3f2-05c50f00b38c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:32.404890 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda38da6-1f4c-4242-b3f2-05c50f00b38c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:32.438960 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3687d9-4569-44e4-aa84-e4afae192f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:32.439786 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3687d9-4569-44e4-aa84-e4afae192f22 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:32.440070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3687d9-4569-44e4-aa84-e4afae192f22 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:32.440345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3687d9-4569-44e4-aa84-e4afae192f22 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:32.443298 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:32.448616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3687d9-4569-44e4-aa84-e4afae192f22 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:32.450565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3687d9-4569-44e4-aa84-e4afae192f22 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-5f3687d9-4569-44e4-aa84-e4afae192f22 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:39:32.465345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:32.466935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:32.468148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:32.468148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:32.468148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:39:32.468148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:39:32.468148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:39:32.468148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:39:32.468148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:39:32.468148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:39:32.468148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:39:32.468148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:32.468148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 619/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:32.472517 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5336673-4381-47af-bd1a-aff30f5fb4af None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:32.572188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5336673-4381-47af-bd1a-aff30f5fb4af None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:32.606881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26534f0a-6d7f-4fa5-af1c-b2af7ad91b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:32.607574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26534f0a-6d7f-4fa5-af1c-b2af7ad91b97 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:32.607861 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26534f0a-6d7f-4fa5-af1c-b2af7ad91b97 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:32.608260 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26534f0a-6d7f-4fa5-af1c-b2af7ad91b97 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:32.609079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26534f0a-6d7f-4fa5-af1c-b2af7ad91b97 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:32.609393 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26534f0a-6d7f-4fa5-af1c-b2af7ad91b97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:32.610844 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26534f0a-6d7f-4fa5-af1c-b2af7ad91b97 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:32.628743 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 621/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 2 13:39:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:39:32.634672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3687d9-4569-44e4-aa84-e4afae192f22 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:32.733931 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3687d9-4569-44e4-aa84-e4afae192f22 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:32.767909 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ef729-c7ad-4330-b459-c5bce5123e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:32.768581 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ef729-c7ad-4330-b459-c5bce5123e28 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:32.768859 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ef729-c7ad-4330-b459-c5bce5123e28 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:32.769129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ef729-c7ad-4330-b459-c5bce5123e28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:32.828483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:32.834853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ef729-c7ad-4330-b459-c5bce5123e28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:32.836335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ef729-c7ad-4330-b459-c5bce5123e28 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:32.932976 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 620/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:39:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:39:32.939717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26534f0a-6d7f-4fa5-af1c-b2af7ad91b97 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:32.966585 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:33.044655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26534f0a-6d7f-4fa5-af1c-b2af7ad91b97 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:33.078325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cb342-7cb1-4245-92d9-e6586a2251b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:33.079107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cb342-7cb1-4245-92d9-e6586a2251b0 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:33.079390 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cb342-7cb1-4245-92d9-e6586a2251b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:33.079693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cb342-7cb1-4245-92d9-e6586a2251b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:33.090473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cb342-7cb1-4245-92d9-e6586a2251b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:33.091958 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cb342-7cb1-4245-92d9-e6586a2251b0 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-064cb342-7cb1-4245-92d9-e6586a2251b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:39:33.109967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:33.111634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:33.120118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:39:33.120118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:39:33.120118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:33.120118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:33.120118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 622/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:33.120466 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ef729-c7ad-4330-b459-c5bce5123e28 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:33.209671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:33.215297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ef729-c7ad-4330-b459-c5bce5123e28 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:33.255901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8827fd7-4cf7-48c5-acf0-a1ecb2703b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:33.256700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827fd7-4cf7-48c5-acf0-a1ecb2703b9b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:33.257535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827fd7-4cf7-48c5-acf0-a1ecb2703b9b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:33.257535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827fd7-4cf7-48c5-acf0-a1ecb2703b9b None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:33.257960 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8827fd7-4cf7-48c5-acf0-a1ecb2703b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:33.258260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8827fd7-4cf7-48c5-acf0-a1ecb2703b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:33.259661 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8827fd7-4cf7-48c5-acf0-a1ecb2703b9b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:33.271790 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 621/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:33.282990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cb342-7cb1-4245-92d9-e6586a2251b0 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:33.358829 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:33.381175 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cb342-7cb1-4245-92d9-e6586a2251b0 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:33.414709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f16a70-7de0-4682-a225-e34e79b465c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:33.415522 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f16a70-7de0-4682-a225-e34e79b465c0 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:33.415801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f16a70-7de0-4682-a225-e34e79b465c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:33.416070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f16a70-7de0-4682-a225-e34e79b465c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:33.423316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f16a70-7de0-4682-a225-e34e79b465c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:33.424789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f16a70-7de0-4682-a225-e34e79b465c0 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-91f16a70-7de0-4682-a225-e34e79b465c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:39:33.439675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:33.441441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:33.443573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:39:33.443573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:39:33.443573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:39:33.443573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:39:33.443573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:39:33.443573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:39:33.443573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:39:33.443573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:33.443573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 623/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:33.448574 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8827fd7-4cf7-48c5-acf0-a1ecb2703b9b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:33.554172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8827fd7-4cf7-48c5-acf0-a1ecb2703b9b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:33.595659 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3d7e8-82d5-4886-9dff-4679257c08fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:33.596325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3d7e8-82d5-4886-9dff-4679257c08fe None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:33.596775 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3d7e8-82d5-4886-9dff-4679257c08fe None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:33.597053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3d7e8-82d5-4886-9dff-4679257c08fe None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:33.597849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3d7e8-82d5-4886-9dff-4679257c08fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:33.598154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3d7e8-82d5-4886-9dff-4679257c08fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:33.599637 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3d7e8-82d5-4886-9dff-4679257c08fe None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:33.612634 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 622/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:33.618908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f16a70-7de0-4682-a225-e34e79b465c0 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:33.720717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f16a70-7de0-4682-a225-e34e79b465c0 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:33.757058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc23c4-a93c-4b8c-aee5-c22f47d49488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:33.757724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc23c4-a93c-4b8c-aee5-c22f47d49488 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:33.758005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc23c4-a93c-4b8c-aee5-c22f47d49488 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:33.758277 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc23c4-a93c-4b8c-aee5-c22f47d49488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:33.759141 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc23c4-a93c-4b8c-aee5-c22f47d49488 None admin] RBAC: Adding query filter params (role.id=a9712a3506694519b4e4945b54539d79, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=b387ad13a6c843d0b9a43bc8f5f7fa13) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:33.759475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc23c4-a93c-4b8c-aee5-c22f47d49488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:33.760923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc23c4-a93c-4b8c-aee5-c22f47d49488 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:33.768461 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 624/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:39:33 2022] GET /identity/v3/role_assignments?user.id=b387ad13a6c843d0b9a43bc8f5f7fa13&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=a9712a3506694519b4e4945b54539d79 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:36.084892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7a4d7-e381-4d2f-88bb-dc23eb574426 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:36.085420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7a4d7-e381-4d2f-88bb-dc23eb574426 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:36.085420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7a4d7-e381-4d2f-88bb-dc23eb574426 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:36.086804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 623/1247] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:36.092138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33d0dd-778e-490b-a3e5-dab8ed82d59f None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:36.092539 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33d0dd-778e-490b-a3e5-dab8ed82d59f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:36.092701 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33d0dd-778e-490b-a3e5-dab8ed82d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:36.097752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:36.110178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-2f33d0dd-778e-490b-a3e5-dab8ed82d59f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:36.111473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2f33d0dd-778e-490b-a3e5-dab8ed82d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:36.176983 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 625/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:39:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:39:36.200735 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7a4d7-e381-4d2f-88bb-dc23eb574426 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:36.218606 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:36.301288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7a4d7-e381-4d2f-88bb-dc23eb574426 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:36.333476 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ecce5-0d23-4482-865e-b3c8dd1e09b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:36.334249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ecce5-0d23-4482-865e-b3c8dd1e09b0 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:36.334523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ecce5-0d23-4482-865e-b3c8dd1e09b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:36.334787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ecce5-0d23-4482-865e-b3c8dd1e09b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:36.344515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ecce5-0d23-4482-865e-b3c8dd1e09b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-3e9ecce5-0d23-4482-865e-b3c8dd1e09b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:39:36.351979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:36.352912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:36.353949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:36.353949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:36.353949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:36.353949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:36.353949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:39:36.353949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:39:36.353949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:39:36.353949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:39:36.353949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:39:36.353949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:39:36.353949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:39:36.353949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:36.353949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 624/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:39:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:36.359656 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33d0dd-778e-490b-a3e5-dab8ed82d59f None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:36.459870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33d0dd-778e-490b-a3e5-dab8ed82d59f None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:36.489974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:36.494806 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc9d6d-0804-4422-ad94-25008d81f80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:36.495490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc9d6d-0804-4422-ad94-25008d81f80f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:36.495805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc9d6d-0804-4422-ad94-25008d81f80f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:36.496079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc9d6d-0804-4422-ad94-25008d81f80f None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:36.496823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc9d6d-0804-4422-ad94-25008d81f80f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:36.497129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc9d6d-0804-4422-ad94-25008d81f80f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:36.498488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc9d6d-0804-4422-ad94-25008d81f80f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:36.509489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 626/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:39:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:36.514224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ecce5-0d23-4482-865e-b3c8dd1e09b0 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:36.590742 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:36.613006 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ecce5-0d23-4482-865e-b3c8dd1e09b0 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:36.645176 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037cf7-92ae-4347-b706-a92ce1976431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:36.645962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037cf7-92ae-4347-b706-a92ce1976431 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:36.646250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037cf7-92ae-4347-b706-a92ce1976431 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:36.646528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037cf7-92ae-4347-b706-a92ce1976431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:36.657769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a037cf7-92ae-4347-b706-a92ce1976431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:36.659286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a037cf7-92ae-4347-b706-a92ce1976431 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-3a037cf7-92ae-4347-b706-a92ce1976431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:39:36.676889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:36.677952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:36.678908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:39:36.678908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:39:36.678908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:36.678908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:36.678908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 625/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:36.683863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc9d6d-0804-4422-ad94-25008d81f80f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:36.785511 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc9d6d-0804-4422-ad94-25008d81f80f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:36.818265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7513687-a116-4a93-8b32-198f95466198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:36.818920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7513687-a116-4a93-8b32-198f95466198 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:36.819201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7513687-a116-4a93-8b32-198f95466198 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:36.819494 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7513687-a116-4a93-8b32-198f95466198 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:36.820241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7513687-a116-4a93-8b32-198f95466198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:36.820545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7513687-a116-4a93-8b32-198f95466198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:36.821915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7513687-a116-4a93-8b32-198f95466198 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:36.833906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 627/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:36.840271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037cf7-92ae-4347-b706-a92ce1976431 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:36.937681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037cf7-92ae-4347-b706-a92ce1976431 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:36.964138 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:36.972246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fea9c-3a6c-4b04-8e80-6ad1e47c20c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:36.973037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fea9c-3a6c-4b04-8e80-6ad1e47c20c1 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:36.973315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fea9c-3a6c-4b04-8e80-6ad1e47c20c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:36.973585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fea9c-3a6c-4b04-8e80-6ad1e47c20c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:36.981137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fea9c-3a6c-4b04-8e80-6ad1e47c20c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:36.982587 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fea9c-3a6c-4b04-8e80-6ad1e47c20c1 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-f92fea9c-3a6c-4b04-8e80-6ad1e47c20c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:39:36.997853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:36.999293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:37.000353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:37.000353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:37.000353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:39:37.000353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:39:37.000353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:39:37.000353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:39:37.000353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:39:37.000353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:39:37.000353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:39:37.000353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:37.000353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 626/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:37.005177 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7513687-a116-4a93-8b32-198f95466198 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:37.061044 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:37.106633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7513687-a116-4a93-8b32-198f95466198 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:37.140775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d4a24-ddcc-4d61-a3c5-493df3da85fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:37.141445 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d4a24-ddcc-4d61-a3c5-493df3da85fb None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:37.141730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d4a24-ddcc-4d61-a3c5-493df3da85fb None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:37.142009 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d4a24-ddcc-4d61-a3c5-493df3da85fb None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:37.142834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d4a24-ddcc-4d61-a3c5-493df3da85fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:37.143143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d4a24-ddcc-4d61-a3c5-493df3da85fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:37.144594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d4a24-ddcc-4d61-a3c5-493df3da85fb None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:37.162033 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 628/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 2 13:39:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:37.167989 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fea9c-3a6c-4b04-8e80-6ad1e47c20c1 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:37.267848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fea9c-3a6c-4b04-8e80-6ad1e47c20c1 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:37.300709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577f8a0-4146-407a-9b3e-c0a16c439d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:37.301353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577f8a0-4146-407a-9b3e-c0a16c439d78 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:37.301632 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577f8a0-4146-407a-9b3e-c0a16c439d78 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:37.301918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577f8a0-4146-407a-9b3e-c0a16c439d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:37.356772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:37.368729 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577f8a0-4146-407a-9b3e-c0a16c439d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:37.370186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577f8a0-4146-407a-9b3e-c0a16c439d78 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:37.467989 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 627/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:39:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:39:37.473821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d4a24-ddcc-4d61-a3c5-493df3da85fb None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:37.575194 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d4a24-ddcc-4d61-a3c5-493df3da85fb None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:37.588091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:37.608509 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bea1b-ceed-435e-a3e1-d8d32787f61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:37.609292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bea1b-ceed-435e-a3e1-d8d32787f61e None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:37.609576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bea1b-ceed-435e-a3e1-d8d32787f61e None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:37.609851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bea1b-ceed-435e-a3e1-d8d32787f61e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:37.619499 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bea1b-ceed-435e-a3e1-d8d32787f61e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:37.621521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bea1b-ceed-435e-a3e1-d8d32787f61e None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-b57bea1b-ceed-435e-a3e1-d8d32787f61e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:39:37.638961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:37.639961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:37.641007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:39:37.641007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:39:37.641007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:37.641007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:37.641007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 629/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:37.645889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577f8a0-4146-407a-9b3e-c0a16c439d78 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:37.731664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:37.743246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577f8a0-4146-407a-9b3e-c0a16c439d78 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:37.776580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295589f-3979-464d-be06-2299b24e2c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:37.777232 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295589f-3979-464d-be06-2299b24e2c92 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:37.777514 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295589f-3979-464d-be06-2299b24e2c92 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:37.777788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295589f-3979-464d-be06-2299b24e2c92 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:37.778507 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295589f-3979-464d-be06-2299b24e2c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:37.778813 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295589f-3979-464d-be06-2299b24e2c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:37.780230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295589f-3979-464d-be06-2299b24e2c92 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:37.791075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 628/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:37.797374 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bea1b-ceed-435e-a3e1-d8d32787f61e None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:37.895743 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bea1b-ceed-435e-a3e1-d8d32787f61e None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:37.929215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf8368-ea1a-43d4-b77d-7d94dbf106f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:37.930009 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf8368-ea1a-43d4-b77d-7d94dbf106f5 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:37.930378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf8368-ea1a-43d4-b77d-7d94dbf106f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:37.930572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf8368-ea1a-43d4-b77d-7d94dbf106f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:37.937756 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf8368-ea1a-43d4-b77d-7d94dbf106f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:37.939239 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf8368-ea1a-43d4-b77d-7d94dbf106f5 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-b0cf8368-ea1a-43d4-b77d-7d94dbf106f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:39:37.953137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:37.954124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:37.955040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:39:37.955040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:39:37.955040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:39:37.955040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:39:37.955040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:39:37.955040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:39:37.955040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:39:37.955040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:37.955040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 630/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:37.960281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295589f-3979-464d-be06-2299b24e2c92 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:38.060772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295589f-3979-464d-be06-2299b24e2c92 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:38.093384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e9a43-a74b-44e5-b92d-107c87d27250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:38.094027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e9a43-a74b-44e5-b92d-107c87d27250 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:38.094305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e9a43-a74b-44e5-b92d-107c87d27250 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:38.094574 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e9a43-a74b-44e5-b92d-107c87d27250 None admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:38.095342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e9a43-a74b-44e5-b92d-107c87d27250 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:38.095672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e9a43-a74b-44e5-b92d-107c87d27250 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:38.097081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e9a43-a74b-44e5-b92d-107c87d27250 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:38.109404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 629/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:39:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:38.115487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf8368-ea1a-43d4-b77d-7d94dbf106f5 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:38.141227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:38.214222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf8368-ea1a-43d4-b77d-7d94dbf106f5 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:38.375792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493918b-4e73-4eb9-8f51-6de80e1657ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:38.376446 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493918b-4e73-4eb9-8f51-6de80e1657ac None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:38.376730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493918b-4e73-4eb9-8f51-6de80e1657ac None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:38.377005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493918b-4e73-4eb9-8f51-6de80e1657ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:38.377823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493918b-4e73-4eb9-8f51-6de80e1657ac None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=b387ad13a6c843d0b9a43bc8f5f7fa13) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:38.378134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493918b-4e73-4eb9-8f51-6de80e1657ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:38.379594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493918b-4e73-4eb9-8f51-6de80e1657ac None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:38.385048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 631/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:39:38 2022] GET /identity/v3/role_assignments?user.id=b387ad13a6c843d0b9a43bc8f5f7fa13&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=c5632345c9274d348669482f1f7414c8 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:40.602719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b28a2-0cb2-4f67-9afb-34010f0e98e8 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:40.603225 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b28a2-0cb2-4f67-9afb-34010f0e98e8 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:40.603225 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b28a2-0cb2-4f67-9afb-34010f0e98e8 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:40.604585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 630/1261] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:40.610451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cb2c4-6d7e-43dd-8f26-7973eb1ada4c None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:40.610866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cb2c4-6d7e-43dd-8f26-7973eb1ada4c None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:40.611007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cb2c4-6d7e-43dd-8f26-7973eb1ada4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:40.629900 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-4b9cb2c4-6d7e-43dd-8f26-7973eb1ada4c None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:40.631075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4b9cb2c4-6d7e-43dd-8f26-7973eb1ada4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:40.695801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 632/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:39:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:39:40.718433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b28a2-0cb2-4f67-9afb-34010f0e98e8 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:40.729219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:40.825784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b28a2-0cb2-4f67-9afb-34010f0e98e8 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:40.858042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b2ff9-b7d8-48c7-a91a-00f1926c7f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:40.858759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b2ff9-b7d8-48c7-a91a-00f1926c7f6e None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:40.859036 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b2ff9-b7d8-48c7-a91a-00f1926c7f6e None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:40.859306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b2ff9-b7d8-48c7-a91a-00f1926c7f6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:40.868981 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b2ff9-b7d8-48c7-a91a-00f1926c7f6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-125b2ff9-b7d8-48c7-a91a-00f1926c7f6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:39:40.877564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:40.878788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:40.880017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:40.880017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:40.880017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:40.880017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:40.880017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:39:40.880017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:39:40.880017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:39:40.880017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:39:40.880017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:39:40.880017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:39:40.880017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:39:40.880017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:40.880017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 631/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:40.884812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cb2c4-6d7e-43dd-8f26-7973eb1ada4c None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:40.902943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:40.981810 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cb2c4-6d7e-43dd-8f26-7973eb1ada4c None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:41.014850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48e4a1-97bd-4377-aeac-501e2fc6dea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:41.015530 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48e4a1-97bd-4377-aeac-501e2fc6dea4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:41.015807 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48e4a1-97bd-4377-aeac-501e2fc6dea4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:41.016073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48e4a1-97bd-4377-aeac-501e2fc6dea4 None admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:41.016800 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48e4a1-97bd-4377-aeac-501e2fc6dea4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:41.017098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48e4a1-97bd-4377-aeac-501e2fc6dea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:41.018446 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48e4a1-97bd-4377-aeac-501e2fc6dea4 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:41.026401 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 633/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:39:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:41.032735 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b2ff9-b7d8-48c7-a91a-00f1926c7f6e None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:41.098843 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:41.132082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b2ff9-b7d8-48c7-a91a-00f1926c7f6e None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:41.165311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aa4bd-de1b-4245-833a-211babdb1054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:41.166099 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa4bd-de1b-4245-833a-211babdb1054 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:41.168315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa4bd-de1b-4245-833a-211babdb1054 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:41.168315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa4bd-de1b-4245-833a-211babdb1054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:41.178828 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aa4bd-de1b-4245-833a-211babdb1054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:41.180452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aa4bd-de1b-4245-833a-211babdb1054 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-624aa4bd-de1b-4245-833a-211babdb1054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:39:41.198250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:41.199384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:41.200555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:39:41.200555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:39:41.200555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:41.200555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:41.200555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 632/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:41.205883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48e4a1-97bd-4377-aeac-501e2fc6dea4 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:41.285670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:41.304391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48e4a1-97bd-4377-aeac-501e2fc6dea4 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:41.336877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed41c82-a33a-4bb5-b28b-96b4709df11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:41.337535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed41c82-a33a-4bb5-b28b-96b4709df11f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:41.337818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed41c82-a33a-4bb5-b28b-96b4709df11f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:41.338094 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed41c82-a33a-4bb5-b28b-96b4709df11f None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:41.338803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed41c82-a33a-4bb5-b28b-96b4709df11f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:41.339108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed41c82-a33a-4bb5-b28b-96b4709df11f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:41.341114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed41c82-a33a-4bb5-b28b-96b4709df11f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:41.351986 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 634/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:41.357671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aa4bd-de1b-4245-833a-211babdb1054 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:41.458650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aa4bd-de1b-4245-833a-211babdb1054 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:41.479510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:41.493092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716a060-4a41-4829-960c-551e5b27aee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:41.493889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716a060-4a41-4829-960c-551e5b27aee9 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:41.494172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716a060-4a41-4829-960c-551e5b27aee9 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:41.494447 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716a060-4a41-4829-960c-551e5b27aee9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:41.502337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716a060-4a41-4829-960c-551e5b27aee9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:41.504126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716a060-4a41-4829-960c-551e5b27aee9 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-5716a060-4a41-4829-960c-551e5b27aee9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:39:41.518816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:41.519983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:41.521137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:41.521137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:41.521137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:39:41.521137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:39:41.521137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:39:41.521137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:39:41.521137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:39:41.521137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:39:41.521137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:39:41.521137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:41.521137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 633/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:41.525972 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed41c82-a33a-4bb5-b28b-96b4709df11f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:41.622451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed41c82-a33a-4bb5-b28b-96b4709df11f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:41.656678 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3b05c-9bab-4e9f-ae9d-2bef9f89e516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:41.657334 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b05c-9bab-4e9f-ae9d-2bef9f89e516 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:41.657613 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b05c-9bab-4e9f-ae9d-2bef9f89e516 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:41.657884 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b05c-9bab-4e9f-ae9d-2bef9f89e516 None admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:41.658703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3b05c-9bab-4e9f-ae9d-2bef9f89e516 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:41.659002 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3b05c-9bab-4e9f-ae9d-2bef9f89e516 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:41.660436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3b05c-9bab-4e9f-ae9d-2bef9f89e516 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:41.669265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:41.677256 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 635/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 2 13:39:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:41.682958 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716a060-4a41-4829-960c-551e5b27aee9 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:41.783730 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716a060-4a41-4829-960c-551e5b27aee9 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:41.817047 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d365d-057e-4d3a-8717-e0a5f054afe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:41.819562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d365d-057e-4d3a-8717-e0a5f054afe0 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:41.819562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d365d-057e-4d3a-8717-e0a5f054afe0 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:41.819562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d365d-057e-4d3a-8717-e0a5f054afe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:41.829215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d365d-057e-4d3a-8717-e0a5f054afe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:41.830648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d365d-057e-4d3a-8717-e0a5f054afe0 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-629d365d-057e-4d3a-8717-e0a5f054afe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:39:41.847322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:41.848429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:41.849487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:39:41.849487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:39:41.849487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:41.849487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:41.849487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 634/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:41.854427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3b05c-9bab-4e9f-ae9d-2bef9f89e516 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:41.953410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3b05c-9bab-4e9f-ae9d-2bef9f89e516 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:41.986856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fa4f1-9f86-4edd-8cb4-8f74ddccf6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:41.987543 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fa4f1-9f86-4edd-8cb4-8f74ddccf6e4 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:41.987827 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fa4f1-9f86-4edd-8cb4-8f74ddccf6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:41.988100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fa4f1-9f86-4edd-8cb4-8f74ddccf6e4 None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:41.988807 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fa4f1-9f86-4edd-8cb4-8f74ddccf6e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:41.989110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fa4f1-9f86-4edd-8cb4-8f74ddccf6e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:41.990471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fa4f1-9f86-4edd-8cb4-8f74ddccf6e4 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:42.002185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 636/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:42.007988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d365d-057e-4d3a-8717-e0a5f054afe0 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:42.040059 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:42.107990 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d365d-057e-4d3a-8717-e0a5f054afe0 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:42.141650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cfa51-8f12-4513-88f6-051cd7a9df63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:42.142435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cfa51-8f12-4513-88f6-051cd7a9df63 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:42.142717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cfa51-8f12-4513-88f6-051cd7a9df63 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:42.142987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cfa51-8f12-4513-88f6-051cd7a9df63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:42.149567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cfa51-8f12-4513-88f6-051cd7a9df63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:42.150999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cfa51-8f12-4513-88f6-051cd7a9df63 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-db3cfa51-8f12-4513-88f6-051cd7a9df63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:39:42.165296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:42.166485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:42.168259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:39:42.168259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:39:42.168259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:39:42.168259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:39:42.168259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:39:42.168259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:39:42.168259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:39:42.168259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:42.168259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 635/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:42.173158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fa4f1-9f86-4edd-8cb4-8f74ddccf6e4 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:42.232804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:42.274550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fa4f1-9f86-4edd-8cb4-8f74ddccf6e4 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:42.307390 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c693247-21b5-4e0b-ad68-994760f7d49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:42.308004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693247-21b5-4e0b-ad68-994760f7d49f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:42.308886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693247-21b5-4e0b-ad68-994760f7d49f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:42.309168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693247-21b5-4e0b-ad68-994760f7d49f None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:42.309937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c693247-21b5-4e0b-ad68-994760f7d49f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:42.310241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c693247-21b5-4e0b-ad68-994760f7d49f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:42.311752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c693247-21b5-4e0b-ad68-994760f7d49f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:42.323328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 637/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:42.329636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cfa51-8f12-4513-88f6-051cd7a9df63 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:42.420948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:42.429816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cfa51-8f12-4513-88f6-051cd7a9df63 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:42.464248 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03758d2-6ad4-4a2a-b651-57878c730269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:42.465748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03758d2-6ad4-4a2a-b651-57878c730269 None admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:42.466032 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03758d2-6ad4-4a2a-b651-57878c730269 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:42.466307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03758d2-6ad4-4a2a-b651-57878c730269 None admin] PATH_INFO: `/v3/projects/8deff8fec8614da6997a32993c033fd8/users/b387ad13a6c843d0b9a43bc8f5f7fa13/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:42.468294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03758d2-6ad4-4a2a-b651-57878c730269 None admin] RBAC: Authorizing `identity:create_grant(project_id=8deff8fec8614da6997a32993c033fd8, user_id=b387ad13a6c843d0b9a43bc8f5f7fa13, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:42.469723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03758d2-6ad4-4a2a-b651-57878c730269 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:42.575507 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 636/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 2 13:39:42 2022] PUT /identity/v3/projects/8deff8fec8614da6997a32993c033fd8/users/b387ad13a6c843d0b9a43bc8f5f7fa13/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:44.781775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c804d-c6bc-433e-8065-889ff78d5eef None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:44.782304 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c804d-c6bc-433e-8065-889ff78d5eef None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:44.782304 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c804d-c6bc-433e-8065-889ff78d5eef None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:44.783695 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 638/1274] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:44.788809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf20378-69b1-465f-a409-76e7bd2a9949 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:44.789229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf20378-69b1-465f-a409-76e7bd2a9949 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:44.789371 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf20378-69b1-465f-a409-76e7bd2a9949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:44.805575 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-5cf20378-69b1-465f-a409-76e7bd2a9949 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:44.806849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-5cf20378-69b1-465f-a409-76e7bd2a9949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:44.875523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 637/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:39:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:39:44.900020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c804d-c6bc-433e-8065-889ff78d5eef None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:44.998407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c804d-c6bc-433e-8065-889ff78d5eef None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:45.015913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:45.032101 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f075ab-5b8c-418e-bebe-e10d4e691b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:45.032821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f075ab-5b8c-418e-bebe-e10d4e691b34 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:45.033105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f075ab-5b8c-418e-bebe-e10d4e691b34 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:45.033382 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f075ab-5b8c-418e-bebe-e10d4e691b34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:45.043237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f075ab-5b8c-418e-bebe-e10d4e691b34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-e7f075ab-5b8c-418e-bebe-e10d4e691b34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:39:45.050936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:45.052106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:45.053337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:45.053337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:45.053337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:45.053337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:45.053337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:39:45.053337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:39:45.053337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:39:45.053337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:39:45.053337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:39:45.053337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:39:45.053337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:39:45.053337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:45.053337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 639/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 2 13:39:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:45.058673 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf20378-69b1-465f-a409-76e7bd2a9949 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:45.139660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:45.157145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf20378-69b1-465f-a409-76e7bd2a9949 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:45.190817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d94a22-4980-4ee3-98ab-18037f95b42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:45.191564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d94a22-4980-4ee3-98ab-18037f95b42b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:45.191851 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d94a22-4980-4ee3-98ab-18037f95b42b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:45.192126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d94a22-4980-4ee3-98ab-18037f95b42b None admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:45.192871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d94a22-4980-4ee3-98ab-18037f95b42b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:45.193175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d94a22-4980-4ee3-98ab-18037f95b42b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:45.194558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d94a22-4980-4ee3-98ab-18037f95b42b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:45.202413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 638/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 2 13:39:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:45.208147 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f075ab-5b8c-418e-bebe-e10d4e691b34 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:45.308080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f075ab-5b8c-418e-bebe-e10d4e691b34 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:45.341308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2af28a-78dc-4f4c-8758-d9d303b8d552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:45.342090 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2af28a-78dc-4f4c-8758-d9d303b8d552 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:45.342372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2af28a-78dc-4f4c-8758-d9d303b8d552 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:45.342644 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2af28a-78dc-4f4c-8758-d9d303b8d552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:45.353231 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2af28a-78dc-4f4c-8758-d9d303b8d552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:45.354682 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2af28a-78dc-4f4c-8758-d9d303b8d552 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-7b2af28a-78dc-4f4c-8758-d9d303b8d552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:39:45.372568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:45.373652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:45.375228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:39:45.375228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:39:45.375228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:45.375228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:45.375228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 640/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:45.379958 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d94a22-4980-4ee3-98ab-18037f95b42b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:45.481135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d94a22-4980-4ee3-98ab-18037f95b42b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:45.514162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b559541-97c5-423a-82ba-bda2ab977008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:45.514818 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b559541-97c5-423a-82ba-bda2ab977008 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:45.515102 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b559541-97c5-423a-82ba-bda2ab977008 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:45.515377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b559541-97c5-423a-82ba-bda2ab977008 None admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:45.516127 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b559541-97c5-423a-82ba-bda2ab977008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:45.516433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b559541-97c5-423a-82ba-bda2ab977008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:45.517834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b559541-97c5-423a-82ba-bda2ab977008 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:45.529941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 639/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:45.535754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2af28a-78dc-4f4c-8758-d9d303b8d552 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:45.566440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:45.633168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2af28a-78dc-4f4c-8758-d9d303b8d552 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:45.667152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb54fb-65c0-47da-aaba-e49dc9d8f8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:45.668586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb54fb-65c0-47da-aaba-e49dc9d8f8a9 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:45.668869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb54fb-65c0-47da-aaba-e49dc9d8f8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:45.669144 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb54fb-65c0-47da-aaba-e49dc9d8f8a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:45.676278 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb54fb-65c0-47da-aaba-e49dc9d8f8a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:45.677742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb54fb-65c0-47da-aaba-e49dc9d8f8a9 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-fefb54fb-65c0-47da-aaba-e49dc9d8f8a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:39:45.693122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:45.694228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:45.695322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:45.695322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:45.695322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:39:45.695322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:39:45.695322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:39:45.695322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:39:45.695322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:39:45.695322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:39:45.695322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:39:45.695322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:45.695322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 641/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:45.700245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b559541-97c5-423a-82ba-bda2ab977008 None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:45.704025 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:45.800186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b559541-97c5-423a-82ba-bda2ab977008 None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:45.834535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baddfbe-ef63-4a7a-9563-48589b392edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:45.835125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baddfbe-ef63-4a7a-9563-48589b392edd None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:45.835405 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baddfbe-ef63-4a7a-9563-48589b392edd None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:45.835716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baddfbe-ef63-4a7a-9563-48589b392edd None admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:45.836567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baddfbe-ef63-4a7a-9563-48589b392edd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:45.836891 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baddfbe-ef63-4a7a-9563-48589b392edd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:45.838314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baddfbe-ef63-4a7a-9563-48589b392edd None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:45.855805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 640/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 2 13:39:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:45.861594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb54fb-65c0-47da-aaba-e49dc9d8f8a9 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:45.950680 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:45.959961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb54fb-65c0-47da-aaba-e49dc9d8f8a9 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:45.992747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c9bd2-24a7-4978-b184-27a65e254c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:45.993388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c9bd2-24a7-4978-b184-27a65e254c2c None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:45.993671 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c9bd2-24a7-4978-b184-27a65e254c2c None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:45.993940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c9bd2-24a7-4978-b184-27a65e254c2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:46.059750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c9bd2-24a7-4978-b184-27a65e254c2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:46.061186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c9bd2-24a7-4978-b184-27a65e254c2c None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:46.147137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:46.157490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 642/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 2 13:39:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:39:46.163357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baddfbe-ef63-4a7a-9563-48589b392edd None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:46.225417 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:46.264251 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baddfbe-ef63-4a7a-9563-48589b392edd None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:46.297521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8e452-e262-4b4c-aaa4-4c6233324a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:46.298308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8e452-e262-4b4c-aaa4-4c6233324a7b None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:46.298596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8e452-e262-4b4c-aaa4-4c6233324a7b None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:46.298870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8e452-e262-4b4c-aaa4-4c6233324a7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:46.309389 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8e452-e262-4b4c-aaa4-4c6233324a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:46.310838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8e452-e262-4b4c-aaa4-4c6233324a7b None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-c5c8e452-e262-4b4c-aaa4-4c6233324a7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:39:46.328827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:46.330498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:46.332665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:39:46.332665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:39:46.332665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:39:46.332665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:46.332665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 641/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:46.337019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c9bd2-24a7-4978-b184-27a65e254c2c None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:46.432035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c9bd2-24a7-4978-b184-27a65e254c2c None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:46.468602 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dca57-9996-465a-8d51-364c6f58ecef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:46.469285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dca57-9996-465a-8d51-364c6f58ecef None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:46.469572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dca57-9996-465a-8d51-364c6f58ecef None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:46.469846 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dca57-9996-465a-8d51-364c6f58ecef None admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:46.470559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dca57-9996-465a-8d51-364c6f58ecef None admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:46.470864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dca57-9996-465a-8d51-364c6f58ecef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:46.472264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dca57-9996-465a-8d51-364c6f58ecef None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:46.483326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 643/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 2 13:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:46.488966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8e452-e262-4b4c-aaa4-4c6233324a7b None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:46.589769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8e452-e262-4b4c-aaa4-4c6233324a7b None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:46.604302 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:46.625175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847471a8-140a-423c-855f-ef31a4d8ebde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:46.626003 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847471a8-140a-423c-855f-ef31a4d8ebde None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:46.626259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847471a8-140a-423c-855f-ef31a4d8ebde None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:46.626536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847471a8-140a-423c-855f-ef31a4d8ebde None admin] PATH_INFO: `/v3/projects/service` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:46.633287 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847471a8-140a-423c-855f-ef31a4d8ebde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:46.634741 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847471a8-140a-423c-855f-ef31a4d8ebde None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application [None req-847471a8-140a-423c-855f-ef31a4d8ebde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:39:46.648236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:46.649162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:46.650107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:39:46.650107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:39:46.650107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:39:46.650107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:39:46.650107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:39:46.650107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:39:46.650107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:39:46.650107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: ERROR keystone.server.flask.application Jun 02 13:39:46.650107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 642/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 2 13:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:46.655324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dca57-9996-465a-8d51-364c6f58ecef None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:46.715132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:46.753515 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dca57-9996-465a-8d51-364c6f58ecef None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:46.785322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1662071-a564-4369-95f8-b394f3801c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:46.786002 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662071-a564-4369-95f8-b394f3801c27 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:46.786304 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662071-a564-4369-95f8-b394f3801c27 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:46.786581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662071-a564-4369-95f8-b394f3801c27 None admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:46.787357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1662071-a564-4369-95f8-b394f3801c27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:46.787693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1662071-a564-4369-95f8-b394f3801c27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:46.789113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1662071-a564-4369-95f8-b394f3801c27 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:46.801564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 644/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 2 13:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:46.808016 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847471a8-140a-423c-855f-ef31a4d8ebde None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:46.908185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847471a8-140a-423c-855f-ef31a4d8ebde None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:46.941984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80303ca4-30d4-4f05-a989-04eec0003d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:46.942651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80303ca4-30d4-4f05-a989-04eec0003d54 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:46.942939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80303ca4-30d4-4f05-a989-04eec0003d54 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:46.943218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80303ca4-30d4-4f05-a989-04eec0003d54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:46.944103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80303ca4-30d4-4f05-a989-04eec0003d54 None admin] RBAC: Adding query filter params (role.id=c5632345c9274d348669482f1f7414c8, scope.project.id=8deff8fec8614da6997a32993c033fd8, user.id=b387ad13a6c843d0b9a43bc8f5f7fa13) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:46.944398 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80303ca4-30d4-4f05-a989-04eec0003d54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:46.946015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80303ca4-30d4-4f05-a989-04eec0003d54 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:46.952246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 643/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 2 13:39:46 2022] GET /identity/v3/role_assignments?user.id=b387ad13a6c843d0b9a43bc8f5f7fa13&scope.project.id=8deff8fec8614da6997a32993c033fd8&role.id=c5632345c9274d348669482f1f7414c8 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:39:49.219404 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872118e-3640-437a-bf19-841840ff879c None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:49.219992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872118e-3640-437a-bf19-841840ff879c None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:49.220114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872118e-3640-437a-bf19-841840ff879c None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:49.221514 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 645/1288] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:49.227260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46f25f-d821-4bfc-aaa4-82567f73528e None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:49.227698 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46f25f-d821-4bfc-aaa4-82567f73528e None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:49.227907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46f25f-d821-4bfc-aaa4-82567f73528e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:49.245315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-9e46f25f-d821-4bfc-aaa4-82567f73528e None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:49.246608 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9e46f25f-d821-4bfc-aaa4-82567f73528e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:49.276396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:49.313429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 644/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:39:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:39:49.336033 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872118e-3640-437a-bf19-841840ff879c None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:49.436024 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872118e-3640-437a-bf19-841840ff879c None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:49.449784 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:49.472782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc4b0a-9e71-4dfe-b7d6-3db31916a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:49.473500 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc4b0a-9e71-4dfe-b7d6-3db31916a06f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:49.473776 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc4b0a-9e71-4dfe-b7d6-3db31916a06f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:49.474047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc4b0a-9e71-4dfe-b7d6-3db31916a06f None admin] PATH_INFO: `/v3/services/placement` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:49.474684 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc4b0a-9e71-4dfe-b7d6-3db31916a06f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:49.476078 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc4b0a-9e71-4dfe-b7d6-3db31916a06f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-e4cc4b0a-9e71-4dfe-b7d6-3db31916a06f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:49.488098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:49.489327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:49.490189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 646/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 2 13:39:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:49.495289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46f25f-d821-4bfc-aaa4-82567f73528e None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:49.591388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46f25f-d821-4bfc-aaa4-82567f73528e None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:49.624499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da36a3d-9763-42fa-828f-e3551a504252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:49.625156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da36a3d-9763-42fa-828f-e3551a504252 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:49.625439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da36a3d-9763-42fa-828f-e3551a504252 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:49.625712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da36a3d-9763-42fa-828f-e3551a504252 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:49.626418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da36a3d-9763-42fa-828f-e3551a504252 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:49.626721 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da36a3d-9763-42fa-828f-e3551a504252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:49.628266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da36a3d-9763-42fa-828f-e3551a504252 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:49.633300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 645/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 2 13:39:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:49.640065 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc4b0a-9e71-4dfe-b7d6-3db31916a06f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:49.742694 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc4b0a-9e71-4dfe-b7d6-3db31916a06f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:49.776867 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc237c76-d11a-4cec-9d97-45c5851db3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:49.778107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc237c76-d11a-4cec-9d97-45c5851db3b6 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:49.778388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc237c76-d11a-4cec-9d97-45c5851db3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:49.778657 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc237c76-d11a-4cec-9d97-45c5851db3b6 None admin] PATH_INFO: `/v3/services` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:49.779362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc237c76-d11a-4cec-9d97-45c5851db3b6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:49.779676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc237c76-d11a-4cec-9d97-45c5851db3b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:49.781033 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc237c76-d11a-4cec-9d97-45c5851db3b6 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:49.785366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 647/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 2 13:39:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:52.067961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30614f-0576-49bd-8157-dfdef2d18c88 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.068620 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30614f-0576-49bd-8157-dfdef2d18c88 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.068620 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30614f-0576-49bd-8157-dfdef2d18c88 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.069872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 646/1293] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:52.075225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe03d72-ace7-4579-8bbd-338be4f83d45 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.075734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe03d72-ace7-4579-8bbd-338be4f83d45 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.075842 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe03d72-ace7-4579-8bbd-338be4f83d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.092650 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-4fe03d72-ace7-4579-8bbd-338be4f83d45 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:52.093855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4fe03d72-ace7-4579-8bbd-338be4f83d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:52.123600 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:52.159807 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 648/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:39:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:39:52.183034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30614f-0576-49bd-8157-dfdef2d18c88 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:52.213986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:52.283486 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30614f-0576-49bd-8157-dfdef2d18c88 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:52.317184 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73026091-1cc8-4608-9166-1fadf3a5f955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:52.317823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73026091-1cc8-4608-9166-1fadf3a5f955 None admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:52.318156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73026091-1cc8-4608-9166-1fadf3a5f955 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:52.318478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73026091-1cc8-4608-9166-1fadf3a5f955 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:52.319115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73026091-1cc8-4608-9166-1fadf3a5f955 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:52.320528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73026091-1cc8-4608-9166-1fadf3a5f955 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:52.462984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 647/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 2 13:39:52 2022] POST /identity/v3/services => generated 246 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:54.722191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ce4b9-fb37-493f-affb-366b9ccca253 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:54.722761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ce4b9-fb37-493f-affb-366b9ccca253 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:54.722761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ce4b9-fb37-493f-affb-366b9ccca253 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:54.724137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 649/1296] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:39:54.729374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192798b-3276-4dd7-8088-80e7ccf9af15 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:54.729812 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192798b-3276-4dd7-8088-80e7ccf9af15 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:54.729941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192798b-3276-4dd7-8088-80e7ccf9af15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:54.747475 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-9192798b-3276-4dd7-8088-80e7ccf9af15 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:54.748656 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9192798b-3276-4dd7-8088-80e7ccf9af15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:54.820846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 648/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:39:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:39:54.844359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ce4b9-fb37-493f-affb-366b9ccca253 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:54.946912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ce4b9-fb37-493f-affb-366b9ccca253 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:54.980003 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3b01d-c3c8-4555-8059-404a26fbc44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:54.981261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3b01d-c3c8-4555-8059-404a26fbc44f None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:54.981542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3b01d-c3c8-4555-8059-404a26fbc44f None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:54.981811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3b01d-c3c8-4555-8059-404a26fbc44f None admin] PATH_INFO: `/v3/services/placement` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:54.982466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3b01d-c3c8-4555-8059-404a26fbc44f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:54.983862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3b01d-c3c8-4555-8059-404a26fbc44f None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-f8d3b01d-c3c8-4555-8059-404a26fbc44f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:54.996799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:54.998158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:54.999573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 650/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 2 13:39:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:55.004577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192798b-3276-4dd7-8088-80e7ccf9af15 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:55.022888 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:55.099765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192798b-3276-4dd7-8088-80e7ccf9af15 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:55.133802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b828e-3b69-45cf-95b0-5d6df340784c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:55.134461 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b828e-3b69-45cf-95b0-5d6df340784c None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:55.134743 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b828e-3b69-45cf-95b0-5d6df340784c None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:55.135019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b828e-3b69-45cf-95b0-5d6df340784c None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:55.135819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b828e-3b69-45cf-95b0-5d6df340784c None admin] RBAC: Adding query filter params (name=placement) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:55.136126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b828e-3b69-45cf-95b0-5d6df340784c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:55.137556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b828e-3b69-45cf-95b0-5d6df340784c None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:55.142577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 649/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 2 13:39:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:55.148523 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3b01d-c3c8-4555-8059-404a26fbc44f None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:55.180533 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:55.246477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3b01d-c3c8-4555-8059-404a26fbc44f None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:55.279933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bd34e-2569-418c-b55f-5927d9750447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:55.280595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bd34e-2569-418c-b55f-5927d9750447 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:55.280876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bd34e-2569-418c-b55f-5927d9750447 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:55.281154 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bd34e-2569-418c-b55f-5927d9750447 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:55.282142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2bd34e-2569-418c-b55f-5927d9750447 None admin] RBAC: Adding query filter params (interface=public, service_id=ce68a06d3dbc4d5d87271862b6f4ba81, region_id=RegionOne) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:55.282257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2bd34e-2569-418c-b55f-5927d9750447 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:55.283634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2bd34e-2569-418c-b55f-5927d9750447 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:55.289290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 651/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 2 13:39:55 2022] GET /identity/v3/endpoints?service_id=ce68a06d3dbc4d5d87271862b6f4ba81&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:55.295432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b828e-3b69-45cf-95b0-5d6df340784c None admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:55.383069 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:55.392364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b828e-3b69-45cf-95b0-5d6df340784c None admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:55.425739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670b1a9-f541-48e8-98f3-ccf37d718a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:55.426393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670b1a9-f541-48e8-98f3-ccf37d718a30 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:55.426676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670b1a9-f541-48e8-98f3-ccf37d718a30 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:55.426951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670b1a9-f541-48e8-98f3-ccf37d718a30 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:55.427676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670b1a9-f541-48e8-98f3-ccf37d718a30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:55.429052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670b1a9-f541-48e8-98f3-ccf37d718a30 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:55.436260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 650/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 2 13:39:55 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:57.671338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d562-deab-42a0-aa21-76a3e29f3c17 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:57.671955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d562-deab-42a0-aa21-76a3e29f3c17 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:57.671955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d562-deab-42a0-aa21-76a3e29f3c17 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:57.673227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 652/1302] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:57.679410 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335388a-7a46-42e1-a841-3deef5ac2732 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:57.680017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335388a-7a46-42e1-a841-3deef5ac2732 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:57.680017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335388a-7a46-42e1-a841-3deef5ac2732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:57.697718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-b335388a-7a46-42e1-a841-3deef5ac2732 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:57.699582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b335388a-7a46-42e1-a841-3deef5ac2732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:57.773795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 651/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:39:57 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:39:57.797518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853d562-deab-42a0-aa21-76a3e29f3c17 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:57.904496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:57.911414 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853d562-deab-42a0-aa21-76a3e29f3c17 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:57.947655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119ced6-22f8-41a3-872a-17b9ff5c1907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:57.948473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119ced6-22f8-41a3-872a-17b9ff5c1907 None admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:57.948757 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119ced6-22f8-41a3-872a-17b9ff5c1907 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:57.949031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119ced6-22f8-41a3-872a-17b9ff5c1907 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:57.949690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119ced6-22f8-41a3-872a-17b9ff5c1907 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:57.951091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119ced6-22f8-41a3-872a-17b9ff5c1907 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application [None req-a119ced6-22f8-41a3-872a-17b9ff5c1907 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:39:57.963554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:39:57.964799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application with Lock( Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: ERROR keystone.server.flask.application Jun 02 13:39:57.965879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 653/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 2 13:39:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:39:57.971346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335388a-7a46-42e1-a841-3deef5ac2732 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:58.053786 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:58.077378 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335388a-7a46-42e1-a841-3deef5ac2732 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:58.113170 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbb1f8-0692-42a9-8066-2df7aad09330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:58.114014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbb1f8-0692-42a9-8066-2df7aad09330 None admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:58.114479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbb1f8-0692-42a9-8066-2df7aad09330 None admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:58.114920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbb1f8-0692-42a9-8066-2df7aad09330 None admin] PATH_INFO: `/v3/services` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:58.115902 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbb1f8-0692-42a9-8066-2df7aad09330 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:58.116414 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbb1f8-0692-42a9-8066-2df7aad09330 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:58.118529 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbb1f8-0692-42a9-8066-2df7aad09330 None admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:58.127266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 652/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 2 13:39:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:58.132369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119ced6-22f8-41a3-872a-17b9ff5c1907 None admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:58.239427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119ced6-22f8-41a3-872a-17b9ff5c1907 None admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:58.274526 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2316b1-fed8-4c98-829f-71889faab400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:58.275182 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2316b1-fed8-4c98-829f-71889faab400 None admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:58.275473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2316b1-fed8-4c98-829f-71889faab400 None admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:58.275767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2316b1-fed8-4c98-829f-71889faab400 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:58.276569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2316b1-fed8-4c98-829f-71889faab400 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:58.278484 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2316b1-fed8-4c98-829f-71889faab400 None admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:58.485998 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 654/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 2 13:39:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:08.121992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=30 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:08.480445 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:50.178306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebf61b-9084-4ee8-b7b6-827d851ad25c None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:50.178891 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebf61b-9084-4ee8-b7b6-827d851ad25c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:50.178891 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebf61b-9084-4ee8-b7b6-827d851ad25c None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:50.185658 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495304e6-6ce0-4718-94a8-c6845c9c9dc1 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:50.186115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495304e6-6ce0-4718-94a8-c6845c9c9dc1 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:50.186197 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495304e6-6ce0-4718-94a8-c6845c9c9dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:50.189653 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 653/1307] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:47:50 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:47:50.279520 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-495304e6-6ce0-4718-94a8-c6845c9c9dc1 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:50.280875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-495304e6-6ce0-4718-94a8-c6845c9c9dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:50.395914 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 655/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:50.450222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f5fc4-b86d-40d0-bdf3-1034d06b4910 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:50.450519 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f5fc4-b86d-40d0-bdf3-1034d06b4910 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:50.450783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f5fc4-b86d-40d0-bdf3-1034d06b4910 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:50.452646 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 654/1309] 10.222.0.39 () {54 vars in 964 bytes} [Thu Jun 2 13:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:47:50.459843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d647aa4-c6c0-4bc2-97de-790c2ba1b995 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:50.460652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d647aa4-c6c0-4bc2-97de-790c2ba1b995 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:50.461665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d647aa4-c6c0-4bc2-97de-790c2ba1b995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:50.549190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-6d647aa4-c6c0-4bc2-97de-790c2ba1b995 None None] MFA Rules not processed for user `d95c75980e114aa488424fb115add647`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:50.550684 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6d647aa4-c6c0-4bc2-97de-790c2ba1b995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:50.574683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:50.683251 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 656/1310] 10.222.0.39 () {58 vars in 1061 bytes} [Thu Jun 2 13:47:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:50.692181 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f5fc4-b86d-40d0-bdf3-1034d06b4910 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:50.693881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-820f5fc4-b86d-40d0-bdf3-1034d06b4910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:50.816866 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f5fc4-b86d-40d0-bdf3-1034d06b4910 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:50.903282 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7ecb9-206c-4867-890d-53c477ab1cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:50.904117 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7ecb9-206c-4867-890d-53c477ab1cbd service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:50.904409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7ecb9-206c-4867-890d-53c477ab1cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:50.904684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7ecb9-206c-4867-890d-53c477ab1cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:50.906434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-98c7ecb9-206c-4867-890d-53c477ab1cbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:50.967656 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:51.022519 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7ecb9-206c-4867-890d-53c477ab1cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:51.024101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7ecb9-206c-4867-890d-53c477ab1cbd service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:51.180269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 655/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:53.755352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707595c-8334-4516-bdc5-548e36e3843b None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:53.755901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707595c-8334-4516-bdc5-548e36e3843b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:53.756021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707595c-8334-4516-bdc5-548e36e3843b None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:53.757558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 657/1312] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:47:53.763921 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e251-c84f-490e-b135-d1cc4daab714 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:53.764368 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e251-c84f-490e-b135-d1cc4daab714 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:53.764631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e251-c84f-490e-b135-d1cc4daab714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:53.839224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-e6f5e251-c84f-490e-b135-d1cc4daab714 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:53.840488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e6f5e251-c84f-490e-b135-d1cc4daab714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:53.947497 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 656/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:53.984411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707595c-8334-4516-bdc5-548e36e3843b None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:53.985996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a707595c-8334-4516-bdc5-548e36e3843b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:54.095551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707595c-8334-4516-bdc5-548e36e3843b None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:54.170507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:54.173157 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fd9b8-6eab-4869-818e-680dcb78ad4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:54.173812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fd9b8-6eab-4869-818e-680dcb78ad4d service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:54.174094 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fd9b8-6eab-4869-818e-680dcb78ad4d service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:54.174372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fd9b8-6eab-4869-818e-680dcb78ad4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:54.176048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ed0fd9b8-6eab-4869-818e-680dcb78ad4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:54.302901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fd9b8-6eab-4869-818e-680dcb78ad4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:54.305405 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fd9b8-6eab-4869-818e-680dcb78ad4d service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:54.328480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 658/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:57.124872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31f2f8-aa21-4ac6-b368-f6896ea81e4c None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:57.125409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31f2f8-aa21-4ac6-b368-f6896ea81e4c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:57.125409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31f2f8-aa21-4ac6-b368-f6896ea81e4c None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:57.126785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 657/1315] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:47:57.132354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c967c-926e-40e7-a18e-f3a4df8a1483 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:57.133672 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c967c-926e-40e7-a18e-f3a4df8a1483 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:57.133781 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c967c-926e-40e7-a18e-f3a4df8a1483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:57.197428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-dc0c967c-926e-40e7-a18e-f3a4df8a1483 None None] MFA Rules not processed for user `eca02941be074229a99a5024c4561e96`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:57.198626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-dc0c967c-926e-40e7-a18e-f3a4df8a1483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:57.250410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:57.294925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 659/1316] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:57.335051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31f2f8-aa21-4ac6-b368-f6896ea81e4c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:57.336660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-bf31f2f8-aa21-4ac6-b368-f6896ea81e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:57.346537 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:57.442854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31f2f8-aa21-4ac6-b368-f6896ea81e4c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:57.518555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ef6ff-c62f-4487-ad4d-dbb94229e647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:57.519203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ef6ff-c62f-4487-ad4d-dbb94229e647 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:57.519510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ef6ff-c62f-4487-ad4d-dbb94229e647 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:57.519789 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ef6ff-c62f-4487-ad4d-dbb94229e647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:57.521444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2b2ef6ff-c62f-4487-ad4d-dbb94229e647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:57.585936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:57.633431 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ef6ff-c62f-4487-ad4d-dbb94229e647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:57.634557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ef6ff-c62f-4487-ad4d-dbb94229e647 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:57.652995 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 658/1317] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:00.731999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f017-1463-404c-b9c4-abffd75c8f98 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:00.732558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f017-1463-404c-b9c4-abffd75c8f98 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:00.732558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f017-1463-404c-b9c4-abffd75c8f98 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:00.733929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 660/1318] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:00.739102 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4e42d-f4eb-4789-994d-a434dce98c9f None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:00.739534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4e42d-f4eb-4789-994d-a434dce98c9f None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:00.739682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4e42d-f4eb-4789-994d-a434dce98c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:00.804350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-13e4e42d-f4eb-4789-994d-a434dce98c9f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:00.805549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-13e4e42d-f4eb-4789-994d-a434dce98c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:00.900672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 659/1319] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:00.938818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6f017-1463-404c-b9c4-abffd75c8f98 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:00.940373 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6fe6f017-1463-404c-b9c4-abffd75c8f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:01.042836 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6f017-1463-404c-b9c4-abffd75c8f98 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:01.114082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af492c2a-7b0a-42f7-b3ee-be83e4266f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:01.114719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af492c2a-7b0a-42f7-b3ee-be83e4266f33 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:01.114998 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af492c2a-7b0a-42f7-b3ee-be83e4266f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:01.115270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af492c2a-7b0a-42f7-b3ee-be83e4266f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:01.116921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-af492c2a-7b0a-42f7-b3ee-be83e4266f33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:01.124229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:01.223971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af492c2a-7b0a-42f7-b3ee-be83e4266f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:01.225408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af492c2a-7b0a-42f7-b3ee-be83e4266f33 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:01.243058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 661/1320] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:04.579939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff31081-7039-4be8-ba92-47c82f723bf5 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:04.580497 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff31081-7039-4be8-ba92-47c82f723bf5 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:04.580497 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff31081-7039-4be8-ba92-47c82f723bf5 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:04.581777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 660/1321] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:04.587283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1f18-3581-484a-a281-66000ec9f8ad None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:04.587794 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1f18-3581-484a-a281-66000ec9f8ad None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:04.588040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1f18-3581-484a-a281-66000ec9f8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:04.656238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-834d1f18-3581-484a-a281-66000ec9f8ad None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:04.657427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-834d1f18-3581-484a-a281-66000ec9f8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:04.717450 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:04.756968 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 662/1322] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:04.793035 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff31081-7039-4be8-ba92-47c82f723bf5 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:04.794577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2ff31081-7039-4be8-ba92-47c82f723bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:04.814129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:04.899366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff31081-7039-4be8-ba92-47c82f723bf5 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:04.972995 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f879-c960-4b8f-969c-75d77e8aaad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:04.973645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f879-c960-4b8f-969c-75d77e8aaad5 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:04.973926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f879-c960-4b8f-969c-75d77e8aaad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:04.974200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f879-c960-4b8f-969c-75d77e8aaad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:04.975867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6fe4f879-c960-4b8f-969c-75d77e8aaad5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:05.050687 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:05.093562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4f879-c960-4b8f-969c-75d77e8aaad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:05.095025 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4f879-c960-4b8f-969c-75d77e8aaad5 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:05.114832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 661/1323] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:07.440554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cce8f-f6e2-40bd-b7b6-b64b6644dfbd None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:07.441122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cce8f-f6e2-40bd-b7b6-b64b6644dfbd None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:07.441122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cce8f-f6e2-40bd-b7b6-b64b6644dfbd None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:07.442487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 663/1324] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:07.448666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df94a7-406e-4dd8-a488-6083f6bf41f4 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:07.449181 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df94a7-406e-4dd8-a488-6083f6bf41f4 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:07.449294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df94a7-406e-4dd8-a488-6083f6bf41f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:07.516805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-17df94a7-406e-4dd8-a488-6083f6bf41f4 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:07.517910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-17df94a7-406e-4dd8-a488-6083f6bf41f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:07.620721 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 662/1325] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:07.670973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bfde8-9110-4aa5-a2aa-a37dc44ac40e None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:07.671269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bfde8-9110-4aa5-a2aa-a37dc44ac40e None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:07.671583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bfde8-9110-4aa5-a2aa-a37dc44ac40e None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:07.672990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 664/1326] 10.222.0.39 () {54 vars in 964 bytes} [Thu Jun 2 13:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:07.678888 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b46e1b-4111-4a53-80a4-365209c16198 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:07.679176 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b46e1b-4111-4a53-80a4-365209c16198 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:07.679480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b46e1b-4111-4a53-80a4-365209c16198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:07.709139 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:07.754647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-02b46e1b-4111-4a53-80a4-365209c16198 None None] MFA Rules not processed for user `d95c75980e114aa488424fb115add647`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:07.755855 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-02b46e1b-4111-4a53-80a4-365209c16198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:07.842563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 663/1327] 10.222.0.39 () {58 vars in 1061 bytes} [Thu Jun 2 13:48:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:48:07.852253 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bfde8-9110-4aa5-a2aa-a37dc44ac40e None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:07.853793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-356bfde8-9110-4aa5-a2aa-a37dc44ac40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:07.958506 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bfde8-9110-4aa5-a2aa-a37dc44ac40e None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:08.032725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc31ed8-9b4b-4da0-9d45-5c2ed06915f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:08.033370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc31ed8-9b4b-4da0-9d45-5c2ed06915f4 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:08.033653 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc31ed8-9b4b-4da0-9d45-5c2ed06915f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:08.033928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc31ed8-9b4b-4da0-9d45-5c2ed06915f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:08.035595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7cc31ed8-9b4b-4da0-9d45-5c2ed06915f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:08.052198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:08.145427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc31ed8-9b4b-4da0-9d45-5c2ed06915f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:08.146785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc31ed8-9b4b-4da0-9d45-5c2ed06915f4 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:08.165497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 665/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:10.700129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a2d41-ca84-492d-b82d-3449a894b44c None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:10.700716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a2d41-ca84-492d-b82d-3449a894b44c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:10.700716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a2d41-ca84-492d-b82d-3449a894b44c None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:10.702186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 664/1329] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:10.707338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994f405-2509-466e-82f1-3b7ae62df4ca None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:10.707798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994f405-2509-466e-82f1-3b7ae62df4ca None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:10.708039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994f405-2509-466e-82f1-3b7ae62df4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:10.774057 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-9994f405-2509-466e-82f1-3b7ae62df4ca None None] MFA Rules not processed for user `eca02941be074229a99a5024c4561e96`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:10.775239 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9994f405-2509-466e-82f1-3b7ae62df4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:10.839930 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:10.871834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 666/1330] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:10.908341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a2d41-ca84-492d-b82d-3449a894b44c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:10.909962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-304a2d41-ca84-492d-b82d-3449a894b44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:11.014588 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a2d41-ca84-492d-b82d-3449a894b44c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:11.034657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:11.089519 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf87c71-8f88-46ac-b6d3-c36cd7277bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:11.090657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf87c71-8f88-46ac-b6d3-c36cd7277bba service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:11.090657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf87c71-8f88-46ac-b6d3-c36cd7277bba service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:11.090831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf87c71-8f88-46ac-b6d3-c36cd7277bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:11.092612 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9bf87c71-8f88-46ac-b6d3-c36cd7277bba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:11.202184 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf87c71-8f88-46ac-b6d3-c36cd7277bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:11.203652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf87c71-8f88-46ac-b6d3-c36cd7277bba service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:11.221882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 665/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:14.125799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afdc26-b798-46f7-8947-b113ab1e3416 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:14.126317 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afdc26-b798-46f7-8947-b113ab1e3416 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:14.126484 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afdc26-b798-46f7-8947-b113ab1e3416 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:14.127992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 667/1332] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:14.133920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6fbec-bcd2-49d7-823a-d0385273efbb None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:14.134440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6fbec-bcd2-49d7-823a-d0385273efbb None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:14.134440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6fbec-bcd2-49d7-823a-d0385273efbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:14.201324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:14.204442 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-a1d6fbec-bcd2-49d7-823a-d0385273efbb None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:14.205667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a1d6fbec-bcd2-49d7-823a-d0385273efbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:14.309533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 666/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:14.345807 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afdc26-b798-46f7-8947-b113ab1e3416 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:14.347357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-11afdc26-b798-46f7-8947-b113ab1e3416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:14.481284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afdc26-b798-46f7-8947-b113ab1e3416 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:14.563259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dd75c-8c73-4edc-8fda-16c0ff702104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:14.563945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dd75c-8c73-4edc-8fda-16c0ff702104 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:14.564225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dd75c-8c73-4edc-8fda-16c0ff702104 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:14.564491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dd75c-8c73-4edc-8fda-16c0ff702104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:14.566137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7b2dd75c-8c73-4edc-8fda-16c0ff702104 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:14.597185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:14.682943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dd75c-8c73-4edc-8fda-16c0ff702104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:14.684416 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dd75c-8c73-4edc-8fda-16c0ff702104 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:14.705666 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 668/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:17.005343 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f3866-beea-4782-8407-4ab76315cb3c None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:17.005916 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f3866-beea-4782-8407-4ab76315cb3c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:17.005916 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f3866-beea-4782-8407-4ab76315cb3c None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:17.007292 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 667/1335] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:17.013159 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1795acf-89c6-47ee-ab9d-b8c56bca0f61 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:17.013642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1795acf-89c6-47ee-ab9d-b8c56bca0f61 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:17.013744 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1795acf-89c6-47ee-ab9d-b8c56bca0f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:17.078150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f1795acf-89c6-47ee-ab9d-b8c56bca0f61 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:17.079345 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f1795acf-89c6-47ee-ab9d-b8c56bca0f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:17.154403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:17.176223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 669/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:17.216166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f3866-beea-4782-8407-4ab76315cb3c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:17.217686 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-756f3866-beea-4782-8407-4ab76315cb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:17.322828 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f3866-beea-4782-8407-4ab76315cb3c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:17.351353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:17.396854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1164b-0028-4cfc-aba5-ebe3b3d48d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:17.397498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1164b-0028-4cfc-aba5-ebe3b3d48d7c service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:17.397776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1164b-0028-4cfc-aba5-ebe3b3d48d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:17.398050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1164b-0028-4cfc-aba5-ebe3b3d48d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:17.399739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c3e1164b-0028-4cfc-aba5-ebe3b3d48d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:17.513232 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1164b-0028-4cfc-aba5-ebe3b3d48d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:17.514629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1164b-0028-4cfc-aba5-ebe3b3d48d7c service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:17.533171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 668/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:20.391394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a33c-0eb6-4c91-9888-3a7849e16d3b None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:20.391953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a33c-0eb6-4c91-9888-3a7849e16d3b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:20.392063 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a33c-0eb6-4c91-9888-3a7849e16d3b None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:20.393431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 670/1338] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:20.398645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a092a-f6f7-4421-a7e0-56a652698157 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:20.399052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a092a-f6f7-4421-a7e0-56a652698157 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:20.399192 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a092a-f6f7-4421-a7e0-56a652698157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:20.463717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-6d1a092a-f6f7-4421-a7e0-56a652698157 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:20.464928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6d1a092a-f6f7-4421-a7e0-56a652698157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:20.473369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:20.561548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 669/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:20.597920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192a33c-0eb6-4c91-9888-3a7849e16d3b None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:20.601308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e192a33c-0eb6-4c91-9888-3a7849e16d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:20.713721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192a33c-0eb6-4c91-9888-3a7849e16d3b None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:20.717351 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1bc5-1543-4628-8ba1-1a29ab5af07a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:20.717988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1bc5-1543-4628-8ba1-1a29ab5af07a service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:20.718266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1bc5-1543-4628-8ba1-1a29ab5af07a service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:20.718540 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1bc5-1543-4628-8ba1-1a29ab5af07a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:20.720327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d40d1bc5-1543-4628-8ba1-1a29ab5af07a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:20.827193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1bc5-1543-4628-8ba1-1a29ab5af07a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:20.828567 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1bc5-1543-4628-8ba1-1a29ab5af07a service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:20.838670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:20.847642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 671/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:25.408088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44354-d617-46c5-bbf1-f1a2ed932ce8 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:25.408606 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44354-d617-46c5-bbf1-f1a2ed932ce8 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:25.408717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44354-d617-46c5-bbf1-f1a2ed932ce8 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:25.410430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 670/1341] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:25.415596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d73b3-20d2-4a6b-8ec8-acb316992968 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:25.416084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d73b3-20d2-4a6b-8ec8-acb316992968 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:25.416178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d73b3-20d2-4a6b-8ec8-acb316992968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:25.472822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-a71d73b3-20d2-4a6b-8ec8-acb316992968 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:25.474142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a71d73b3-20d2-4a6b-8ec8-acb316992968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:25.552008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 672/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:25.590762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44354-d617-46c5-bbf1-f1a2ed932ce8 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:25.593108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-60b44354-d617-46c5-bbf1-f1a2ed932ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:25.606439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44354-d617-46c5-bbf1-f1a2ed932ce8 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:25.609914 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8e9e7-9ea1-4bf8-b4f2-c8b7bd3c1077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:25.610542 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8e9e7-9ea1-4bf8-b4f2-c8b7bd3c1077 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:25.610825 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8e9e7-9ea1-4bf8-b4f2-c8b7bd3c1077 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:25.611099 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8e9e7-9ea1-4bf8-b4f2-c8b7bd3c1077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:25.620549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8e9e7-9ea1-4bf8-b4f2-c8b7bd3c1077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:25.621983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8e9e7-9ea1-4bf8-b4f2-c8b7bd3c1077 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:25.631386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 671/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:29.025948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145daa-7acc-4253-9bf6-8d52e7108270 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:29.026524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145daa-7acc-4253-9bf6-8d52e7108270 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:29.026524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145daa-7acc-4253-9bf6-8d52e7108270 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:29.028014 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 673/1344] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:29.033336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da81f9f-1f27-4bc4-a7bc-bf4855f0c713 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:29.033777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da81f9f-1f27-4bc4-a7bc-bf4855f0c713 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:29.036570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da81f9f-1f27-4bc4-a7bc-bf4855f0c713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:29.062609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-5da81f9f-1f27-4bc4-a7bc-bf4855f0c713 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:29.063834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-5da81f9f-1f27-4bc4-a7bc-bf4855f0c713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:29.071750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 672/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:29.109295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66145daa-7acc-4253-9bf6-8d52e7108270 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:29.120523 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66145daa-7acc-4253-9bf6-8d52e7108270 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:29.124325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07c637-9642-4b7d-a006-e679d90f7688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:29.124966 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c637-9642-4b7d-a006-e679d90f7688 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:29.125249 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c637-9642-4b7d-a006-e679d90f7688 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:29.125527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c637-9642-4b7d-a006-e679d90f7688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:29.135312 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07c637-9642-4b7d-a006-e679d90f7688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:29.136792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07c637-9642-4b7d-a006-e679d90f7688 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:29.146622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 674/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:33.807630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54de2db-6765-4644-9975-130316d65534 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:33.808190 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54de2db-6765-4644-9975-130316d65534 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:33.808190 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54de2db-6765-4644-9975-130316d65534 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:33.809574 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 673/1347] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:33.814965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9698700-cfc4-40b0-9165-e935d7620cb0 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:33.815381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9698700-cfc4-40b0-9165-e935d7620cb0 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:33.815627 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9698700-cfc4-40b0-9165-e935d7620cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:33.834315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f9698700-cfc4-40b0-9165-e935d7620cb0 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:33.835525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f9698700-cfc4-40b0-9165-e935d7620cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:33.843294 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 675/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:33.881017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54de2db-6765-4644-9975-130316d65534 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:33.892816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54de2db-6765-4644-9975-130316d65534 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:33.896402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0c249-ac39-4e28-91a3-808145fd01a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:33.897059 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0c249-ac39-4e28-91a3-808145fd01a4 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:33.897339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0c249-ac39-4e28-91a3-808145fd01a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:33.897613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0c249-ac39-4e28-91a3-808145fd01a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:33.907490 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0c249-ac39-4e28-91a3-808145fd01a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:33.908982 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0c249-ac39-4e28-91a3-808145fd01a4 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:33.918433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 674/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:39.442865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b28edf-1289-4849-8ca2-d254445c9208 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:39.443845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b28edf-1289-4849-8ca2-d254445c9208 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:39.444295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b28edf-1289-4849-8ca2-d254445c9208 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:39.446404 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 676/1350] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 2 13:48:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:39.451674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eae143-7b29-45d0-948c-63b122219619 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:39.452106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eae143-7b29-45d0-948c-63b122219619 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:39.452220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eae143-7b29-45d0-948c-63b122219619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:39.533767 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-e2eae143-7b29-45d0-948c-63b122219619 None None] MFA Rules not processed for user `b387ad13a6c843d0b9a43bc8f5f7fa13`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:39.535247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e2eae143-7b29-45d0-948c-63b122219619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:39.587948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:39.646166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 675/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 2 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:43.828958 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=56 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:43.972170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dc737-f11a-48cc-97a7-c771d889fe8f None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:43.972658 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dc737-f11a-48cc-97a7-c771d889fe8f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:43.973051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dc737-f11a-48cc-97a7-c771d889fe8f None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:43.975022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 677/1352] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 2 13:48:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:43.979920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c8eef-808f-4e07-995e-d380c46d4f56 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:43.980394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c8eef-808f-4e07-995e-d380c46d4f56 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:43.980661 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c8eef-808f-4e07-995e-d380c46d4f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:43.999436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-635c8eef-808f-4e07-995e-d380c46d4f56 None None] MFA Rules not processed for user `b387ad13a6c843d0b9a43bc8f5f7fa13`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:44.000674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-635c8eef-808f-4e07-995e-d380c46d4f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:44.010306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 676/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 2 13:48:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:45.631199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e750acf-e68b-4c93-b419-c33aa49f0825 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:45.631734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e750acf-e68b-4c93-b419-c33aa49f0825 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:45.631734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e750acf-e68b-4c93-b419-c33aa49f0825 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:45.633057 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 678/1354] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 2 13:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:45.638280 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a035620-b4b5-41eb-a45a-5d3329777efe None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:45.638680 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a035620-b4b5-41eb-a45a-5d3329777efe None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:45.638948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a035620-b4b5-41eb-a45a-5d3329777efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:45.658195 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-0a035620-b4b5-41eb-a45a-5d3329777efe None None] MFA Rules not processed for user `b387ad13a6c843d0b9a43bc8f5f7fa13`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:45.659487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-0a035620-b4b5-41eb-a45a-5d3329777efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:45.668973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 677/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 2 13:48:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:48:49.473689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcbb6b-de0a-4a5d-9cff-12cb12c4bf47 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:49.474254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcbb6b-de0a-4a5d-9cff-12cb12c4bf47 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:49.474254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcbb6b-de0a-4a5d-9cff-12cb12c4bf47 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:49.475818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 679/1356] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:49.480926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bdff9-80ae-474a-9ded-75f3e54756da None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:49.481331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bdff9-80ae-474a-9ded-75f3e54756da None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:49.481493 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bdff9-80ae-474a-9ded-75f3e54756da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:49.500030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-819bdff9-80ae-474a-9ded-75f3e54756da None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:49.501430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-819bdff9-80ae-474a-9ded-75f3e54756da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:49.509763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 678/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:49.571492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f9e90-bee9-444a-b9e6-38d162f0363a None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:49.576186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f9e90-bee9-444a-b9e6-38d162f0363a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:49.576186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f9e90-bee9-444a-b9e6-38d162f0363a None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:49.576186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 680/1358] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 2 13:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:49.588773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0077a-2d33-40f4-952c-3d4c4398a74c None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:49.589070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0077a-2d33-40f4-952c-3d4c4398a74c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:49.589351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0077a-2d33-40f4-952c-3d4c4398a74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:49.663950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-b9e0077a-2d33-40f4-952c-3d4c4398a74c None None] MFA Rules not processed for user `b9971f2bf0f2400b90168f6032a0e226`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:49.665867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b9e0077a-2d33-40f4-952c-3d4c4398a74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:49.754927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 679/1359] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 2 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:49.763359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f9e90-bee9-444a-b9e6-38d162f0363a None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:49.778042 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f9e90-bee9-444a-b9e6-38d162f0363a None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:49.783513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424c25c-7475-4592-983c-fa04bf42b2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:49.784143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424c25c-7475-4592-983c-fa04bf42b2bb service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:49.784424 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424c25c-7475-4592-983c-fa04bf42b2bb service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:49.784893 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424c25c-7475-4592-983c-fa04bf42b2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:49.794238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424c25c-7475-4592-983c-fa04bf42b2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:49.795925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424c25c-7475-4592-983c-fa04bf42b2bb service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:49.806078 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 681/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:52.280517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40dec1-55e9-44ba-a7fe-7e8792dbb10c None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:52.281037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40dec1-55e9-44ba-a7fe-7e8792dbb10c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:52.281122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40dec1-55e9-44ba-a7fe-7e8792dbb10c None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:52.282619 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 680/1361] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:52.287681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9a6e0-64f1-4ab3-bddd-1a9051c24751 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:52.288089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9a6e0-64f1-4ab3-bddd-1a9051c24751 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:52.288242 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9a6e0-64f1-4ab3-bddd-1a9051c24751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:52.306839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-49f9a6e0-64f1-4ab3-bddd-1a9051c24751 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:52.308291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-49f9a6e0-64f1-4ab3-bddd-1a9051c24751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:52.316267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 682/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:52.363069 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40dec1-55e9-44ba-a7fe-7e8792dbb10c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:52.377828 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40dec1-55e9-44ba-a7fe-7e8792dbb10c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:52.384459 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b10195-b3f8-4e09-b078-4b48af705dc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:52.385249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b10195-b3f8-4e09-b078-4b48af705dc4 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:52.385649 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b10195-b3f8-4e09-b078-4b48af705dc4 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:52.386053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b10195-b3f8-4e09-b078-4b48af705dc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:52.395286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b10195-b3f8-4e09-b078-4b48af705dc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:52.396917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b10195-b3f8-4e09-b078-4b48af705dc4 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:52.407584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 681/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:55.176317 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e129e82-7564-41b5-8da3-4009ee259fcb None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:55.177279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e129e82-7564-41b5-8da3-4009ee259fcb None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:55.177789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e129e82-7564-41b5-8da3-4009ee259fcb None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:55.179748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 683/1364] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:55.185557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec62b15-1c50-4101-a326-e6abb0656d0d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:55.186023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec62b15-1c50-4101-a326-e6abb0656d0d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:55.186121 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec62b15-1c50-4101-a326-e6abb0656d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:55.204543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-1ec62b15-1c50-4101-a326-e6abb0656d0d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:55.205655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1ec62b15-1c50-4101-a326-e6abb0656d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:55.214121 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 682/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:55.260149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c4945-e658-44a5-bcfb-1eafcb60bc49 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:55.260431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c4945-e658-44a5-bcfb-1eafcb60bc49 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:55.260874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c4945-e658-44a5-bcfb-1eafcb60bc49 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:55.262433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 684/1366] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 2 13:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:55.267998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a970c-a3d8-495c-9cb0-ce5e8ba104a1 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:55.268289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a970c-a3d8-495c-9cb0-ce5e8ba104a1 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:55.268568 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a970c-a3d8-495c-9cb0-ce5e8ba104a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:55.287610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-0a0a970c-a3d8-495c-9cb0-ce5e8ba104a1 None None] MFA Rules not processed for user `b9971f2bf0f2400b90168f6032a0e226`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:55.288779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-0a0a970c-a3d8-495c-9cb0-ce5e8ba104a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:55.298890 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 683/1367] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 2 13:48:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:55.308119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c4945-e658-44a5-bcfb-1eafcb60bc49 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:55.322266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c4945-e658-44a5-bcfb-1eafcb60bc49 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:55.327783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744d131-50d4-4364-840f-202b2d6eb027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:55.328412 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744d131-50d4-4364-840f-202b2d6eb027 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:55.328696 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744d131-50d4-4364-840f-202b2d6eb027 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:55.328973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744d131-50d4-4364-840f-202b2d6eb027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:55.337062 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744d131-50d4-4364-840f-202b2d6eb027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:55.338742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744d131-50d4-4364-840f-202b2d6eb027 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:55.347975 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 685/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:57.827240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e96f57-f3e6-41d5-b1cc-44202eb3c6c2 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:57.827855 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e96f57-f3e6-41d5-b1cc-44202eb3c6c2 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:57.827855 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e96f57-f3e6-41d5-b1cc-44202eb3c6c2 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:57.829287 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 684/1369] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:57.835321 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5464a83-4470-4f77-b63d-92ce0ecc5bca None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:57.835872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5464a83-4470-4f77-b63d-92ce0ecc5bca None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:57.835983 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5464a83-4470-4f77-b63d-92ce0ecc5bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:57.857571 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-d5464a83-4470-4f77-b63d-92ce0ecc5bca None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:57.858974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d5464a83-4470-4f77-b63d-92ce0ecc5bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:57.867785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 686/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:48:57.905364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88af03c-7fbd-42bb-a25e-6d0b6abdfa95 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:57.905794 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88af03c-7fbd-42bb-a25e-6d0b6abdfa95 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:57.906275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88af03c-7fbd-42bb-a25e-6d0b6abdfa95 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:57.907802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 685/1371] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:57.912230 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5464a83-4470-4f77-b63d-92ce0ecc5bca None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:57.916160 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04a662-dbe3-4a7b-b8c3-b89ba53261d0 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:57.916647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04a662-dbe3-4a7b-b8c3-b89ba53261d0 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:57.916928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04a662-dbe3-4a7b-b8c3-b89ba53261d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:57.925391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5464a83-4470-4f77-b63d-92ce0ecc5bca None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:57.931602 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeabb94-dd8f-4102-8c26-7e6b295caabb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:57.932253 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeabb94-dd8f-4102-8c26-7e6b295caabb service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:57.932536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeabb94-dd8f-4102-8c26-7e6b295caabb service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:57.932812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeabb94-dd8f-4102-8c26-7e6b295caabb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:57.936068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ab04a662-dbe3-4a7b-b8c3-b89ba53261d0 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:57.937374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ab04a662-dbe3-4a7b-b8c3-b89ba53261d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:57.941675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeabb94-dd8f-4102-8c26-7e6b295caabb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:57.943260 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeabb94-dd8f-4102-8c26-7e6b295caabb service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:57.947920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 686/1372] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:48:57.953138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 687/1373] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:58.264503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363a087-414b-4827-a288-3b6bb8f81ffe None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:58.264503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363a087-414b-4827-a288-3b6bb8f81ffe None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:58.267323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363a087-414b-4827-a288-3b6bb8f81ffe None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:58.267323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 687/1374] 10.222.0.39 () {54 vars in 963 bytes} [Thu Jun 2 13:48:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:48:58.272613 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32fdf0-daad-470f-a586-b48983cf7543 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:58.275488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32fdf0-daad-470f-a586-b48983cf7543 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:58.276115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32fdf0-daad-470f-a586-b48983cf7543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:58.334207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-1e32fdf0-daad-470f-a586-b48983cf7543 None None] MFA Rules not processed for user `7e91db8d261d4d458b695abc4e0ab28e`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:48:58.335417 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1e32fdf0-daad-470f-a586-b48983cf7543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:58.406223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 688/1375] 10.222.0.39 () {58 vars in 1060 bytes} [Thu Jun 2 13:48:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:48:58.413802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363a087-414b-4827-a288-3b6bb8f81ffe None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:58.429245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363a087-414b-4827-a288-3b6bb8f81ffe None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:58.433363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a90de-30ff-4c9a-ad94-8c2fa267580b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:58.434173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a90de-30ff-4c9a-ad94-8c2fa267580b service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:58.434562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a90de-30ff-4c9a-ad94-8c2fa267580b service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:58.434966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a90de-30ff-4c9a-ad94-8c2fa267580b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:58.447161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a90de-30ff-4c9a-ad94-8c2fa267580b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:58.449044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a90de-30ff-4c9a-ad94-8c2fa267580b service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:58.464137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 688/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:00.453929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b920e97-6e69-46a5-8bdc-543d045c7d8d None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:00.454508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b920e97-6e69-46a5-8bdc-543d045c7d8d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:00.454508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b920e97-6e69-46a5-8bdc-543d045c7d8d None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:00.455897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 689/1377] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:00.461638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4862c-53a9-47d7-acb1-11458e28db24 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:00.462147 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4862c-53a9-47d7-acb1-11458e28db24 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:00.462284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4862c-53a9-47d7-acb1-11458e28db24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:00.480788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-b7f4862c-53a9-47d7-acb1-11458e28db24 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:00.482013 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b7f4862c-53a9-47d7-acb1-11458e28db24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:00.489948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 689/1378] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:00.535036 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b920e97-6e69-46a5-8bdc-543d045c7d8d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:00.550576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b920e97-6e69-46a5-8bdc-543d045c7d8d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:00.556787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfe470-8b05-4944-ac21-6dd1fd4147a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:00.557434 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe470-8b05-4944-ac21-6dd1fd4147a4 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:00.557717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe470-8b05-4944-ac21-6dd1fd4147a4 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:00.557995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe470-8b05-4944-ac21-6dd1fd4147a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:00.566659 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfe470-8b05-4944-ac21-6dd1fd4147a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:00.568297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfe470-8b05-4944-ac21-6dd1fd4147a4 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:00.577917 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 690/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:02.959377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8aea7-4a68-42d2-9c06-e1cef175cc2a None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:02.960292 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8aea7-4a68-42d2-9c06-e1cef175cc2a None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:02.960717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8aea7-4a68-42d2-9c06-e1cef175cc2a None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:02.968391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947218fc-b800-4436-a9aa-4ad014138e4f None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:02.969206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947218fc-b800-4436-a9aa-4ad014138e4f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:02.969633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947218fc-b800-4436-a9aa-4ad014138e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:02.971107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 690/1380] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:49:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:02.987772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-947218fc-b800-4436-a9aa-4ad014138e4f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:02.989203 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-947218fc-b800-4436-a9aa-4ad014138e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:02.998119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 691/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:03.041875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8aea7-4a68-42d2-9c06-e1cef175cc2a None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:03.057318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8aea7-4a68-42d2-9c06-e1cef175cc2a None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:03.062786 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa40a7-c8eb-4092-8ea0-b78c9f0833aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:03.063470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa40a7-c8eb-4092-8ea0-b78c9f0833aa service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:03.063762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa40a7-c8eb-4092-8ea0-b78c9f0833aa service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:03.064089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa40a7-c8eb-4092-8ea0-b78c9f0833aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:03.073194 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa40a7-c8eb-4092-8ea0-b78c9f0833aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:03.074773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa40a7-c8eb-4092-8ea0-b78c9f0833aa service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:03.085464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 691/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:05.538361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf99e0-6ac4-426a-8420-3d2e6cad1f2c None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:05.538936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf99e0-6ac4-426a-8420-3d2e6cad1f2c None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:05.538936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf99e0-6ac4-426a-8420-3d2e6cad1f2c None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:05.540295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 692/1383] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:05.546409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2a7b4-97f2-4071-a72e-29752de487da None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:05.546987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2a7b4-97f2-4071-a72e-29752de487da None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:05.546987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2a7b4-97f2-4071-a72e-29752de487da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:05.554654 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:49:05.584019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-e0e2a7b4-97f2-4071-a72e-29752de487da None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:05.585388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e0e2a7b4-97f2-4071-a72e-29752de487da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:05.595119 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 692/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:05.637997 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf99e0-6ac4-426a-8420-3d2e6cad1f2c None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:05.653162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf99e0-6ac4-426a-8420-3d2e6cad1f2c None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:05.658480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c002b9-e3b7-4037-8a74-aaa4f45353ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:05.659112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c002b9-e3b7-4037-8a74-aaa4f45353ce service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:05.659390 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c002b9-e3b7-4037-8a74-aaa4f45353ce service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:05.659704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c002b9-e3b7-4037-8a74-aaa4f45353ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:05.668941 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c002b9-e3b7-4037-8a74-aaa4f45353ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:05.670518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c002b9-e3b7-4037-8a74-aaa4f45353ce service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:05.681461 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 693/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:07.965429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b149d10-b13c-4b8b-98cd-a44e913cd938 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:07.966078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b149d10-b13c-4b8b-98cd-a44e913cd938 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:07.966078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b149d10-b13c-4b8b-98cd-a44e913cd938 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:07.967763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 693/1386] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:07.973440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5bbe2-c981-43c3-b7ac-50f10b4b23c1 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:07.974020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5bbe2-c981-43c3-b7ac-50f10b4b23c1 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:07.974020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5bbe2-c981-43c3-b7ac-50f10b4b23c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:07.992248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-93c5bbe2-c981-43c3-b7ac-50f10b4b23c1 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:07.993497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-93c5bbe2-c981-43c3-b7ac-50f10b4b23c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:08.001641 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 694/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:08.050075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b149d10-b13c-4b8b-98cd-a44e913cd938 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:08.064723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b149d10-b13c-4b8b-98cd-a44e913cd938 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:08.070358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77da78b-ffd9-4d22-bd1c-91ca34490122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:08.071614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77da78b-ffd9-4d22-bd1c-91ca34490122 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:08.071792 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77da78b-ffd9-4d22-bd1c-91ca34490122 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:08.072064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77da78b-ffd9-4d22-bd1c-91ca34490122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:08.080761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77da78b-ffd9-4d22-bd1c-91ca34490122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:08.082408 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77da78b-ffd9-4d22-bd1c-91ca34490122 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:08.093688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 694/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:10.601507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59359a-98ee-4360-9646-4dd987a5b857 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:10.602036 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59359a-98ee-4360-9646-4dd987a5b857 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:10.602036 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59359a-98ee-4360-9646-4dd987a5b857 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:10.604020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 695/1389] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:10.610303 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870c91c-714a-4fab-9688-bd7eaeb29520 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:10.610775 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870c91c-714a-4fab-9688-bd7eaeb29520 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:10.610989 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870c91c-714a-4fab-9688-bd7eaeb29520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:10.629236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-3870c91c-714a-4fab-9688-bd7eaeb29520 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:10.630451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3870c91c-714a-4fab-9688-bd7eaeb29520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:10.639224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 695/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:10.684243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59359a-98ee-4360-9646-4dd987a5b857 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:10.701483 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59359a-98ee-4360-9646-4dd987a5b857 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:10.707428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bb972-af66-4af3-9124-8e59ae656c90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:10.708111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bb972-af66-4af3-9124-8e59ae656c90 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:10.708399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bb972-af66-4af3-9124-8e59ae656c90 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:10.708670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bb972-af66-4af3-9124-8e59ae656c90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:10.718016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bb972-af66-4af3-9124-8e59ae656c90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:10.719676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bb972-af66-4af3-9124-8e59ae656c90 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:10.730007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 696/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:13.131841 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a735-397e-46b1-aa1f-93323c3f92db None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:13.132614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a735-397e-46b1-aa1f-93323c3f92db None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:13.132614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a735-397e-46b1-aa1f-93323c3f92db None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:13.133841 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 696/1392] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:49:13.139421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb701-dfe8-4754-804c-9cef5e15f682 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:13.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb701-dfe8-4754-804c-9cef5e15f682 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:13.139962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb701-dfe8-4754-804c-9cef5e15f682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:13.158564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-811bb701-dfe8-4754-804c-9cef5e15f682 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:13.159811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-811bb701-dfe8-4754-804c-9cef5e15f682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:13.169342 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 697/1393] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:13.213836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9a735-397e-46b1-aa1f-93323c3f92db None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:13.228964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9a735-397e-46b1-aa1f-93323c3f92db None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:13.234281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b10ee-15cf-48f6-96b7-b5c1c9014a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:13.234911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b10ee-15cf-48f6-96b7-b5c1c9014a0d service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:13.235191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b10ee-15cf-48f6-96b7-b5c1c9014a0d service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:13.235541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b10ee-15cf-48f6-96b7-b5c1c9014a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:13.244459 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b10ee-15cf-48f6-96b7-b5c1c9014a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:13.246038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b10ee-15cf-48f6-96b7-b5c1c9014a0d service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:13.255560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 697/1394] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:15.333348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd6549-48fe-46b0-9984-01eccc625d50 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:15.333926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd6549-48fe-46b0-9984-01eccc625d50 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:15.333926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd6549-48fe-46b0-9984-01eccc625d50 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:15.335319 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 698/1395] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:15.341227 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680dd33-4f3f-4244-819b-8a59a9fe678a None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:15.341663 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680dd33-4f3f-4244-819b-8a59a9fe678a None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:15.341784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680dd33-4f3f-4244-819b-8a59a9fe678a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:15.359920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-2680dd33-4f3f-4244-819b-8a59a9fe678a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:15.361108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2680dd33-4f3f-4244-819b-8a59a9fe678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:15.369817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 698/1396] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:15.426649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d072a-4948-427e-b985-1fe4d1416ad6 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:15.430166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d072a-4948-427e-b985-1fe4d1416ad6 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:15.430166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d072a-4948-427e-b985-1fe4d1416ad6 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:15.430166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 699/1397] 10.222.0.39 () {54 vars in 962 bytes} [Thu Jun 2 13:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:15.433935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0de284-db3f-41af-856c-6af50c2df154 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:15.434298 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0de284-db3f-41af-856c-6af50c2df154 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:15.434648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0de284-db3f-41af-856c-6af50c2df154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:15.483805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-7c0de284-db3f-41af-856c-6af50c2df154 None None] MFA Rules not processed for user `be4de0fa80784de1acfcd47a2b77d9ac`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:15.485281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-7c0de284-db3f-41af-856c-6af50c2df154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:15.545987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 699/1398] 10.222.0.39 () {58 vars in 1059 bytes} [Thu Jun 2 13:49:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:15.553390 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d072a-4948-427e-b985-1fe4d1416ad6 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:15.558706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=90 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:49:15.564502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d072a-4948-427e-b985-1fe4d1416ad6 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:15.568353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40286e19-161a-4506-971b-55190f4e1792 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be4de0fa80784de1acfcd47a2b77d9ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:15.568996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40286e19-161a-4506-971b-55190f4e1792 service glance] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:15.569281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40286e19-161a-4506-971b-55190f4e1792 service glance] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:15.569560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40286e19-161a-4506-971b-55190f4e1792 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:15.579295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40286e19-161a-4506-971b-55190f4e1792 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:15.580765 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40286e19-161a-4506-971b-55190f4e1792 service glance] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:15.591536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 700/1399] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:15.635971 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48da74-7687-4529-bcd1-68c72f7c6d0d None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:15.636257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48da74-7687-4529-bcd1-68c72f7c6d0d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:15.636533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48da74-7687-4529-bcd1-68c72f7c6d0d None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:15.637931 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 700/1400] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:15.643400 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d951d4-1915-44f1-b68d-0a2884d00f75 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:15.643719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d951d4-1915-44f1-b68d-0a2884d00f75 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:15.643999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d951d4-1915-44f1-b68d-0a2884d00f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:15.662082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f3d951d4-1915-44f1-b68d-0a2884d00f75 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:15.663238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f3d951d4-1915-44f1-b68d-0a2884d00f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:15.670961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 701/1401] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:15.715362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48da74-7687-4529-bcd1-68c72f7c6d0d None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:15.729707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48da74-7687-4529-bcd1-68c72f7c6d0d None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:15.735226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471f126-e7c8-479c-a513-7afc872eec3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:15.735893 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471f126-e7c8-479c-a513-7afc872eec3c service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:15.736179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471f126-e7c8-479c-a513-7afc872eec3c service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:15.736456 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471f126-e7c8-479c-a513-7afc872eec3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:15.745399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471f126-e7c8-479c-a513-7afc872eec3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:15.747028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471f126-e7c8-479c-a513-7afc872eec3c service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:15.756732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 701/1402] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:16.247050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcff686-b627-4b65-aba8-1bc9f515ef1e None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:16.247365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcff686-b627-4b65-aba8-1bc9f515ef1e None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:16.247645 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcff686-b627-4b65-aba8-1bc9f515ef1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:16.303379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-8dcff686-b627-4b65-aba8-1bc9f515ef1e None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:16.304587 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8dcff686-b627-4b65-aba8-1bc9f515ef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:16.368804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 702/1403] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 13:49:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:16.413875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a723f-b487-4d46-b567-b3ab9e9a6f7c None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:16.414490 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a723f-b487-4d46-b567-b3ab9e9a6f7c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:16.414490 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a723f-b487-4d46-b567-b3ab9e9a6f7c None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:16.416610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 702/1404] 10.222.0.39 () {54 vars in 942 bytes} [Thu Jun 2 13:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:16.423236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c09e3-f46c-498d-a615-b77153fb6f8d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:16.423638 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c09e3-f46c-498d-a615-b77153fb6f8d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:16.423944 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c09e3-f46c-498d-a615-b77153fb6f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:16.474387 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-200c09e3-f46c-498d-a615-b77153fb6f8d None None] MFA Rules not processed for user `00f3424dc2ee4f828638b3a8f5c9fc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:16.475616 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-200c09e3-f46c-498d-a615-b77153fb6f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:16.549279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 703/1405] 10.222.0.39 () {58 vars in 1039 bytes} [Thu Jun 2 13:49:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:16.558577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a723f-b487-4d46-b567-b3ab9e9a6f7c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:16.571824 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a723f-b487-4d46-b567-b3ab9e9a6f7c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:16.576669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65adbc-60f9-483e-849a-cc309387cd01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:16.577305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65adbc-60f9-483e-849a-cc309387cd01 service swift] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:16.577587 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65adbc-60f9-483e-849a-cc309387cd01 service swift] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:16.577862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65adbc-60f9-483e-849a-cc309387cd01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:16.585754 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65adbc-60f9-483e-849a-cc309387cd01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:16.587903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65adbc-60f9-483e-849a-cc309387cd01 service swift] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:16.595844 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 703/1406] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 13:49:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:49:18.208829 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6adea-5234-48e2-924e-ba1b77a7297c None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:18.209375 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6adea-5234-48e2-924e-ba1b77a7297c None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:18.209375 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6adea-5234-48e2-924e-ba1b77a7297c None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:18.210759 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 704/1407] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:18.216644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e3745-d31a-45f8-a8a8-e83dfebff245 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:18.217091 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e3745-d31a-45f8-a8a8-e83dfebff245 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:18.217337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e3745-d31a-45f8-a8a8-e83dfebff245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:18.239839 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-f07e3745-d31a-45f8-a8a8-e83dfebff245 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:18.241059 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f07e3745-d31a-45f8-a8a8-e83dfebff245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:18.249359 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 704/1408] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:18.295678 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6adea-5234-48e2-924e-ba1b77a7297c None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:18.313369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6adea-5234-48e2-924e-ba1b77a7297c None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:18.319146 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13aaafd-72da-45cb-9193-a3c9e21eaa12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:18.319989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aaafd-72da-45cb-9193-a3c9e21eaa12 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:18.320269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aaafd-72da-45cb-9193-a3c9e21eaa12 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:18.320550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aaafd-72da-45cb-9193-a3c9e21eaa12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:18.330138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13aaafd-72da-45cb-9193-a3c9e21eaa12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:18.331772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13aaafd-72da-45cb-9193-a3c9e21eaa12 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:18.343686 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 705/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:28.232963 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=72 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:49:28.339276 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=98 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:49:40.956691 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed41ed3-8181-41e9-871d-94b558175e92 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:40.957350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed41ed3-8181-41e9-871d-94b558175e92 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:40.957350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed41ed3-8181-41e9-871d-94b558175e92 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:40.958626 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 705/1410] 10.222.0.39 () {54 vars in 918 bytes} [Thu Jun 2 13:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:40.964362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb597d-9639-455a-bce2-0c8f731bd2eb None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:40.964835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb597d-9639-455a-bce2-0c8f731bd2eb None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:40.964945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb597d-9639-455a-bce2-0c8f731bd2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:40.982611 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-8beb597d-9639-455a-bce2-0c8f731bd2eb None None] MFA Rules not processed for user `b387ad13a6c843d0b9a43bc8f5f7fa13`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:40.983823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8beb597d-9639-455a-bce2-0c8f731bd2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:40.992537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 706/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jun 2 13:49:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:41.006455 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fc054-3dca-4492-8a42-1652a7f3502f None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:41.006744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fc054-3dca-4492-8a42-1652a7f3502f None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:41.007023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fc054-3dca-4492-8a42-1652a7f3502f None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:41.008430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 706/1412] 10.222.0.39 () {54 vars in 918 bytes} [Thu Jun 2 13:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:41.013682 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b034c-b835-4257-9001-ee747d4817b0 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:41.013968 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b034c-b835-4257-9001-ee747d4817b0 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:41.014244 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b034c-b835-4257-9001-ee747d4817b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:41.032053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-a11b034c-b835-4257-9001-ee747d4817b0 None None] MFA Rules not processed for user `b9971f2bf0f2400b90168f6032a0e226`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:41.033199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a11b034c-b835-4257-9001-ee747d4817b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:41.042116 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 707/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jun 2 13:49:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:43.733797 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629a480-eacb-412f-85d3-018ddfb295f2 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:43.734378 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629a480-eacb-412f-85d3-018ddfb295f2 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:43.734378 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629a480-eacb-412f-85d3-018ddfb295f2 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:43.735730 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:43.740870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d228fb-0ad4-4ab4-a88b-7c0cb2deec0e None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:43.741291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d228fb-0ad4-4ab4-a88b-7c0cb2deec0e None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:43.741433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d228fb-0ad4-4ab4-a88b-7c0cb2deec0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:43.758749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-94d228fb-0ad4-4ab4-a88b-7c0cb2deec0e None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:43.760242 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-94d228fb-0ad4-4ab4-a88b-7c0cb2deec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:43.767925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:43.810686 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629a480-eacb-412f-85d3-018ddfb295f2 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:43.825250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629a480-eacb-412f-85d3-018ddfb295f2 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:43.830866 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d9abc-3558-4248-8338-4c0e27a392e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:43.831284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d9abc-3558-4248-8338-4c0e27a392e7 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:43.831605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d9abc-3558-4248-8338-4c0e27a392e7 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:43.831885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d9abc-3558-4248-8338-4c0e27a392e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:43.840430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d9abc-3558-4248-8338-4c0e27a392e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:43.842066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d9abc-3558-4248-8338-4c0e27a392e7 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:43.851471 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 708/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:44.822976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c85bf2-dcd2-4306-8363-51af3dc2bcce None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:44.823591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c85bf2-dcd2-4306-8363-51af3dc2bcce None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:44.823591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c85bf2-dcd2-4306-8363-51af3dc2bcce None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:44.824932 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:44.829841 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2727cf9-3708-459d-a388-54c4c8d2f374 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:44.830266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2727cf9-3708-459d-a388-54c4c8d2f374 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:44.830401 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2727cf9-3708-459d-a388-54c4c8d2f374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:44.848244 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d2727cf9-3708-459d-a388-54c4c8d2f374 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:44.849430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d2727cf9-3708-459d-a388-54c4c8d2f374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:44.857682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:45.025339 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c85bf2-dcd2-4306-8363-51af3dc2bcce None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:45.039137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c85bf2-dcd2-4306-8363-51af3dc2bcce None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:45.045181 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4e0e7-9376-46ba-89b0-3ea0055ef8eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:45.045803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4e0e7-9376-46ba-89b0-3ea0055ef8eb service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:45.047385 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4e0e7-9376-46ba-89b0-3ea0055ef8eb service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:45.047385 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4e0e7-9376-46ba-89b0-3ea0055ef8eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:45.054216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4e0e7-9376-46ba-89b0-3ea0055ef8eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:45.055821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4e0e7-9376-46ba-89b0-3ea0055ef8eb service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:45.065117 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 710/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:45.991972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55354b74-2db7-4e8e-b79b-7dca6b2473a8 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:45.992548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55354b74-2db7-4e8e-b79b-7dca6b2473a8 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:45.992548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55354b74-2db7-4e8e-b79b-7dca6b2473a8 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:45.993985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:45.999031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b02e-17cd-4659-b870-e4a7d64ba0e8 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:45.999434 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b02e-17cd-4659-b870-e4a7d64ba0e8 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:45.999647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b02e-17cd-4659-b870-e4a7d64ba0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:46.017566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-21b6b02e-17cd-4659-b870-e4a7d64ba0e8 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:46.018748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-21b6b02e-17cd-4659-b870-e4a7d64ba0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:46.026997 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:46.176593 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55354b74-2db7-4e8e-b79b-7dca6b2473a8 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:46.190576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55354b74-2db7-4e8e-b79b-7dca6b2473a8 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:46.195946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fea91-49f9-4f64-9786-d1c3c8561edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:46.197080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fea91-49f9-4f64-9786-d1c3c8561edc service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:46.197362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fea91-49f9-4f64-9786-d1c3c8561edc service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:46.197638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fea91-49f9-4f64-9786-d1c3c8561edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:46.205720 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fea91-49f9-4f64-9786-d1c3c8561edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:46.207304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fea91-49f9-4f64-9786-d1c3c8561edc service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:46.217330 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 711/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:47.117219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998036d4-7d95-4cb0-886d-06c5926e8593 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:47.117759 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998036d4-7d95-4cb0-886d-06c5926e8593 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:47.117759 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998036d4-7d95-4cb0-886d-06c5926e8593 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:47.119121 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:47.124149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76c27a-ad7e-44b6-a72c-ce32bd6dcd09 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:47.124616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76c27a-ad7e-44b6-a72c-ce32bd6dcd09 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:47.124713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76c27a-ad7e-44b6-a72c-ce32bd6dcd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:47.143164 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-8e76c27a-ad7e-44b6-a72c-ce32bd6dcd09 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:47.144381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8e76c27a-ad7e-44b6-a72c-ce32bd6dcd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:47.152655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:47.301272 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998036d4-7d95-4cb0-886d-06c5926e8593 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:47.315887 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998036d4-7d95-4cb0-886d-06c5926e8593 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:47.321236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a42a-c914-4976-b41c-4c3fbbdc17f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:47.323112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a42a-c914-4976-b41c-4c3fbbdc17f8 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:47.323400 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a42a-c914-4976-b41c-4c3fbbdc17f8 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:47.323711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a42a-c914-4976-b41c-4c3fbbdc17f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:47.331783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2a42a-c914-4976-b41c-4c3fbbdc17f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:47.333364 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2a42a-c914-4976-b41c-4c3fbbdc17f8 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:47.343308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 713/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:48.253117 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daa357-db22-4e2c-aab1-333138e927bf None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:48.253761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daa357-db22-4e2c-aab1-333138e927bf None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:48.253761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daa357-db22-4e2c-aab1-333138e927bf None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:48.255085 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:48.260505 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad17fde-78eb-417e-be21-0b0b7c5c685f None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:48.260926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad17fde-78eb-417e-be21-0b0b7c5c685f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:48.261060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad17fde-78eb-417e-be21-0b0b7c5c685f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:48.279199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-fad17fde-78eb-417e-be21-0b0b7c5c685f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:48.280430 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-fad17fde-78eb-417e-be21-0b0b7c5c685f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:48.288056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:49:48.437223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daa357-db22-4e2c-aab1-333138e927bf None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:48.451984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daa357-db22-4e2c-aab1-333138e927bf None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:48.457507 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1b28a-4add-4671-8724-aaf40449b853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:48.458133 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1b28a-4add-4671-8724-aaf40449b853 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:48.458410 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1b28a-4add-4671-8724-aaf40449b853 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:48.458679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1b28a-4add-4671-8724-aaf40449b853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:48.467387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1b28a-4add-4671-8724-aaf40449b853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:48.468973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1b28a-4add-4671-8724-aaf40449b853 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:48.478032 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 714/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:49.380187 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e623d8-2182-4544-ae2a-5e015d7c23cf None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:49.380668 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e623d8-2182-4544-ae2a-5e015d7c23cf None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:49.380764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e623d8-2182-4544-ae2a-5e015d7c23cf None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:49.382122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:49.387928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950b5d-2b44-4418-a22c-025475b59bfa None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:49.388367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950b5d-2b44-4418-a22c-025475b59bfa None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:49.388476 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950b5d-2b44-4418-a22c-025475b59bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:49.406901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-6d950b5d-2b44-4418-a22c-025475b59bfa None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:49.408063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6d950b5d-2b44-4418-a22c-025475b59bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:49.415932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:49.563822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e623d8-2182-4544-ae2a-5e015d7c23cf None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:49.578286 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e623d8-2182-4544-ae2a-5e015d7c23cf None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:49.583873 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078e77e-5d20-47e6-bd44-bddffd8e6b44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:49.584472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078e77e-5d20-47e6-bd44-bddffd8e6b44 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:49.584756 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078e77e-5d20-47e6-bd44-bddffd8e6b44 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:49.585032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078e77e-5d20-47e6-bd44-bddffd8e6b44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:49.593306 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078e77e-5d20-47e6-bd44-bddffd8e6b44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:49.594893 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078e77e-5d20-47e6-bd44-bddffd8e6b44 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:49.604396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 716/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:50.488210 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f8f17-4192-4961-a24a-9e6fcfa1bda6 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:50.488746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f8f17-4192-4961-a24a-9e6fcfa1bda6 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:50.488746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f8f17-4192-4961-a24a-9e6fcfa1bda6 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:50.490139 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:50.495757 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c361a2-bf4f-495c-9b2a-18b5f5f748d2 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:50.496182 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c361a2-bf4f-495c-9b2a-18b5f5f748d2 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:50.496318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c361a2-bf4f-495c-9b2a-18b5f5f748d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:50.514876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-30c361a2-bf4f-495c-9b2a-18b5f5f748d2 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:50.516035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-30c361a2-bf4f-495c-9b2a-18b5f5f748d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:50.524027 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:50.673317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f8f17-4192-4961-a24a-9e6fcfa1bda6 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:50.688048 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f8f17-4192-4961-a24a-9e6fcfa1bda6 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:50.693386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7087ca2-d432-4e62-afd8-35f8379d5bf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:50.694020 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7087ca2-d432-4e62-afd8-35f8379d5bf5 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:50.694306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7087ca2-d432-4e62-afd8-35f8379d5bf5 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:50.694584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7087ca2-d432-4e62-afd8-35f8379d5bf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:50.702508 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7087ca2-d432-4e62-afd8-35f8379d5bf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:50.704132 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7087ca2-d432-4e62-afd8-35f8379d5bf5 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:50.713243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 717/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:51.625591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a729-d6aa-4df7-8f2b-dfc80fb20885 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:51.626177 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a729-d6aa-4df7-8f2b-dfc80fb20885 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:51.626177 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a729-d6aa-4df7-8f2b-dfc80fb20885 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:51.627527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:51.632361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6ab17-8801-4544-9d48-404833730b8f None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:51.632745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6ab17-8801-4544-9d48-404833730b8f None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:51.632930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6ab17-8801-4544-9d48-404833730b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:51.650679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-fad6ab17-8801-4544-9d48-404833730b8f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:51.651895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-fad6ab17-8801-4544-9d48-404833730b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:51.659622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:51.809721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7a729-d6aa-4df7-8f2b-dfc80fb20885 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:51.824686 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7a729-d6aa-4df7-8f2b-dfc80fb20885 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:51.830005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f37a29-8ae3-43f2-b10a-170d1a1e5d04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:51.830630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f37a29-8ae3-43f2-b10a-170d1a1e5d04 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:51.830912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f37a29-8ae3-43f2-b10a-170d1a1e5d04 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:51.831188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f37a29-8ae3-43f2-b10a-170d1a1e5d04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:51.839182 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f37a29-8ae3-43f2-b10a-170d1a1e5d04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:51.840791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f37a29-8ae3-43f2-b10a-170d1a1e5d04 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:51.849995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 719/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:52.794800 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04c38a-2c88-4f32-9c2d-b8298d3fb8cb None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:52.795362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04c38a-2c88-4f32-9c2d-b8298d3fb8cb None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:52.795362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04c38a-2c88-4f32-9c2d-b8298d3fb8cb None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:52.796768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:52.801896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df69d2-42d2-45f0-a1fb-6b19c05285dd None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:52.802328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df69d2-42d2-45f0-a1fb-6b19c05285dd None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:52.802492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df69d2-42d2-45f0-a1fb-6b19c05285dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:52.821126 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-58df69d2-42d2-45f0-a1fb-6b19c05285dd None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:52.822302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-58df69d2-42d2-45f0-a1fb-6b19c05285dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:52.830074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:52.977215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04c38a-2c88-4f32-9c2d-b8298d3fb8cb None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:52.991434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04c38a-2c88-4f32-9c2d-b8298d3fb8cb None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:52.997081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b902d0f-9415-4ba8-99d7-8930588cdece service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:52.997718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b902d0f-9415-4ba8-99d7-8930588cdece service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:52.997999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b902d0f-9415-4ba8-99d7-8930588cdece service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:52.998274 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b902d0f-9415-4ba8-99d7-8930588cdece service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:53.006338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b902d0f-9415-4ba8-99d7-8930588cdece service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:53.007965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b902d0f-9415-4ba8-99d7-8930588cdece service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:53.018018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 720/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:55.117310 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bbd03-0335-465c-b442-e74ef4990ec9 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:55.117874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bbd03-0335-465c-b442-e74ef4990ec9 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:55.117874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bbd03-0335-465c-b442-e74ef4990ec9 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:55.119255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:55.124556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cc265-5d0f-4237-8905-0f9cb68e2785 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:55.125006 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cc265-5d0f-4237-8905-0f9cb68e2785 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:55.125123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cc265-5d0f-4237-8905-0f9cb68e2785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:55.143840 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-f90cc265-5d0f-4237-8905-0f9cb68e2785 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:55.145041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f90cc265-5d0f-4237-8905-0f9cb68e2785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:55.153478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:55.191562 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bbd03-0335-465c-b442-e74ef4990ec9 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:55.202614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bbd03-0335-465c-b442-e74ef4990ec9 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:55.206088 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6620140-060b-4188-86c9-0f61f702d16f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:55.206716 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6620140-060b-4188-86c9-0f61f702d16f service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:55.206994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6620140-060b-4188-86c9-0f61f702d16f service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:55.207267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6620140-060b-4188-86c9-0f61f702d16f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:55.216665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6620140-060b-4188-86c9-0f61f702d16f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:55.218141 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6620140-060b-4188-86c9-0f61f702d16f service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:55.227554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 722/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:49:57.609208 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a75614-ab56-4c50-9157-fc8208802f9e None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:57.609746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a75614-ab56-4c50-9157-fc8208802f9e None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:57.609746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a75614-ab56-4c50-9157-fc8208802f9e None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:57.611028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:49:57.616203 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2530725-291d-4bb8-ace4-c34be482254b None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:57.616588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2530725-291d-4bb8-ace4-c34be482254b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:57.616762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2530725-291d-4bb8-ace4-c34be482254b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:57.634677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-e2530725-291d-4bb8-ace4-c34be482254b None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:57.636162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e2530725-291d-4bb8-ace4-c34be482254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:57.643939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:57.682713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a75614-ab56-4c50-9157-fc8208802f9e None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:57.693155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a75614-ab56-4c50-9157-fc8208802f9e None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:57.696613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c633b5a-a26b-4ab4-a1d9-fe0e64ec3e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:57.697230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c633b5a-a26b-4ab4-a1d9-fe0e64ec3e8c service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:57.697509 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c633b5a-a26b-4ab4-a1d9-fe0e64ec3e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:57.697781 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c633b5a-a26b-4ab4-a1d9-fe0e64ec3e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:57.706636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c633b5a-a26b-4ab4-a1d9-fe0e64ec3e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:57.708116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c633b5a-a26b-4ab4-a1d9-fe0e64ec3e8c service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:57.718116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 723/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:50:00.355666 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cade3-4ced-43bb-93e6-88f4ab6bbecd None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:00.356257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cade3-4ced-43bb-93e6-88f4ab6bbecd None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:00.356257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cade3-4ced-43bb-93e6-88f4ab6bbecd None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:00.357572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:00.362927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269095b-33de-444f-b656-fcff1fde6417 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:00.363329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269095b-33de-444f-b656-fcff1fde6417 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:00.363524 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269095b-33de-444f-b656-fcff1fde6417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:00.381330 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-e269095b-33de-444f-b656-fcff1fde6417 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:00.383129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e269095b-33de-444f-b656-fcff1fde6417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:00.391424 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:00.429689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cade3-4ced-43bb-93e6-88f4ab6bbecd None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:00.440139 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cade3-4ced-43bb-93e6-88f4ab6bbecd None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:00.443596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c6c21-ed9b-488f-a151-2ca54d419db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:00.444217 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c6c21-ed9b-488f-a151-2ca54d419db4 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:00.444496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c6c21-ed9b-488f-a151-2ca54d419db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:00.444768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c6c21-ed9b-488f-a151-2ca54d419db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:00.453978 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c6c21-ed9b-488f-a151-2ca54d419db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:00.455379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c6c21-ed9b-488f-a151-2ca54d419db4 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:00.465128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 725/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:50:02.806948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3034-1658-4aea-abcb-7a5f07c17ac7 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:02.807539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3034-1658-4aea-abcb-7a5f07c17ac7 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:02.807539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3034-1658-4aea-abcb-7a5f07c17ac7 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:02.808906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:02.814054 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e0e02-56bd-4397-a021-e164efb2e99c None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:02.814461 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e0e02-56bd-4397-a021-e164efb2e99c None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:02.814606 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e0e02-56bd-4397-a021-e164efb2e99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:02.831907 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-cb6e0e02-56bd-4397-a021-e164efb2e99c None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:02.833069 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-cb6e0e02-56bd-4397-a021-e164efb2e99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:02.841230 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:02.879140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b3034-1658-4aea-abcb-7a5f07c17ac7 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:02.890089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b3034-1658-4aea-abcb-7a5f07c17ac7 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:02.893682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1f01d-fee1-4fa3-83be-8861ca21a20e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:02.894315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1f01d-fee1-4fa3-83be-8861ca21a20e service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:02.894598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1f01d-fee1-4fa3-83be-8861ca21a20e service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:02.894874 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1f01d-fee1-4fa3-83be-8861ca21a20e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:02.904267 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1f01d-fee1-4fa3-83be-8861ca21a20e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:02.905690 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1f01d-fee1-4fa3-83be-8861ca21a20e service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:02.914967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 726/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:50:05.347606 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543020a-e42e-4b93-93e6-8a33bf4e7b97 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:05.348160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543020a-e42e-4b93-93e6-8a33bf4e7b97 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:05.348160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543020a-e42e-4b93-93e6-8a33bf4e7b97 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:05.349536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:05.354882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5885bff-f7b5-4f78-bc0d-e3d672ebdf8e None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:05.355312 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5885bff-f7b5-4f78-bc0d-e3d672ebdf8e None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:05.355422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5885bff-f7b5-4f78-bc0d-e3d672ebdf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:05.372947 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-b5885bff-f7b5-4f78-bc0d-e3d672ebdf8e None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:05.374144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b5885bff-f7b5-4f78-bc0d-e3d672ebdf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:05.382349 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:05.420836 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543020a-e42e-4b93-93e6-8a33bf4e7b97 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:05.431309 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543020a-e42e-4b93-93e6-8a33bf4e7b97 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:05.435062 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684db02-658c-4995-a9a7-e02cc5bec6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:05.435731 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684db02-658c-4995-a9a7-e02cc5bec6dd service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:05.436013 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684db02-658c-4995-a9a7-e02cc5bec6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:05.436287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684db02-658c-4995-a9a7-e02cc5bec6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:05.444991 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684db02-658c-4995-a9a7-e02cc5bec6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:05.446904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684db02-658c-4995-a9a7-e02cc5bec6dd service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:05.456079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 728/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:50:07.735879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cbddb-d004-48f1-9ec2-9b471dd5c15c None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:07.736432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cbddb-d004-48f1-9ec2-9b471dd5c15c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:07.736432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cbddb-d004-48f1-9ec2-9b471dd5c15c None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:07.737804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:07.743180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dea02-30af-4c71-a377-730d4838e87c None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:07.744137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dea02-30af-4c71-a377-730d4838e87c None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:07.744399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dea02-30af-4c71-a377-730d4838e87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:07.762260 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-193dea02-30af-4c71-a377-730d4838e87c None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:07.763439 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-193dea02-30af-4c71-a377-730d4838e87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:07.771196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:07.809312 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cbddb-d004-48f1-9ec2-9b471dd5c15c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:07.819816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cbddb-d004-48f1-9ec2-9b471dd5c15c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:07.823255 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4790b98-5beb-41cc-8bed-59297d1fc5ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:07.823910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4790b98-5beb-41cc-8bed-59297d1fc5ea service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:07.824194 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4790b98-5beb-41cc-8bed-59297d1fc5ea service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:07.824469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4790b98-5beb-41cc-8bed-59297d1fc5ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:07.833161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4790b98-5beb-41cc-8bed-59297d1fc5ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:07.834574 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4790b98-5beb-41cc-8bed-59297d1fc5ea service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:07.843758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 729/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:50:10.114750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cf1af-d298-4b41-85ec-45ee29259487 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:10.115330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cf1af-d298-4b41-85ec-45ee29259487 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:10.115436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cf1af-d298-4b41-85ec-45ee29259487 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:10.120056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:10.122632 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918f8da-5227-4e10-a247-d6ad23c0d682 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:10.123042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918f8da-5227-4e10-a247-d6ad23c0d682 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:10.123251 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918f8da-5227-4e10-a247-d6ad23c0d682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:10.129470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=70 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:50:10.142363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-8918f8da-5227-4e10-a247-d6ad23c0d682 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:10.143595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8918f8da-5227-4e10-a247-d6ad23c0d682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:10.151508 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:10.188413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cf1af-d298-4b41-85ec-45ee29259487 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:10.193697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=73 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:50:10.199903 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cf1af-d298-4b41-85ec-45ee29259487 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:10.203386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf0ca9-e22c-44d8-a2de-0831d359483c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:10.206081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf0ca9-e22c-44d8-a2de-0831d359483c service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:10.206081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf0ca9-e22c-44d8-a2de-0831d359483c service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:10.206081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf0ca9-e22c-44d8-a2de-0831d359483c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:10.213283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf0ca9-e22c-44d8-a2de-0831d359483c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:10.214712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf0ca9-e22c-44d8-a2de-0831d359483c service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:10.224075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 731/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:50:12.471645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba3715-abf0-45d7-af6f-7ba7fcb49e40 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:12.472149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba3715-abf0-45d7-af6f-7ba7fcb49e40 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:12.472272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba3715-abf0-45d7-af6f-7ba7fcb49e40 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:12.473611 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:12.479786 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a1e54-c75f-4a26-b96f-7eb264082c06 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:12.480252 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a1e54-c75f-4a26-b96f-7eb264082c06 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:12.480361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a1e54-c75f-4a26-b96f-7eb264082c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:12.497717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-0d9a1e54-c75f-4a26-b96f-7eb264082c06 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:12.498905 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0d9a1e54-c75f-4a26-b96f-7eb264082c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:12.506635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:12.544141 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba3715-abf0-45d7-af6f-7ba7fcb49e40 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:12.554669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba3715-abf0-45d7-af6f-7ba7fcb49e40 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:12.558239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a63955-5f44-4b8a-bb79-d6e1d70ed7ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:12.558866 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a63955-5f44-4b8a-bb79-d6e1d70ed7ce service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:12.559151 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a63955-5f44-4b8a-bb79-d6e1d70ed7ce service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:12.559430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a63955-5f44-4b8a-bb79-d6e1d70ed7ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:12.568306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a63955-5f44-4b8a-bb79-d6e1d70ed7ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:12.569729 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a63955-5f44-4b8a-bb79-d6e1d70ed7ce service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:12.579238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 732/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:50:14.823805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f37fd-6384-4921-b6c0-58b738846ed3 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:14.824361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f37fd-6384-4921-b6c0-58b738846ed3 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:14.824361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f37fd-6384-4921-b6c0-58b738846ed3 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:14.825746 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:14.831337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc892e0-3176-48d7-a6f2-0946edfe7686 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:14.831784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc892e0-3176-48d7-a6f2-0946edfe7686 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:14.831929 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc892e0-3176-48d7-a6f2-0946edfe7686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:14.849849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-4fc892e0-3176-48d7-a6f2-0946edfe7686 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:14.851035 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4fc892e0-3176-48d7-a6f2-0946edfe7686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:14.859301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:14.895477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f37fd-6384-4921-b6c0-58b738846ed3 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:14.906592 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f37fd-6384-4921-b6c0-58b738846ed3 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:14.910112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee20756-0d7a-43da-9d53-5eb3938e0606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:14.910743 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee20756-0d7a-43da-9d53-5eb3938e0606 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:14.911026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee20756-0d7a-43da-9d53-5eb3938e0606 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:14.911297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee20756-0d7a-43da-9d53-5eb3938e0606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:14.920546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee20756-0d7a-43da-9d53-5eb3938e0606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:14.921968 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee20756-0d7a-43da-9d53-5eb3938e0606 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:14.931149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 734/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:50:17.162513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ea609-d997-4131-b907-c012bda7b2ec None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:17.163053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ea609-d997-4131-b907-c012bda7b2ec None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:17.163053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ea609-d997-4131-b907-c012bda7b2ec None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:17.164602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:17.170404 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c87372-0158-477f-a9c9-71f5fde895e2 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:17.170820 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c87372-0158-477f-a9c9-71f5fde895e2 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:17.170966 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c87372-0158-477f-a9c9-71f5fde895e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:17.188485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-65c87372-0158-477f-a9c9-71f5fde895e2 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:17.189679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-65c87372-0158-477f-a9c9-71f5fde895e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:17.197462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:17.234198 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ea609-d997-4131-b907-c012bda7b2ec None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:17.244748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ea609-d997-4131-b907-c012bda7b2ec None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:17.248256 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbc663-83e7-438e-be40-d7923d1dacbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:17.248883 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbc663-83e7-438e-be40-d7923d1dacbe service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:17.249168 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbc663-83e7-438e-be40-d7923d1dacbe service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:17.249445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbc663-83e7-438e-be40-d7923d1dacbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:17.258529 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbc663-83e7-438e-be40-d7923d1dacbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:17.260787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbc663-83e7-438e-be40-d7923d1dacbe service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:17.270118 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 735/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:50:27.183432 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=17 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:50:27.265938 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=17 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:50:49.378369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e155e1-5839-468f-8db9-c1fb08219cde None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:49.378914 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e155e1-5839-468f-8db9-c1fb08219cde None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:49.378914 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e155e1-5839-468f-8db9-c1fb08219cde None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:49.380330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 736/1471] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:49.385571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511388c-f222-47a6-af11-c8c1dc546957 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:49.386284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511388c-f222-47a6-af11-c8c1dc546957 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:49.386442 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511388c-f222-47a6-af11-c8c1dc546957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:49.404380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-6511388c-f222-47a6-af11-c8c1dc546957 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:49.405499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6511388c-f222-47a6-af11-c8c1dc546957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:49.413236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 736/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:49.459334 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d7db1-2d10-4bcc-adeb-7b054432fe61 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:49.459649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d7db1-2d10-4bcc-adeb-7b054432fe61 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:49.459926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d7db1-2d10-4bcc-adeb-7b054432fe61 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:49.461297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 737/1473] 10.222.0.39 () {54 vars in 962 bytes} [Thu Jun 2 13:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:49.466636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe41ecc-d1f2-4fa9-af2c-2521472eca88 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:49.466955 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe41ecc-d1f2-4fa9-af2c-2521472eca88 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:49.467236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe41ecc-d1f2-4fa9-af2c-2521472eca88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:49.486106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-0fe41ecc-d1f2-4fa9-af2c-2521472eca88 None None] MFA Rules not processed for user `be4de0fa80784de1acfcd47a2b77d9ac`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:49.487271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-0fe41ecc-d1f2-4fa9-af2c-2521472eca88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:49.493660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 737/1474] 10.222.0.39 () {58 vars in 1059 bytes} [Thu Jun 2 13:50:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:49.500760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d7db1-2d10-4bcc-adeb-7b054432fe61 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:49.512062 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d7db1-2d10-4bcc-adeb-7b054432fe61 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:49.515640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38768b-575d-4b98-8beb-5e6b8cdaf8ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be4de0fa80784de1acfcd47a2b77d9ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:49.516292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38768b-575d-4b98-8beb-5e6b8cdaf8ad service glance] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:49.516575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38768b-575d-4b98-8beb-5e6b8cdaf8ad service glance] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:49.516851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38768b-575d-4b98-8beb-5e6b8cdaf8ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:49.526359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38768b-575d-4b98-8beb-5e6b8cdaf8ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:49.527804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38768b-575d-4b98-8beb-5e6b8cdaf8ad service glance] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:49.537018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 738/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:50:51.862677 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b0abc-bcf5-4672-a6f2-282a61bc3837 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:51.863263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b0abc-bcf5-4672-a6f2-282a61bc3837 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:51.863263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b0abc-bcf5-4672-a6f2-282a61bc3837 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:51.864640 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 738/1476] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:51.870629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9fa4b-74ae-42a4-a37d-bc6a648cde5a None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:51.871031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9fa4b-74ae-42a4-a37d-bc6a648cde5a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:51.871186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9fa4b-74ae-42a4-a37d-bc6a648cde5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:51.889110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-42e9fa4b-74ae-42a4-a37d-bc6a648cde5a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:51.890300 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-42e9fa4b-74ae-42a4-a37d-bc6a648cde5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:51.898042 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 739/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:51.922111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b0abc-bcf5-4672-a6f2-282a61bc3837 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:51.935150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b0abc-bcf5-4672-a6f2-282a61bc3837 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:51.939713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638394b-f26b-4a42-b653-9cefc5fd3f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:51.944815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638394b-f26b-4a42-b653-9cefc5fd3f2e admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:51.944815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638394b-f26b-4a42-b653-9cefc5fd3f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:51.944815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638394b-f26b-4a42-b653-9cefc5fd3f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:51.944815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638394b-f26b-4a42-b653-9cefc5fd3f2e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:51.944815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: WARNING py.warnings [None req-5638394b-f26b-4a42-b653-9cefc5fd3f2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:50:51.944815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: warnings.warn(msg) Jun 02 13:50:51.944815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: Jun 02 13:50:51.946014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638394b-f26b-4a42-b653-9cefc5fd3f2e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:51.963393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 739/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 2 13:50:51 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:50:54.199216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3967d18-01c6-476a-bd25-977f46cb78d4 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:54.199828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3967d18-01c6-476a-bd25-977f46cb78d4 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:54.199828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3967d18-01c6-476a-bd25-977f46cb78d4 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:54.201192 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 740/1479] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:54.206622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb0deb-3194-41c5-8150-36cca7b03fb9 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:54.207031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb0deb-3194-41c5-8150-36cca7b03fb9 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:54.207186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb0deb-3194-41c5-8150-36cca7b03fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:54.225296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-efeb0deb-3194-41c5-8150-36cca7b03fb9 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:54.226480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-efeb0deb-3194-41c5-8150-36cca7b03fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:54.234265 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 740/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:54.278017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3967d18-01c6-476a-bd25-977f46cb78d4 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:54.292413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3967d18-01c6-476a-bd25-977f46cb78d4 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:54.297761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521877f6-7d76-418b-b041-194af554e878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:54.298388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521877f6-7d76-418b-b041-194af554e878 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:54.298675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521877f6-7d76-418b-b041-194af554e878 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:54.298951 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521877f6-7d76-418b-b041-194af554e878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:54.307014 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521877f6-7d76-418b-b041-194af554e878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:54.308615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521877f6-7d76-418b-b041-194af554e878 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:54.318015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 741/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:50:56.906626 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82788fff-5b0d-4474-b428-a67a07609d2d None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:56.907212 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82788fff-5b0d-4474-b428-a67a07609d2d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:56.907212 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82788fff-5b0d-4474-b428-a67a07609d2d None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:56.908588 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 741/1482] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:56.913784 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4709cc-3d35-418f-86a5-0282bc3f9978 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:56.914179 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4709cc-3d35-418f-86a5-0282bc3f9978 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:56.914347 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4709cc-3d35-418f-86a5-0282bc3f9978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:56.932420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-dc4709cc-3d35-418f-86a5-0282bc3f9978 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:56.933600 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-dc4709cc-3d35-418f-86a5-0282bc3f9978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:56.941234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 742/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:56.976919 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82788fff-5b0d-4474-b428-a67a07609d2d None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:56.988165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82788fff-5b0d-4474-b428-a67a07609d2d None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:56.991667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f042228-2ecb-4f0c-b9b6-6847bfb489ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:56.992378 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f042228-2ecb-4f0c-b9b6-6847bfb489ca service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:56.992657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f042228-2ecb-4f0c-b9b6-6847bfb489ca service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:56.992931 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f042228-2ecb-4f0c-b9b6-6847bfb489ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:57.001774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f042228-2ecb-4f0c-b9b6-6847bfb489ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:57.003195 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f042228-2ecb-4f0c-b9b6-6847bfb489ca service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:57.013320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 742/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:50:59.431573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1c950-e8ba-47c6-ae34-9bc7d892612b None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:59.432142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1c950-e8ba-47c6-ae34-9bc7d892612b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:59.432142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1c950-e8ba-47c6-ae34-9bc7d892612b None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:59.433510 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 743/1485] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:59.438901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a75a1-f08d-4181-ab81-82b8ee997b73 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:59.439307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a75a1-f08d-4181-ab81-82b8ee997b73 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:59.439513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a75a1-f08d-4181-ab81-82b8ee997b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:59.457961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-797a75a1-f08d-4181-ab81-82b8ee997b73 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:59.459146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-797a75a1-f08d-4181-ab81-82b8ee997b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:59.467602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 743/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:59.506693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1c950-e8ba-47c6-ae34-9bc7d892612b None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:59.518094 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1c950-e8ba-47c6-ae34-9bc7d892612b None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:59.521558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80e6f2-e0aa-4fd2-abca-e2c27e07e369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:59.522189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80e6f2-e0aa-4fd2-abca-e2c27e07e369 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:59.522474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80e6f2-e0aa-4fd2-abca-e2c27e07e369 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:59.522754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80e6f2-e0aa-4fd2-abca-e2c27e07e369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:59.532363 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80e6f2-e0aa-4fd2-abca-e2c27e07e369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:59.533801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80e6f2-e0aa-4fd2-abca-e2c27e07e369 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:59.543178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 744/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:51:01.913935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1af7d-6251-4f86-bd6a-e4dfb1986e07 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:01.914586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1af7d-6251-4f86-bd6a-e4dfb1986e07 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:01.914586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1af7d-6251-4f86-bd6a-e4dfb1986e07 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:01.916105 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 744/1488] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:51:01.921446 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f4d96-a448-4a82-8170-2c6cab89efa2 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:01.921909 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f4d96-a448-4a82-8170-2c6cab89efa2 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:01.922016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f4d96-a448-4a82-8170-2c6cab89efa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:01.940016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-7e3f4d96-a448-4a82-8170-2c6cab89efa2 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:51:01.941200 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7e3f4d96-a448-4a82-8170-2c6cab89efa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:51:01.949604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 745/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:51:01.989084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1af7d-6251-4f86-bd6a-e4dfb1986e07 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:51:02.000072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1af7d-6251-4f86-bd6a-e4dfb1986e07 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:51:02.003516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310e199-1991-48df-b620-cc4115191f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:51:02.004168 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310e199-1991-48df-b620-cc4115191f21 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:02.004444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310e199-1991-48df-b620-cc4115191f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:02.004715 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310e199-1991-48df-b620-cc4115191f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:02.014286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310e199-1991-48df-b620-cc4115191f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:51:02.015733 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310e199-1991-48df-b620-cc4115191f21 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:51:02.026340 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 745/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:51:04.654342 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1359ea-a2a5-4b7d-b0c3-4f3370be7302 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:04.654891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1359ea-a2a5-4b7d-b0c3-4f3370be7302 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:04.654891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1359ea-a2a5-4b7d-b0c3-4f3370be7302 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:04.656231 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 746/1491] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 2 13:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:51:04.661361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdc46f-ceaa-41b7-9e19-5207b08c15a3 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:04.661784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdc46f-ceaa-41b7-9e19-5207b08c15a3 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:04.661921 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdc46f-ceaa-41b7-9e19-5207b08c15a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:04.679897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-0efdc46f-ceaa-41b7-9e19-5207b08c15a3 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:51:04.681085 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-0efdc46f-ceaa-41b7-9e19-5207b08c15a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:51:04.689306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 746/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 2 13:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:51:04.727215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1359ea-a2a5-4b7d-b0c3-4f3370be7302 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:51:04.738153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1359ea-a2a5-4b7d-b0c3-4f3370be7302 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:51:04.741646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a27f27-5175-41d1-8b62-95e6c4e7dce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:51:04.742308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a27f27-5175-41d1-8b62-95e6c4e7dce9 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:04.742589 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a27f27-5175-41d1-8b62-95e6c4e7dce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:04.742861 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a27f27-5175-41d1-8b62-95e6c4e7dce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:04.752145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a27f27-5175-41d1-8b62-95e6c4e7dce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:51:04.753566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a27f27-5175-41d1-8b62-95e6c4e7dce9 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:51:04.762909 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 747/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:51:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:51:14.674759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=33 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:51:14.758594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=33 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:52:38.411913 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f264d-0ea9-41f7-b7b3-b28b8d850cff None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:38.412499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f264d-0ea9-41f7-b7b3-b28b8d850cff None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:38.412499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f264d-0ea9-41f7-b7b3-b28b8d850cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:38.430682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-f09f264d-0ea9-41f7-b7b3-b28b8d850cff None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:52:38.431903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f09f264d-0ea9-41f7-b7b3-b28b8d850cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:38.440283 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 747/1494] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:52:38.448049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7720bfc-b53a-411c-85eb-7126969b7ba8 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:38.448514 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7720bfc-b53a-411c-85eb-7126969b7ba8 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:38.448630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7720bfc-b53a-411c-85eb-7126969b7ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:38.465881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f7720bfc-b53a-411c-85eb-7126969b7ba8 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:52:38.467060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f7720bfc-b53a-411c-85eb-7126969b7ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:38.474965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 748/1495] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:52:38.479284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f264d-0ea9-41f7-b7b3-b28b8d850cff None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:38.489255 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f264d-0ea9-41f7-b7b3-b28b8d850cff None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:38.493723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80970a7-945e-4376-9366-e197f35d07b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:38.494369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80970a7-945e-4376-9366-e197f35d07b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:38.494656 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80970a7-945e-4376-9366-e197f35d07b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:38.494936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80970a7-945e-4376-9366-e197f35d07b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:38.495694 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80970a7-945e-4376-9366-e197f35d07b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:52:38.496003 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80970a7-945e-4376-9366-e197f35d07b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:38.497024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: WARNING py.warnings [None req-a80970a7-945e-4376-9366-e197f35d07b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:52:38.497024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: warnings.warn(msg) Jun 02 13:52:38.497024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: Jun 02 13:52:38.497908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80970a7-945e-4376-9366-e197f35d07b5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:38.510064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 748/1496] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:52:38.518167 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7720bfc-b53a-411c-85eb-7126969b7ba8 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:38.527197 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7720bfc-b53a-411c-85eb-7126969b7ba8 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:38.532292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71816e48-7a41-4d2b-b8fa-dc24e723396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:38.532933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71816e48-7a41-4d2b-b8fa-dc24e723396d admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:38.533221 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71816e48-7a41-4d2b-b8fa-dc24e723396d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:38.533502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71816e48-7a41-4d2b-b8fa-dc24e723396d admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:38.534190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71816e48-7a41-4d2b-b8fa-dc24e723396d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:38.536083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: WARNING py.warnings [None req-71816e48-7a41-4d2b-b8fa-dc24e723396d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:52:38.536083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: warnings.warn(msg) Jun 02 13:52:38.536083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: Jun 02 13:52:38.537293 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71816e48-7a41-4d2b-b8fa-dc24e723396d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:38.682999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 749/1497] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:52:38 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:52:38.687570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80970a7-945e-4376-9366-e197f35d07b5 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:38.697379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80970a7-945e-4376-9366-e197f35d07b5 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:38.751432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af80466-ebdb-4bfb-9479-429ae860a8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:38.752112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af80466-ebdb-4bfb-9479-429ae860a8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:38.752395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af80466-ebdb-4bfb-9479-429ae860a8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:38.752667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af80466-ebdb-4bfb-9479-429ae860a8e5 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:38.753352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af80466-ebdb-4bfb-9479-429ae860a8e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:38.754360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: WARNING py.warnings [None req-8af80466-ebdb-4bfb-9479-429ae860a8e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:52:38.754360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: warnings.warn(msg) Jun 02 13:52:38.754360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: Jun 02 13:52:38.755584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af80466-ebdb-4bfb-9479-429ae860a8e5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:38.852450 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 749/1498] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:52:38 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:52:38.856609 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71816e48-7a41-4d2b-b8fa-dc24e723396d admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:38.866862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71816e48-7a41-4d2b-b8fa-dc24e723396d admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:38.871549 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd38c68-6219-4113-b75c-0991c3c5f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:38.872209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd38c68-6219-4113-b75c-0991c3c5f10f admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:38.872493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd38c68-6219-4113-b75c-0991c3c5f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:38.872770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd38c68-6219-4113-b75c-0991c3c5f10f admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:38.873492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd38c68-6219-4113-b75c-0991c3c5f10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:38.875065 dv-cinder-826510-6-smb devstack@keystone.service[92271]: WARNING py.warnings [None req-abd38c68-6219-4113-b75c-0991c3c5f10f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:52:38.875065 dv-cinder-826510-6-smb devstack@keystone.service[92271]: warnings.warn(msg) Jun 02 13:52:38.875065 dv-cinder-826510-6-smb devstack@keystone.service[92271]: Jun 02 13:52:38.875999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd38c68-6219-4113-b75c-0991c3c5f10f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:38.888735 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 750/1499] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:52:38.893158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af80466-ebdb-4bfb-9479-429ae860a8e5 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:38.902834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af80466-ebdb-4bfb-9479-429ae860a8e5 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:38.907373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a8cbe-8ba0-4d7d-9701-7fd07cd58d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:38.908053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a8cbe-8ba0-4d7d-9701-7fd07cd58d80 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:38.908338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a8cbe-8ba0-4d7d-9701-7fd07cd58d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:38.908615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a8cbe-8ba0-4d7d-9701-7fd07cd58d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:38.909332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a8cbe-8ba0-4d7d-9701-7fd07cd58d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:38.910339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: WARNING py.warnings [None req-fb5a8cbe-8ba0-4d7d-9701-7fd07cd58d80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:52:38.910339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: warnings.warn(msg) Jun 02 13:52:38.910339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: Jun 02 13:52:38.911227 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a8cbe-8ba0-4d7d-9701-7fd07cd58d80 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:38.924946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 750/1500] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:52:38.928974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd38c68-6219-4113-b75c-0991c3c5f10f admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:38.939229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd38c68-6219-4113-b75c-0991c3c5f10f admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:38.943696 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a04b6b-d130-4ae9-a130-982eb2f92dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:38.944561 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a04b6b-d130-4ae9-a130-982eb2f92dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:38.944839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a04b6b-d130-4ae9-a130-982eb2f92dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:38.945115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a04b6b-d130-4ae9-a130-982eb2f92dd4 admin admin] PATH_INFO: `/v3/projects/d0bbd296942b4337aff21bf7f308de3e/users/5a8bf36287f4414ba024c33b13d9252f/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:38.959609 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a04b6b-d130-4ae9-a130-982eb2f92dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0bbd296942b4337aff21bf7f308de3e, user_id=5a8bf36287f4414ba024c33b13d9252f, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:38.960648 dv-cinder-826510-6-smb devstack@keystone.service[92271]: WARNING py.warnings [None req-03a04b6b-d130-4ae9-a130-982eb2f92dd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:52:38.960648 dv-cinder-826510-6-smb devstack@keystone.service[92271]: warnings.warn(msg) Jun 02 13:52:38.960648 dv-cinder-826510-6-smb devstack@keystone.service[92271]: Jun 02 13:52:38.962621 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a04b6b-d130-4ae9-a130-982eb2f92dd4 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:39.058299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 751/1501] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:52:38 2022] PUT /identity/v3/projects/d0bbd296942b4337aff21bf7f308de3e/users/5a8bf36287f4414ba024c33b13d9252f/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:52:39.071329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db684137-5e6c-4fcf-a566-2d0bbf205207 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:39.074402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db684137-5e6c-4fcf-a566-2d0bbf205207 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:39.074402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db684137-5e6c-4fcf-a566-2d0bbf205207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:39.097150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-db684137-5e6c-4fcf-a566-2d0bbf205207 None None] MFA Rules not processed for user `5a8bf36287f4414ba024c33b13d9252f`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:52:39.098330 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-db684137-5e6c-4fcf-a566-2d0bbf205207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:39.160606 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 751/1502] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:52:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:52:39.174024 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426edad-83d8-4864-98c0-97ed92808540 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:39.177055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426edad-83d8-4864-98c0-97ed92808540 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:39.177055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426edad-83d8-4864-98c0-97ed92808540 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:39.177055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 752/1503] 10.222.0.39 () {54 vars in 963 bytes} [Thu Jun 2 13:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:52:39.180613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9f83-8d57-40bf-9c81-b5c56fd48827 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:39.180910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9f83-8d57-40bf-9c81-b5c56fd48827 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:39.181196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9f83-8d57-40bf-9c81-b5c56fd48827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:39.199291 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ccde9f83-8d57-40bf-9c81-b5c56fd48827 None None] MFA Rules not processed for user `7e91db8d261d4d458b695abc4e0ab28e`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:52:39.200509 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ccde9f83-8d57-40bf-9c81-b5c56fd48827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:39.242582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:52:39.249744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 752/1504] 10.222.0.39 () {58 vars in 1060 bytes} [Thu Jun 2 13:52:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:52:39.257308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426edad-83d8-4864-98c0-97ed92808540 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:39.269108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426edad-83d8-4864-98c0-97ed92808540 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:39.272819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbb2c3-39b6-4cc8-9b52-95a2b11e9413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:39.273454 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbb2c3-39b6-4cc8-9b52-95a2b11e9413 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:39.273739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbb2c3-39b6-4cc8-9b52-95a2b11e9413 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:39.274017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbb2c3-39b6-4cc8-9b52-95a2b11e9413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:39.283531 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbb2c3-39b6-4cc8-9b52-95a2b11e9413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:39.285977 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbb2c3-39b6-4cc8-9b52-95a2b11e9413 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:39.293871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 753/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:52:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:52:39.350451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8b83f-c12a-4954-8ce8-caaa3c0fbda0 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:39.350761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8b83f-c12a-4954-8ce8-caaa3c0fbda0 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:39.351038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8b83f-c12a-4954-8ce8-caaa3c0fbda0 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:39.352344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 753/1506] 10.222.0.39 () {52 vars in 829 bytes} [Thu Jun 2 13:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:52:39.355998 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbb2c3-39b6-4cc8-9b52-95a2b11e9413 service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:39.418919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbb2c3-39b6-4cc8-9b52-95a2b11e9413 service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:39.423243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:39.424128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:39.424408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:39.424677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] PATH_INFO: `/v3/users/5a8bf36287f4414ba024c33b13d9252f` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:39.425835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8bf36287f4414ba024c33b13d9252f)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:39.426833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: WARNING py.warnings [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:52:39.426833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: warnings.warn(msg) Jun 02 13:52:39.426833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: Jun 02 13:52:39.428060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:39.754933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8bf36287f4414ba024c33b13d9252f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:39.773084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8bf36287f4414ba024c33b13d9252f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:39.785064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8bf36287f4414ba024c33b13d9252f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:39.785758 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8bf36287f4414ba024c33b13d9252f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:39.789863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:52:39.878817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8bf36287f4414ba024c33b13d9252f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:39.885450 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 754/1507] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:52:39 2022] DELETE /identity/v3/users/5a8bf36287f4414ba024c33b13d9252f => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:52:39.890683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1f9f7-45b9-442c-8212-78468c2d7d83 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:39.891162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1f9f7-45b9-442c-8212-78468c2d7d83 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:39.899633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1f9f7-45b9-442c-8212-78468c2d7d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:39.910069 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-48a1f9f7-45b9-442c-8212-78468c2d7d83 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:52:39.911255 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-48a1f9f7-45b9-442c-8212-78468c2d7d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:39.967334 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 754/1508] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:52:39.977316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:39.978764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:40.035164 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0102b2-7138-4266-8c48-53347081192c admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:40.038719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129d5b9-c45b-4257-b87f-72c8a23a890a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:40.039361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129d5b9-c45b-4257-b87f-72c8a23a890a service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:40.039680 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129d5b9-c45b-4257-b87f-72c8a23a890a service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:40.039957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129d5b9-c45b-4257-b87f-72c8a23a890a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:40.048706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129d5b9-c45b-4257-b87f-72c8a23a890a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:40.050132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129d5b9-c45b-4257-b87f-72c8a23a890a service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:40.059352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 755/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:52:40.654837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1f9f7-45b9-442c-8212-78468c2d7d83 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:40.656285 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-48a1f9f7-45b9-442c-8212-78468c2d7d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:40.667761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1f9f7-45b9-442c-8212-78468c2d7d83 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:40.673499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc643b-1b37-4495-a195-196e09937624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:40.675505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc643b-1b37-4495-a195-196e09937624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:40.675791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc643b-1b37-4495-a195-196e09937624 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:40.676060 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc643b-1b37-4495-a195-196e09937624 admin admin] PATH_INFO: `/v3/projects/d0bbd296942b4337aff21bf7f308de3e` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:40.677361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc643b-1b37-4495-a195-196e09937624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0bbd296942b4337aff21bf7f308de3e)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:40.678264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: WARNING py.warnings [None req-c1cc643b-1b37-4495-a195-196e09937624 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:52:40.678264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: warnings.warn(msg) Jun 02 13:52:40.678264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: Jun 02 13:52:40.680682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc643b-1b37-4495-a195-196e09937624 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:40.794826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c1cc643b-1b37-4495-a195-196e09937624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0bbd296942b4337aff21bf7f308de3e', 'request_id': 'req-c1cc643b-1b37-4495-a195-196e09937624'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:40.886935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c1cc643b-1b37-4495-a195-196e09937624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0bbd296942b4337aff21bf7f308de3e', 'request_id': 'req-c1cc643b-1b37-4495-a195-196e09937624'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:40.901111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c1cc643b-1b37-4495-a195-196e09937624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0bbd296942b4337aff21bf7f308de3e', 'request_id': 'req-c1cc643b-1b37-4495-a195-196e09937624'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:40.912663 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c1cc643b-1b37-4495-a195-196e09937624 admin admin] The token cache is being invalidate because project d0bbd296942b4337aff21bf7f308de3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:52:40.912946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c1cc643b-1b37-4495-a195-196e09937624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:40.913685 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c1cc643b-1b37-4495-a195-196e09937624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:40.915230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 755/1510] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:52:40 2022] DELETE /identity/v3/projects/d0bbd296942b4337aff21bf7f308de3e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:52:50.055251 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:52:50.909638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:28.279056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047af58-e6cd-4b14-8a8c-85bde43d1659 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.279598 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047af58-e6cd-4b14-8a8c-85bde43d1659 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.279714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047af58-e6cd-4b14-8a8c-85bde43d1659 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.281061 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:54:28.286365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9547-8d3e-4300-be2e-baa17d0a2322 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.286793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9547-8d3e-4300-be2e-baa17d0a2322 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.286923 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9547-8d3e-4300-be2e-baa17d0a2322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.305043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-8e7e9547-8d3e-4300-be2e-baa17d0a2322 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:28.306209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8e7e9547-8d3e-4300-be2e-baa17d0a2322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:28.363028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:28.530798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047af58-e6cd-4b14-8a8c-85bde43d1659 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:28.533119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9047af58-e6cd-4b14-8a8c-85bde43d1659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:28.605681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047af58-e6cd-4b14-8a8c-85bde43d1659 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:28.611172 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b838f-1696-43fa-9761-dff1f19aadfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:28.611871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b838f-1696-43fa-9761-dff1f19aadfc service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.612196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b838f-1696-43fa-9761-dff1f19aadfc service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.612474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b838f-1696-43fa-9761-dff1f19aadfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.620798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b838f-1696-43fa-9761-dff1f19aadfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:28.622407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b838f-1696-43fa-9761-dff1f19aadfc service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:28.631702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 757/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:29.489041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465b5ed-111d-4afc-aaa2-1e78cdfd25a7 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.489595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465b5ed-111d-4afc-aaa2-1e78cdfd25a7 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.489595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465b5ed-111d-4afc-aaa2-1e78cdfd25a7 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.490973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:54:29.495816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd4186-657d-455c-94d9-3a8421eea748 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.496237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd4186-657d-455c-94d9-3a8421eea748 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.496382 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd4186-657d-455c-94d9-3a8421eea748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.515206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-47cd4186-657d-455c-94d9-3a8421eea748 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:29.516378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-47cd4186-657d-455c-94d9-3a8421eea748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:29.524015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:29.672455 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465b5ed-111d-4afc-aaa2-1e78cdfd25a7 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:29.686722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465b5ed-111d-4afc-aaa2-1e78cdfd25a7 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:29.692799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eae12c-bbc7-4620-9e3d-26d998c5b9ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:29.693427 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eae12c-bbc7-4620-9e3d-26d998c5b9ee service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.693737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eae12c-bbc7-4620-9e3d-26d998c5b9ee service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.694012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eae12c-bbc7-4620-9e3d-26d998c5b9ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.702092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eae12c-bbc7-4620-9e3d-26d998c5b9ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:29.703709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eae12c-bbc7-4620-9e3d-26d998c5b9ee service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:29.713675 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 758/1516] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:29.866110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b103f6-a294-4813-8400-f6c69f6f04dd None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.866327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b103f6-a294-4813-8400-f6c69f6f04dd None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.866610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b103f6-a294-4813-8400-f6c69f6f04dd None None] PATH_INFO: `/v3` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.867974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 759/1517] 10.222.0.58 () {54 vars in 925 bytes} [Thu Jun 2 13:54:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:29.874230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569bec0-c9d4-4f93-a6f5-520f579b9f4c None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.874526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569bec0-c9d4-4f93-a6f5-520f579b9f4c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.874832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569bec0-c9d4-4f93-a6f5-520f579b9f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.893568 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d569bec0-c9d4-4f93-a6f5-520f579b9f4c None None] MFA Rules not processed for user `b387ad13a6c843d0b9a43bc8f5f7fa13`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:29.894753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d569bec0-c9d4-4f93-a6f5-520f579b9f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:29.956492 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 759/1518] 10.222.0.58 () {58 vars in 1015 bytes} [Thu Jun 2 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:39.509615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=37 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:39.715816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43e19-3af4-439f-bc11-0daa831727d3 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:39.716100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43e19-3af4-439f-bc11-0daa831727d3 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:39.716378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43e19-3af4-439f-bc11-0daa831727d3 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:39.717779 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 760/1519] 10.222.0.39 () {54 vars in 960 bytes} [Thu Jun 2 13:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:54:39.723380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6278f3a-f720-418d-80ac-8a571086d4a5 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:39.723867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6278f3a-f720-418d-80ac-8a571086d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:39.723965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6278f3a-f720-418d-80ac-8a571086d4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:39.741652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-c6278f3a-f720-418d-80ac-8a571086d4a5 None None] MFA Rules not processed for user `b387ad13a6c843d0b9a43bc8f5f7fa13`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:39.742828 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c6278f3a-f720-418d-80ac-8a571086d4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:39.751284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 760/1520] 10.222.0.39 () {58 vars in 1057 bytes} [Thu Jun 2 13:54:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:39.758726 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f43e19-3af4-439f-bc11-0daa831727d3 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:39.772870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f43e19-3af4-439f-bc11-0daa831727d3 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:39.777670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8147e-b276-48f8-b825-3503707abbb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:39.778296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8147e-b276-48f8-b825-3503707abbb9 service placement] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:39.778579 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8147e-b276-48f8-b825-3503707abbb9 service placement] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:39.778854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8147e-b276-48f8-b825-3503707abbb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:39.787507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8147e-b276-48f8-b825-3503707abbb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:39.789073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8147e-b276-48f8-b825-3503707abbb9 service placement] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:39.798421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 761/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:40.991124 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6a1a-e267-4fe7-939d-74c28dce0f5f None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:40.991700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6a1a-e267-4fe7-939d-74c28dce0f5f None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:40.991884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6a1a-e267-4fe7-939d-74c28dce0f5f None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:40.993310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:54:40.998058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0c57-e1ff-4c2b-8886-2206181dabe1 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:40.998484 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0c57-e1ff-4c2b-8886-2206181dabe1 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:40.998630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0c57-e1ff-4c2b-8886-2206181dabe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:41.017051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-1a9d0c57-e1ff-4c2b-8886-2206181dabe1 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:41.018313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1a9d0c57-e1ff-4c2b-8886-2206181dabe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:41.026610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:41.178579 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf6a1a-e267-4fe7-939d-74c28dce0f5f None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:41.193218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf6a1a-e267-4fe7-939d-74c28dce0f5f None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:41.198667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811270e-1686-46a9-8f4f-23794fe66b7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:41.199302 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811270e-1686-46a9-8f4f-23794fe66b7b service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:41.199621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811270e-1686-46a9-8f4f-23794fe66b7b service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:41.204735 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811270e-1686-46a9-8f4f-23794fe66b7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:41.208346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811270e-1686-46a9-8f4f-23794fe66b7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:41.209947 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811270e-1686-46a9-8f4f-23794fe66b7b service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:41.219298 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 762/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:42.092129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57b3a-1407-4540-b374-46fe5b3f438a None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:42.092671 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57b3a-1407-4540-b374-46fe5b3f438a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:42.092671 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57b3a-1407-4540-b374-46fe5b3f438a None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:42.094053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:54:42.099041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c5199-fa38-4132-8ebd-ec6c725a8dbd None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:42.099444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c5199-fa38-4132-8ebd-ec6c725a8dbd None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:42.099626 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c5199-fa38-4132-8ebd-ec6c725a8dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:42.117620 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-816c5199-fa38-4132-8ebd-ec6c725a8dbd None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:42.118788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-816c5199-fa38-4132-8ebd-ec6c725a8dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:42.126553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:42.276353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c57b3a-1407-4540-b374-46fe5b3f438a None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:42.290921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c57b3a-1407-4540-b374-46fe5b3f438a None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:42.296315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f56fa-376c-4997-a1d5-efd8395a23fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:42.296944 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f56fa-376c-4997-a1d5-efd8395a23fe service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:42.297231 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f56fa-376c-4997-a1d5-efd8395a23fe service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:42.297512 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f56fa-376c-4997-a1d5-efd8395a23fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:42.306159 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f56fa-376c-4997-a1d5-efd8395a23fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:42.307799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f56fa-376c-4997-a1d5-efd8395a23fe service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:42.317410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 764/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:46.477372 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f20e9-7356-4f04-b5a5-edbfdd06c837 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:46.477930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f20e9-7356-4f04-b5a5-edbfdd06c837 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:46.477930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f20e9-7356-4f04-b5a5-edbfdd06c837 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:46.479283 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:54:46.484609 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f999c8-e9c4-456d-98c9-6e9db36dca5c None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:46.485035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f999c8-e9c4-456d-98c9-6e9db36dca5c None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:46.485173 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f999c8-e9c4-456d-98c9-6e9db36dca5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:46.503309 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f8f999c8-e9c4-456d-98c9-6e9db36dca5c None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:46.505078 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f8f999c8-e9c4-456d-98c9-6e9db36dca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:46.513021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:46.549230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f20e9-7356-4f04-b5a5-edbfdd06c837 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:46.551411 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-591f20e9-7356-4f04-b5a5-edbfdd06c837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:46.607807 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f20e9-7356-4f04-b5a5-edbfdd06c837 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:46.611310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690b3c0-5118-43bf-a9d3-3f5f05a4c5a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:46.611966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690b3c0-5118-43bf-a9d3-3f5f05a4c5a5 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:46.612244 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690b3c0-5118-43bf-a9d3-3f5f05a4c5a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:46.612515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690b3c0-5118-43bf-a9d3-3f5f05a4c5a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:46.621678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690b3c0-5118-43bf-a9d3-3f5f05a4c5a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:46.623099 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690b3c0-5118-43bf-a9d3-3f5f05a4c5a5 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:46.627912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:46.633123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 765/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:48.841461 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091c75e-47f8-44a0-9de6-cede4c2d9a49 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:48.842011 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091c75e-47f8-44a0-9de6-cede4c2d9a49 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:48.842011 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091c75e-47f8-44a0-9de6-cede4c2d9a49 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.843315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:54:48.848467 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052aa82-d8a0-459f-bca6-3fdeb69ee7d3 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:48.848860 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052aa82-d8a0-459f-bca6-3fdeb69ee7d3 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:48.849050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052aa82-d8a0-459f-bca6-3fdeb69ee7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.867100 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-6052aa82-d8a0-459f-bca6-3fdeb69ee7d3 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:48.868323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6052aa82-d8a0-459f-bca6-3fdeb69ee7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:48.876049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:48.911571 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091c75e-47f8-44a0-9de6-cede4c2d9a49 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:48.922135 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091c75e-47f8-44a0-9de6-cede4c2d9a49 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:48.926215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d126a-737e-4900-a1e5-ab41ce5b92df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:48.926844 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d126a-737e-4900-a1e5-ab41ce5b92df service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:48.927129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d126a-737e-4900-a1e5-ab41ce5b92df service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:48.927402 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d126a-737e-4900-a1e5-ab41ce5b92df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.936228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d126a-737e-4900-a1e5-ab41ce5b92df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:48.937659 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d126a-737e-4900-a1e5-ab41ce5b92df service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:48.947499 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 767/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:52.785034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd73164-9c69-4571-82a8-9768a3827006 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:52.785587 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd73164-9c69-4571-82a8-9768a3827006 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:52.785587 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd73164-9c69-4571-82a8-9768a3827006 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:52.786970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:54:52.792347 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7795-e475-46b8-abce-90567ed6ffca None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:52.792755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7795-e475-46b8-abce-90567ed6ffca None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:52.792855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7795-e475-46b8-abce-90567ed6ffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:52.812522 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-4b4e7795-e475-46b8-abce-90567ed6ffca None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:52.813711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4b4e7795-e475-46b8-abce-90567ed6ffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:52.822156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:53.094429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd73164-9c69-4571-82a8-9768a3827006 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:53.096127 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9bd73164-9c69-4571-82a8-9768a3827006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:53.152777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd73164-9c69-4571-82a8-9768a3827006 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:53.156362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f645ba4-de9e-495e-8f32-a5ca041b2c08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:53.156998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f645ba4-de9e-495e-8f32-a5ca041b2c08 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:53.157283 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f645ba4-de9e-495e-8f32-a5ca041b2c08 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:53.157558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f645ba4-de9e-495e-8f32-a5ca041b2c08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:53.166285 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f645ba4-de9e-495e-8f32-a5ca041b2c08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:53.167834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f645ba4-de9e-495e-8f32-a5ca041b2c08 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:53.177458 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 768/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:55.417172 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b71f2-cc83-4a9b-990c-dd1ae09a1ec5 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:55.417700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b71f2-cc83-4a9b-990c-dd1ae09a1ec5 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:55.417700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b71f2-cc83-4a9b-990c-dd1ae09a1ec5 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:55.419122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:54:55.424487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2426e5-eff4-41e3-98c2-fcab6eac508e None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:55.424950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2426e5-eff4-41e3-98c2-fcab6eac508e None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:55.425071 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2426e5-eff4-41e3-98c2-fcab6eac508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:55.443048 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-7a2426e5-eff4-41e3-98c2-fcab6eac508e None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:55.449172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-7a2426e5-eff4-41e3-98c2-fcab6eac508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:55.452112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:55.722139 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b71f2-cc83-4a9b-990c-dd1ae09a1ec5 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:55.723822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9b1b71f2-cc83-4a9b-990c-dd1ae09a1ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:55.736514 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b71f2-cc83-4a9b-990c-dd1ae09a1ec5 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:55.739992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f49c1-698d-465b-83ac-1728b82a3e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:55.740604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f49c1-698d-465b-83ac-1728b82a3e17 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:55.740883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f49c1-698d-465b-83ac-1728b82a3e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:55.741151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f49c1-698d-465b-83ac-1728b82a3e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:55.749790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f49c1-698d-465b-83ac-1728b82a3e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:55.751201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f49c1-698d-465b-83ac-1728b82a3e17 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:55.761039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 770/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:05.437596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=32 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:05.756904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=33 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:36.608300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f60f-58c9-48f7-814f-bb93b66e5b08 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:36.608916 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f60f-58c9-48f7-814f-bb93b66e5b08 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:36.608916 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f60f-58c9-48f7-814f-bb93b66e5b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:36.621516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86d78c-767e-4538-8f81-45b75886a9b0 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:36.622124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86d78c-767e-4538-8f81-45b75886a9b0 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:36.622124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86d78c-767e-4538-8f81-45b75886a9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:36.651301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-b499f60f-58c9-48f7-814f-bb93b66e5b08 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:36.652238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-bc86d78c-767e-4538-8f81-45b75886a9b0 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:36.652545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b499f60f-58c9-48f7-814f-bb93b66e5b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:36.653426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-bc86d78c-767e-4538-8f81-45b75886a9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:36.671170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 771/1540] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:56:36.672885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 770/1541] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:56:36.681087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8f9cc-ed94-408f-b04d-de9d904b80a1 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:36.681388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8f9cc-ed94-408f-b04d-de9d904b80a1 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:36.681657 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8f9cc-ed94-408f-b04d-de9d904b80a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:36.682081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5ec3b-55df-4ff1-9b7b-f96fd451b834 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:36.682378 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5ec3b-55df-4ff1-9b7b-f96fd451b834 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:36.682657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5ec3b-55df-4ff1-9b7b-f96fd451b834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:36.709702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-4cb5ec3b-55df-4ff1-9b7b-f96fd451b834 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:36.710908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4cb5ec3b-55df-4ff1-9b7b-f96fd451b834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:36.715696 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-40f8f9cc-ed94-408f-b04d-de9d904b80a1 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:36.716886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-40f8f9cc-ed94-408f-b04d-de9d904b80a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:36.727556 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 771/1542] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:56:36.728787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9d442-cd0f-4345-a337-d87ab09d96f8 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:36.732160 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9d442-cd0f-4345-a337-d87ab09d96f8 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:36.732466 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9d442-cd0f-4345-a337-d87ab09d96f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:36.739658 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 772/1543] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:36.740634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8f9cc-ed94-408f-b04d-de9d904b80a1 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:36.763308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-40e9d442-cd0f-4345-a337-d87ab09d96f8 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:36.764543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-40e9d442-cd0f-4345-a337-d87ab09d96f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:36.765767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8f9cc-ed94-408f-b04d-de9d904b80a1 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:36.776741 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 772/1544] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:36.777645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9d442-cd0f-4345-a337-d87ab09d96f8 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:36.786728 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eca04a-6bcb-4839-a4c4-5faa71586ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:36.787420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eca04a-6bcb-4839-a4c4-5faa71586ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:36.787738 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eca04a-6bcb-4839-a4c4-5faa71586ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:36.788018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eca04a-6bcb-4839-a4c4-5faa71586ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:36.788758 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eca04a-6bcb-4839-a4c4-5faa71586ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:36.789066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eca04a-6bcb-4839-a4c4-5faa71586ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:36.790095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: WARNING py.warnings [None req-92eca04a-6bcb-4839-a4c4-5faa71586ed5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:56:36.790095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: warnings.warn(msg) Jun 02 13:56:36.790095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: Jun 02 13:56:36.790995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eca04a-6bcb-4839-a4c4-5faa71586ed5 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:36.793909 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9d442-cd0f-4345-a337-d87ab09d96f8 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:36.803324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d679b04-c9da-4cbd-bda8-8738329831af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:36.804147 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d679b04-c9da-4cbd-bda8-8738329831af admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:36.804345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d679b04-c9da-4cbd-bda8-8738329831af admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:36.804581 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d679b04-c9da-4cbd-bda8-8738329831af admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:36.805323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d679b04-c9da-4cbd-bda8-8738329831af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:36.805628 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d679b04-c9da-4cbd-bda8-8738329831af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:36.807247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d679b04-c9da-4cbd-bda8-8738329831af admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:36.821645 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 773/1545] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:36.823032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a91ca-047c-426b-af25-818ec1579c32 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:36.823329 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a91ca-047c-426b-af25-818ec1579c32 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:36.823643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a91ca-047c-426b-af25-818ec1579c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:36.827965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 773/1546] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:36.836960 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d679b04-c9da-4cbd-bda8-8738329831af admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:36.849857 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d679b04-c9da-4cbd-bda8-8738329831af admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:36.855377 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-941a91ca-047c-426b-af25-818ec1579c32 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:36.856623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-941a91ca-047c-426b-af25-818ec1579c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:36.860087 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf4126-3dc9-460f-ba47-93153ac46f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:36.860760 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf4126-3dc9-460f-ba47-93153ac46f77 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:36.861046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf4126-3dc9-460f-ba47-93153ac46f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:36.861322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf4126-3dc9-460f-ba47-93153ac46f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:36.862024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf4126-3dc9-460f-ba47-93153ac46f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:36.863046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: WARNING py.warnings [None req-9ccf4126-3dc9-460f-ba47-93153ac46f77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:56:36.863046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: warnings.warn(msg) Jun 02 13:56:36.863046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: Jun 02 13:56:36.868778 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf4126-3dc9-460f-ba47-93153ac46f77 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:36.888503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 774/1547] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:36.889909 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a91ca-047c-426b-af25-818ec1579c32 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:36.905223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a91ca-047c-426b-af25-818ec1579c32 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:36.910640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6efe86-c007-4e2e-96ff-2d8190410900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:36.911582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6efe86-c007-4e2e-96ff-2d8190410900 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:36.912089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6efe86-c007-4e2e-96ff-2d8190410900 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:36.912578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6efe86-c007-4e2e-96ff-2d8190410900 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:36.913499 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6efe86-c007-4e2e-96ff-2d8190410900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:36.915628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6efe86-c007-4e2e-96ff-2d8190410900 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:36.966260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 774/1548] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:36 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:56:36.968029 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa74ac-0531-48e7-8a43-f09aacf84e18 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:36.968723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa74ac-0531-48e7-8a43-f09aacf84e18 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:36.969257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa74ac-0531-48e7-8a43-f09aacf84e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:36.991412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d0aa74ac-0531-48e7-8a43-f09aacf84e18 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:36.992718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d0aa74ac-0531-48e7-8a43-f09aacf84e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:37.049802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 775/1549] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:37.050600 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa74ac-0531-48e7-8a43-f09aacf84e18 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.059405 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa74ac-0531-48e7-8a43-f09aacf84e18 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.065929 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d9945-52f7-42eb-aa16-229f6ebbb8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.066557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d9945-52f7-42eb-aa16-229f6ebbb8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.066836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d9945-52f7-42eb-aa16-229f6ebbb8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.067107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d9945-52f7-42eb-aa16-229f6ebbb8c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.067860 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d9945-52f7-42eb-aa16-229f6ebbb8c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:37.068160 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d9945-52f7-42eb-aa16-229f6ebbb8c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.069757 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d9945-52f7-42eb-aa16-229f6ebbb8c4 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.081764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 776/1550] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:37.082960 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8871db-df08-4c57-a0fb-e921e03db815 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.083247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8871db-df08-4c57-a0fb-e921e03db815 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.083547 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8871db-df08-4c57-a0fb-e921e03db815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.088110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 775/1551] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:36 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:37.088110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fba909-f738-4653-8fb8-435fc40c9d5f None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.088110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fba909-f738-4653-8fb8-435fc40c9d5f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.088110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fba909-f738-4653-8fb8-435fc40c9d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.104875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-dc8871db-df08-4c57-a0fb-e921e03db815 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:37.105057 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-59fba909-f738-4653-8fb8-435fc40c9d5f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:37.106002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-dc8871db-df08-4c57-a0fb-e921e03db815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:37.106131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-59fba909-f738-4653-8fb8-435fc40c9d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:37.165969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 777/1552] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:37.167511 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8871db-df08-4c57-a0fb-e921e03db815 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.167887 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 776/1553] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:37.168375 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d272e-ca88-4e93-bbae-1852b6f2e841 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.168755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d272e-ca88-4e93-bbae-1852b6f2e841 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.169130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d272e-ca88-4e93-bbae-1852b6f2e841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.182672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8871db-df08-4c57-a0fb-e921e03db815 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.188533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774543a-6a4e-4a19-8fa9-ffb28b728bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.189229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774543a-6a4e-4a19-8fa9-ffb28b728bdd admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.189557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774543a-6a4e-4a19-8fa9-ffb28b728bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.189939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774543a-6a4e-4a19-8fa9-ffb28b728bdd admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.190580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-288d272e-ca88-4e93-bbae-1852b6f2e841 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:37.190683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774543a-6a4e-4a19-8fa9-ffb28b728bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.191784 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-288d272e-ca88-4e93-bbae-1852b6f2e841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:37.192668 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774543a-6a4e-4a19-8fa9-ffb28b728bdd admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.199776 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 777/1554] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:37.200976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63a22-6475-4059-8259-6d1393c0971b None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.201256 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63a22-6475-4059-8259-6d1393c0971b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.201537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63a22-6475-4059-8259-6d1393c0971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.219819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-4ba63a22-6475-4059-8259-6d1393c0971b None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:37.220981 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4ba63a22-6475-4059-8259-6d1393c0971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:37.228601 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 778/1555] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:37.229897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92a2d0-a2f1-414d-90a4-8b825b31b97c None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.230173 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92a2d0-a2f1-414d-90a4-8b825b31b97c None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.230529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92a2d0-a2f1-414d-90a4-8b825b31b97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.247737 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-2b92a2d0-a2f1-414d-90a4-8b825b31b97c None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:37.248878 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2b92a2d0-a2f1-414d-90a4-8b825b31b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:37.257377 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 779/1556] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:37.258112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92a2d0-a2f1-414d-90a4-8b825b31b97c None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.267675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92a2d0-a2f1-414d-90a4-8b825b31b97c None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.272104 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50d9c1-9864-415e-bb17-c05231f1acb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.272744 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50d9c1-9864-415e-bb17-c05231f1acb1 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.273023 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50d9c1-9864-415e-bb17-c05231f1acb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.273293 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50d9c1-9864-415e-bb17-c05231f1acb1 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.273967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50d9c1-9864-415e-bb17-c05231f1acb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.274967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: WARNING py.warnings [None req-ee50d9c1-9864-415e-bb17-c05231f1acb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:56:37.274967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: warnings.warn(msg) Jun 02 13:56:37.274967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: Jun 02 13:56:37.276309 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50d9c1-9864-415e-bb17-c05231f1acb1 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.374138 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 778/1557] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:37.374877 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774543a-6a4e-4a19-8fa9-ffb28b728bdd admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.385356 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774543a-6a4e-4a19-8fa9-ffb28b728bdd admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.389932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d65ac-4015-4a27-90d3-0355eb70121e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.390554 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d65ac-4015-4a27-90d3-0355eb70121e admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.390840 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d65ac-4015-4a27-90d3-0355eb70121e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.391146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d65ac-4015-4a27-90d3-0355eb70121e admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.391857 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d65ac-4015-4a27-90d3-0355eb70121e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.393749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d65ac-4015-4a27-90d3-0355eb70121e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.408102 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:37.419736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 780/1558] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:37.421003 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4689879-bb67-454b-9b47-ca7406085651 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.423103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4689879-bb67-454b-9b47-ca7406085651 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.423103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4689879-bb67-454b-9b47-ca7406085651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.439768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f4689879-bb67-454b-9b47-ca7406085651 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:37.441002 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f4689879-bb67-454b-9b47-ca7406085651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:37.448865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 781/1559] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:37.450266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c724-c5f0-4f71-b70a-5c73c1e163bf None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.450555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c724-c5f0-4f71-b70a-5c73c1e163bf None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.450832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c724-c5f0-4f71-b70a-5c73c1e163bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.468260 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-0069c724-c5f0-4f71-b70a-5c73c1e163bf None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:37.469432 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0069c724-c5f0-4f71-b70a-5c73c1e163bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:37.477171 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 782/1560] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:37.478488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e3f02-aa7f-4768-8e97-e8f43f6d8225 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.478783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e3f02-aa7f-4768-8e97-e8f43f6d8225 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.479065 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e3f02-aa7f-4768-8e97-e8f43f6d8225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.496507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-234e3f02-aa7f-4768-8e97-e8f43f6d8225 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:37.500144 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-234e3f02-aa7f-4768-8e97-e8f43f6d8225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:37.505825 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 783/1561] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:37.507145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96710f-4dc4-4aea-88db-932d2e7ad3d6 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.507418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96710f-4dc4-4aea-88db-932d2e7ad3d6 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.507727 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96710f-4dc4-4aea-88db-932d2e7ad3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.525691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-3b96710f-4dc4-4aea-88db-932d2e7ad3d6 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:37.526848 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3b96710f-4dc4-4aea-88db-932d2e7ad3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:37.533050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 779/1562] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:37.533870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d65ac-4015-4a27-90d3-0355eb70121e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.534925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 784/1563] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:37.535631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96710f-4dc4-4aea-88db-932d2e7ad3d6 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.545303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96710f-4dc4-4aea-88db-932d2e7ad3d6 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.588008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:37.604685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451388d-89c9-4cb6-88b5-8135f0de49b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.605351 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451388d-89c9-4cb6-88b5-8135f0de49b0 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.605635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451388d-89c9-4cb6-88b5-8135f0de49b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.605910 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451388d-89c9-4cb6-88b5-8135f0de49b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.606642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451388d-89c9-4cb6-88b5-8135f0de49b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.606940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d65ac-4015-4a27-90d3-0355eb70121e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.608277 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451388d-89c9-4cb6-88b5-8135f0de49b0 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.612304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223cb9c-0329-4ab6-a244-581dca41a500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.612969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223cb9c-0329-4ab6-a244-581dca41a500 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.613251 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223cb9c-0329-4ab6-a244-581dca41a500 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.613532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223cb9c-0329-4ab6-a244-581dca41a500 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.614258 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223cb9c-0329-4ab6-a244-581dca41a500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:37.614560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223cb9c-0329-4ab6-a244-581dca41a500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.616184 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223cb9c-0329-4ab6-a244-581dca41a500 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.618536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 785/1564] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:37.619330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451388d-89c9-4cb6-88b5-8135f0de49b0 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.629047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451388d-89c9-4cb6-88b5-8135f0de49b0 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.630678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 780/1565] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:37.631520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223cb9c-0329-4ab6-a244-581dca41a500 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.633891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ba347-74c9-41cb-994c-b1afc78f4ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.637855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ba347-74c9-41cb-994c-b1afc78f4ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.637855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ba347-74c9-41cb-994c-b1afc78f4ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.637855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ba347-74c9-41cb-994c-b1afc78f4ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.637855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ba347-74c9-41cb-994c-b1afc78f4ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.637855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ba347-74c9-41cb-994c-b1afc78f4ac1 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.642930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223cb9c-0329-4ab6-a244-581dca41a500 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.648120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcc5fa-3e40-4189-80bd-aa040915b251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.648321 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 786/1566] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:37.649082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ba347-74c9-41cb-994c-b1afc78f4ac1 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.651602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcc5fa-3e40-4189-80bd-aa040915b251 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.651896 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcc5fa-3e40-4189-80bd-aa040915b251 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.652307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcc5fa-3e40-4189-80bd-aa040915b251 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.653047 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcc5fa-3e40-4189-80bd-aa040915b251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:37.653387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcc5fa-3e40-4189-80bd-aa040915b251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.655017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcc5fa-3e40-4189-80bd-aa040915b251 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.660336 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ba347-74c9-41cb-994c-b1afc78f4ac1 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.664835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13c4bf-47d6-4de3-b2cb-16b42354a96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.665471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13c4bf-47d6-4de3-b2cb-16b42354a96a admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.665758 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13c4bf-47d6-4de3-b2cb-16b42354a96a admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.666039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13c4bf-47d6-4de3-b2cb-16b42354a96a admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.666740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13c4bf-47d6-4de3-b2cb-16b42354a96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:37.667041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13c4bf-47d6-4de3-b2cb-16b42354a96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.668651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13c4bf-47d6-4de3-b2cb-16b42354a96a admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.669086 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 781/1567] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:37.669701 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcc5fa-3e40-4189-80bd-aa040915b251 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.688160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 787/1568] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:37.688160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13c4bf-47d6-4de3-b2cb-16b42354a96a admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.688466 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcc5fa-3e40-4189-80bd-aa040915b251 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.691323 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13c4bf-47d6-4de3-b2cb-16b42354a96a admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.691598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbcef6-e851-4483-bdcb-49ef90f122f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.692300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbcef6-e851-4483-bdcb-49ef90f122f6 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.692587 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbcef6-e851-4483-bdcb-49ef90f122f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.692869 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbcef6-e851-4483-bdcb-49ef90f122f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.693764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbcef6-e851-4483-bdcb-49ef90f122f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:37.694074 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbcef6-e851-4483-bdcb-49ef90f122f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.695867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbcef6-e851-4483-bdcb-49ef90f122f6 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.696052 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87400f7-f218-4f35-bd09-3387c27571c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.696734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87400f7-f218-4f35-bd09-3387c27571c0 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.697048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87400f7-f218-4f35-bd09-3387c27571c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.697445 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87400f7-f218-4f35-bd09-3387c27571c0 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.698134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87400f7-f218-4f35-bd09-3387c27571c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.700097 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87400f7-f218-4f35-bd09-3387c27571c0 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.707425 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 782/1569] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:37.708336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbcef6-e851-4483-bdcb-49ef90f122f6 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.717665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbcef6-e851-4483-bdcb-49ef90f122f6 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.722738 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1466f2-6270-4a3b-8632-c3ef4b30f1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.729326 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1466f2-6270-4a3b-8632-c3ef4b30f1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.729326 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1466f2-6270-4a3b-8632-c3ef4b30f1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.729326 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1466f2-6270-4a3b-8632-c3ef4b30f1b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.729326 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1466f2-6270-4a3b-8632-c3ef4b30f1b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:37.729326 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1466f2-6270-4a3b-8632-c3ef4b30f1b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.729326 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1466f2-6270-4a3b-8632-c3ef4b30f1b8 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.738842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 783/1570] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:37.739772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1466f2-6270-4a3b-8632-c3ef4b30f1b8 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.748938 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1466f2-6270-4a3b-8632-c3ef4b30f1b8 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.753453 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ac14e-3f7d-40e9-991a-880dc1a85d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.757950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ac14e-3f7d-40e9-991a-880dc1a85d20 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.757950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ac14e-3f7d-40e9-991a-880dc1a85d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.757950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ac14e-3f7d-40e9-991a-880dc1a85d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.757950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ac14e-3f7d-40e9-991a-880dc1a85d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.757950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ac14e-3f7d-40e9-991a-880dc1a85d20 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.766808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 784/1571] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:37.767724 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ac14e-3f7d-40e9-991a-880dc1a85d20 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.776804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ac14e-3f7d-40e9-991a-880dc1a85d20 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.781475 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd27ef-45cf-459d-b066-193c02aa0bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.782608 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd27ef-45cf-459d-b066-193c02aa0bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.782909 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd27ef-45cf-459d-b066-193c02aa0bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.783169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd27ef-45cf-459d-b066-193c02aa0bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.783918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 788/1572] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:37.784033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd27ef-45cf-459d-b066-193c02aa0bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.784923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87400f7-f218-4f35-bd09-3387c27571c0 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.785864 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd27ef-45cf-459d-b066-193c02aa0bd2 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.795904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87400f7-f218-4f35-bd09-3387c27571c0 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.802283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca8894-51d7-4c07-b920-a07b135f39ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.802283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca8894-51d7-4c07-b920-a07b135f39ed admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.802283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca8894-51d7-4c07-b920-a07b135f39ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.802283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca8894-51d7-4c07-b920-a07b135f39ed admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.803007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca8894-51d7-4c07-b920-a07b135f39ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.804640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca8894-51d7-4c07-b920-a07b135f39ed admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.814408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 789/1573] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:37.815154 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca8894-51d7-4c07-b920-a07b135f39ed admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.826453 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca8894-51d7-4c07-b920-a07b135f39ed admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.831021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12665066-cc26-4359-9267-0597a1921718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.831655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12665066-cc26-4359-9267-0597a1921718 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.831940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12665066-cc26-4359-9267-0597a1921718 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.832216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12665066-cc26-4359-9267-0597a1921718 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.832875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12665066-cc26-4359-9267-0597a1921718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.834715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12665066-cc26-4359-9267-0597a1921718 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.883384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 785/1574] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:37.884159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd27ef-45cf-459d-b066-193c02aa0bd2 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:37.944599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd27ef-45cf-459d-b066-193c02aa0bd2 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:37.949131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3ff62-c639-4070-b93a-649b2042e8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:37.949773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3ff62-c639-4070-b93a-649b2042e8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:37.950053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3ff62-c639-4070-b93a-649b2042e8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:37.950326 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3ff62-c639-4070-b93a-649b2042e8c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:37.950998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3ff62-c639-4070-b93a-649b2042e8c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:37.952918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3ff62-c639-4070-b93a-649b2042e8c3 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:37.963935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 790/1575] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:37.964892 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12665066-cc26-4359-9267-0597a1921718 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:38.024961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12665066-cc26-4359-9267-0597a1921718 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:38.029511 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb4a13-6e5d-48a7-bddf-7a5f66d087b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:38.033835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb4a13-6e5d-48a7-bddf-7a5f66d087b0 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:38.033835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb4a13-6e5d-48a7-bddf-7a5f66d087b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:38.033835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb4a13-6e5d-48a7-bddf-7a5f66d087b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:38.033835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb4a13-6e5d-48a7-bddf-7a5f66d087b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:38.033835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb4a13-6e5d-48a7-bddf-7a5f66d087b0 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:38.055167 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:38.061554 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 786/1576] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/projects => generated 393 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:38.065016 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3ff62-c639-4070-b93a-649b2042e8c3 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:38.122321 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3ff62-c639-4070-b93a-649b2042e8c3 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:38.127234 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0035b-0c32-4bbe-b1f0-92603d0ada41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:38.127956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0035b-0c32-4bbe-b1f0-92603d0ada41 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:38.128234 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0035b-0c32-4bbe-b1f0-92603d0ada41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:38.128513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0035b-0c32-4bbe-b1f0-92603d0ada41 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:38.129270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0035b-0c32-4bbe-b1f0-92603d0ada41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:38.131363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0035b-0c32-4bbe-b1f0-92603d0ada41 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:38.133493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 791/1577] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:37 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:38.134278 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb4a13-6e5d-48a7-bddf-7a5f66d087b0 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:38.182108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:38.194795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb4a13-6e5d-48a7-bddf-7a5f66d087b0 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:38.199386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26db7e5-ea56-4b26-bfe1-ce026cd941d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:38.200306 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26db7e5-ea56-4b26-bfe1-ce026cd941d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:38.200590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26db7e5-ea56-4b26-bfe1-ce026cd941d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:38.200869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26db7e5-ea56-4b26-bfe1-ce026cd941d7 admin admin] PATH_INFO: `/v3/projects/261283c8e8c4447b96e01502e6923d7d/users/39779aae74b443d1b91d707936fc1046/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:38.215081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26db7e5-ea56-4b26-bfe1-ce026cd941d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261283c8e8c4447b96e01502e6923d7d, user_id=39779aae74b443d1b91d707936fc1046, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:38.217777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26db7e5-ea56-4b26-bfe1-ce026cd941d7 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:38.249682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 787/1578] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:38 2022] POST /identity/v3/projects => generated 363 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:38.250544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0035b-0c32-4bbe-b1f0-92603d0ada41 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:38.311567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0035b-0c32-4bbe-b1f0-92603d0ada41 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:38.311977 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 792/1579] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:38 2022] PUT /identity/v3/projects/261283c8e8c4447b96e01502e6923d7d/users/39779aae74b443d1b91d707936fc1046/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:38.312849 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26db7e5-ea56-4b26-bfe1-ce026cd941d7 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:38.374049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5440ef6-0467-4650-a133-36a149bcc921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:38.374721 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5440ef6-0467-4650-a133-36a149bcc921 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:38.375005 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5440ef6-0467-4650-a133-36a149bcc921 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:38.375804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5440ef6-0467-4650-a133-36a149bcc921 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:38.376537 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5440ef6-0467-4650-a133-36a149bcc921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:38.378142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5440ef6-0467-4650-a133-36a149bcc921 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:38.381459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26db7e5-ea56-4b26-bfe1-ce026cd941d7 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:38.386675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7824ee-6cb3-4af6-9a1d-aa1617ee5473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:38.387507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7824ee-6cb3-4af6-9a1d-aa1617ee5473 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:38.387797 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7824ee-6cb3-4af6-9a1d-aa1617ee5473 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:38.388080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7824ee-6cb3-4af6-9a1d-aa1617ee5473 admin admin] PATH_INFO: `/v3/projects/138e1aa5e47542a0b8716574d7a5c9f6/users/41064a325b0a4942be8b72bf140c462b/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:38.388217 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 788/1580] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:38.388975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5440ef6-0467-4650-a133-36a149bcc921 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:38.400521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5440ef6-0467-4650-a133-36a149bcc921 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:38.405080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbfb7a-8fe4-4557-b19b-846056e32c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:38.405726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbfb7a-8fe4-4557-b19b-846056e32c1e admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:38.405864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7824ee-6cb3-4af6-9a1d-aa1617ee5473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=138e1aa5e47542a0b8716574d7a5c9f6, user_id=41064a325b0a4942be8b72bf140c462b, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:38.406012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbfb7a-8fe4-4557-b19b-846056e32c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:38.406282 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbfb7a-8fe4-4557-b19b-846056e32c1e admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:38.406954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbfb7a-8fe4-4557-b19b-846056e32c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:38.408582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7824ee-6cb3-4af6-9a1d-aa1617ee5473 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:38.408872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbfb7a-8fe4-4557-b19b-846056e32c1e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:38.517241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 793/1581] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:38 2022] PUT /identity/v3/projects/138e1aa5e47542a0b8716574d7a5c9f6/users/41064a325b0a4942be8b72bf140c462b/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:38.518035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7824ee-6cb3-4af6-9a1d-aa1617ee5473 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:38.569011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 789/1582] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:38 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:38.569819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbfb7a-8fe4-4557-b19b-846056e32c1e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:38.578037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7824ee-6cb3-4af6-9a1d-aa1617ee5473 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:38.579696 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbfb7a-8fe4-4557-b19b-846056e32c1e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:38.583443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28195ff4-b4e4-4ed9-a915-993e414adfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:38.584158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28195ff4-b4e4-4ed9-a915-993e414adfa9 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:38.584270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cd151-f0be-452c-8f42-52725c512e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:38.584558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28195ff4-b4e4-4ed9-a915-993e414adfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:38.584876 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cd151-f0be-452c-8f42-52725c512e90 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:38.584984 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28195ff4-b4e4-4ed9-a915-993e414adfa9 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:38.585250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cd151-f0be-452c-8f42-52725c512e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:38.585529 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cd151-f0be-452c-8f42-52725c512e90 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:38.585637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28195ff4-b4e4-4ed9-a915-993e414adfa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:38.586232 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cd151-f0be-452c-8f42-52725c512e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:38.587537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28195ff4-b4e4-4ed9-a915-993e414adfa9 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:38.588166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cd151-f0be-452c-8f42-52725c512e90 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:38.597376 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:38.728152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 794/1583] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:38 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:38.728749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 790/1584] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:38 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:38.729116 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28195ff4-b4e4-4ed9-a915-993e414adfa9 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:38.729232 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cd151-f0be-452c-8f42-52725c512e90 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:38.739813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28195ff4-b4e4-4ed9-a915-993e414adfa9 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:38.740142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cd151-f0be-452c-8f42-52725c512e90 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:38.744608 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bde42e-c901-4a54-9feb-632e99f07f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:38.744759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f97a57-d6db-437e-b8df-0ab474b4ea68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:38.745265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bde42e-c901-4a54-9feb-632e99f07f34 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:38.745398 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f97a57-d6db-437e-b8df-0ab474b4ea68 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:38.745551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bde42e-c901-4a54-9feb-632e99f07f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:38.745661 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f97a57-d6db-437e-b8df-0ab474b4ea68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:38.745826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f97a57-d6db-437e-b8df-0ab474b4ea68 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:38.745933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bde42e-c901-4a54-9feb-632e99f07f34 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:38.746504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f97a57-d6db-437e-b8df-0ab474b4ea68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:38.746602 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bde42e-c901-4a54-9feb-632e99f07f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:38.748463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f97a57-d6db-437e-b8df-0ab474b4ea68 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:38.748574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bde42e-c901-4a54-9feb-632e99f07f34 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:38.853547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 795/1585] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:38 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:38.854827 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464e2e9-4424-4a8f-ab8f-4a57de638b27 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:38.855119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464e2e9-4424-4a8f-ab8f-4a57de638b27 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:38.855432 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464e2e9-4424-4a8f-ab8f-4a57de638b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:38.876679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 791/1586] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:38 2022] POST /identity/v3/users => generated 282 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:38.877713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f97a57-d6db-437e-b8df-0ab474b4ea68 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:38.882815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f464e2e9-4424-4a8f-ab8f-4a57de638b27 None None] MFA Rules not processed for user `39779aae74b443d1b91d707936fc1046`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:38.884036 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f464e2e9-4424-4a8f-ab8f-4a57de638b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:38.887914 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f97a57-d6db-437e-b8df-0ab474b4ea68 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:38.893380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f738e5e-6a71-4fa8-9ae2-937bab77be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:38.894437 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738e5e-6a71-4fa8-9ae2-937bab77be56 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:38.894437 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738e5e-6a71-4fa8-9ae2-937bab77be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:38.894660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738e5e-6a71-4fa8-9ae2-937bab77be56 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:38.895343 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f738e5e-6a71-4fa8-9ae2-937bab77be56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:38.896970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f738e5e-6a71-4fa8-9ae2-937bab77be56 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:38.897994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:38.908067 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 792/1587] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:38.909425 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9071-6bee-4b88-9c57-4b725865e2c8 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:38.909846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9071-6bee-4b88-9c57-4b725865e2c8 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:38.910220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9071-6bee-4b88-9c57-4b725865e2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:38.935375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-9bff9071-6bee-4b88-9c57-4b725865e2c8 None None] MFA Rules not processed for user `41064a325b0a4942be8b72bf140c462b`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:38.936593 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9bff9071-6bee-4b88-9c57-4b725865e2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:38.952141 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 796/1588] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:38.952976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464e2e9-4424-4a8f-ab8f-4a57de638b27 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:38.965757 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464e2e9-4424-4a8f-ab8f-4a57de638b27 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:38.972376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220272bf-6b18-4ba9-b3c7-d45a635740c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:38.973044 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220272bf-6b18-4ba9-b3c7-d45a635740c7 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:38.973328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220272bf-6b18-4ba9-b3c7-d45a635740c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:38.973603 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220272bf-6b18-4ba9-b3c7-d45a635740c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:38.974328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220272bf-6b18-4ba9-b3c7-d45a635740c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:38.976059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220272bf-6b18-4ba9-b3c7-d45a635740c7 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:38.986390 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 797/1589] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:38.987138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220272bf-6b18-4ba9-b3c7-d45a635740c7 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:38.997209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220272bf-6b18-4ba9-b3c7-d45a635740c7 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.001742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f61346-245a-4b6c-9e23-08b5f51482a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.002405 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f61346-245a-4b6c-9e23-08b5f51482a5 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.002656 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f61346-245a-4b6c-9e23-08b5f51482a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.002935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f61346-245a-4b6c-9e23-08b5f51482a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.003681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f61346-245a-4b6c-9e23-08b5f51482a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.005264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f61346-245a-4b6c-9e23-08b5f51482a5 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.010205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 793/1590] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:39.011113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff9071-6bee-4b88-9c57-4b725865e2c8 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.016831 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 798/1591] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:39.017555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f61346-245a-4b6c-9e23-08b5f51482a5 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.023669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff9071-6bee-4b88-9c57-4b725865e2c8 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.027735 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f61346-245a-4b6c-9e23-08b5f51482a5 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.028586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef43b45-6e5d-4c14-b9f7-9529a371878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.031106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef43b45-6e5d-4c14-b9f7-9529a371878e admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.031106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef43b45-6e5d-4c14-b9f7-9529a371878e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.031106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef43b45-6e5d-4c14-b9f7-9529a371878e admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.031106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef43b45-6e5d-4c14-b9f7-9529a371878e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.032856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef43b45-6e5d-4c14-b9f7-9529a371878e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.033480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9aa47-baad-419e-9904-48a51da86c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.034322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9aa47-baad-419e-9904-48a51da86c67 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.034607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9aa47-baad-419e-9904-48a51da86c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.034885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9aa47-baad-419e-9904-48a51da86c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.035760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9aa47-baad-419e-9904-48a51da86c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.037470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9aa47-baad-419e-9904-48a51da86c67 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.044525 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 794/1592] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:39.045352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef43b45-6e5d-4c14-b9f7-9529a371878e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.049209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 799/1593] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:39.049989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9aa47-baad-419e-9904-48a51da86c67 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.057016 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef43b45-6e5d-4c14-b9f7-9529a371878e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.059178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9aa47-baad-419e-9904-48a51da86c67 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.061839 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aff8c5-b5a7-4c39-8eae-c3f97ea91c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.062378 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aff8c5-b5a7-4c39-8eae-c3f97ea91c8e admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.062666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aff8c5-b5a7-4c39-8eae-c3f97ea91c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.062966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aff8c5-b5a7-4c39-8eae-c3f97ea91c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.063723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aff8c5-b5a7-4c39-8eae-c3f97ea91c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.064133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dd1d5-bc40-4216-a47c-14dbf3e8a8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.064994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dd1d5-bc40-4216-a47c-14dbf3e8a8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.065276 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dd1d5-bc40-4216-a47c-14dbf3e8a8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.065389 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aff8c5-b5a7-4c39-8eae-c3f97ea91c8e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.065542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dd1d5-bc40-4216-a47c-14dbf3e8a8a0 admin admin] PATH_INFO: `/v3/projects/32f862664b384d49a489ecaf52844577/users/199a0c82abd34b5f88063d79d89da19d/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.075756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 795/1594] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:39.081651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13683c5f-1e5b-48b7-ab30-057e8b2ee20e None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.081818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3dd1d5-bc40-4216-a47c-14dbf3e8a8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f862664b384d49a489ecaf52844577, user_id=199a0c82abd34b5f88063d79d89da19d, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.081932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13683c5f-1e5b-48b7-ab30-057e8b2ee20e None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.082212 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13683c5f-1e5b-48b7-ab30-057e8b2ee20e None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.083549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 796/1595] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 2 13:56:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:56:39.084303 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13683c5f-1e5b-48b7-ab30-057e8b2ee20e None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.084544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3dd1d5-bc40-4216-a47c-14dbf3e8a8a0 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.097656 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13683c5f-1e5b-48b7-ab30-057e8b2ee20e None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.102122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac55348-98f5-48fd-8c93-3e4f93ac20da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.102741 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac55348-98f5-48fd-8c93-3e4f93ac20da admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.103046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac55348-98f5-48fd-8c93-3e4f93ac20da admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.103361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac55348-98f5-48fd-8c93-3e4f93ac20da admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.104156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac55348-98f5-48fd-8c93-3e4f93ac20da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.105763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac55348-98f5-48fd-8c93-3e4f93ac20da admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.116213 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 797/1596] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:39.117101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac55348-98f5-48fd-8c93-3e4f93ac20da admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.126992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac55348-98f5-48fd-8c93-3e4f93ac20da admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.131491 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0b99f-2923-40a2-8cf2-4822fada4fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.132239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0b99f-2923-40a2-8cf2-4822fada4fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.132520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0b99f-2923-40a2-8cf2-4822fada4fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.132791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0b99f-2923-40a2-8cf2-4822fada4fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.133452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0b99f-2923-40a2-8cf2-4822fada4fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.135579 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0b99f-2923-40a2-8cf2-4822fada4fe4 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.146223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 800/1597] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:39 2022] PUT /identity/v3/projects/32f862664b384d49a489ecaf52844577/users/199a0c82abd34b5f88063d79d89da19d/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:39.150875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dd1d5-bc40-4216-a47c-14dbf3e8a8a0 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.211439 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dd1d5-bc40-4216-a47c-14dbf3e8a8a0 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.216241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f2919-8fe3-457b-bc62-c65c53b60168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.216900 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f2919-8fe3-457b-bc62-c65c53b60168 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.217188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f2919-8fe3-457b-bc62-c65c53b60168 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.217485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f2919-8fe3-457b-bc62-c65c53b60168 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.218207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f2919-8fe3-457b-bc62-c65c53b60168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.219881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f2919-8fe3-457b-bc62-c65c53b60168 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.229906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 801/1598] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:39.230767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f2919-8fe3-457b-bc62-c65c53b60168 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.235072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 798/1599] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:39 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:39.235072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0b99f-2923-40a2-8cf2-4822fada4fe4 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.240949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f2919-8fe3-457b-bc62-c65c53b60168 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.295737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0b99f-2923-40a2-8cf2-4822fada4fe4 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.298421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:39.300954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d592429-11f4-46af-9b63-3500bae08507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.301619 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d592429-11f4-46af-9b63-3500bae08507 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.301906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d592429-11f4-46af-9b63-3500bae08507 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.302181 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d592429-11f4-46af-9b63-3500bae08507 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.302903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d592429-11f4-46af-9b63-3500bae08507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.304557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d592429-11f4-46af-9b63-3500bae08507 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.304951 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9caef-858f-4edd-87f2-2b1a7f12848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.305627 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9caef-858f-4edd-87f2-2b1a7f12848d admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.305915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9caef-858f-4edd-87f2-2b1a7f12848d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.306088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:39.306245 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9caef-858f-4edd-87f2-2b1a7f12848d admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.306969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9caef-858f-4edd-87f2-2b1a7f12848d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.308584 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9caef-858f-4edd-87f2-2b1a7f12848d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.316148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 799/1600] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:39.316906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d592429-11f4-46af-9b63-3500bae08507 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.322929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 802/1601] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:39.322929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5414d3-fd72-46c3-82d2-c90c6cc31e3b None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.322929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5414d3-fd72-46c3-82d2-c90c6cc31e3b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.322929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5414d3-fd72-46c3-82d2-c90c6cc31e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.326381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d592429-11f4-46af-9b63-3500bae08507 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.331590 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03379f68-f5cc-4b8f-96ae-f263c3d20880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.332308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03379f68-f5cc-4b8f-96ae-f263c3d20880 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.332526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03379f68-f5cc-4b8f-96ae-f263c3d20880 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.332804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03379f68-f5cc-4b8f-96ae-f263c3d20880 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.333528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03379f68-f5cc-4b8f-96ae-f263c3d20880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.335129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03379f68-f5cc-4b8f-96ae-f263c3d20880 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.341965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-3b5414d3-fd72-46c3-82d2-c90c6cc31e3b None None] MFA Rules not processed for user `b9971f2bf0f2400b90168f6032a0e226`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:39.343164 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3b5414d3-fd72-46c3-82d2-c90c6cc31e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:39.345850 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 800/1602] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:39.346696 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03379f68-f5cc-4b8f-96ae-f263c3d20880 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.357749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03379f68-f5cc-4b8f-96ae-f263c3d20880 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.363008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd56e3-2499-40a1-8b5a-d8609059787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.363903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd56e3-2499-40a1-8b5a-d8609059787f admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.370582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd56e3-2499-40a1-8b5a-d8609059787f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.370582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd56e3-2499-40a1-8b5a-d8609059787f admin admin] PATH_INFO: `/v3/projects/422c5c55bb85401a8c506931f222f566/users/f1c5a9040ded4bafbcd926c00eb7e9e0/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.379035 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd56e3-2499-40a1-8b5a-d8609059787f admin admin] RBAC: Authorizing `identity:create_grant(project_id=422c5c55bb85401a8c506931f222f566, user_id=f1c5a9040ded4bafbcd926c00eb7e9e0, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.380114 dv-cinder-826510-6-smb devstack@keystone.service[92272]: WARNING py.warnings [None req-9fdd56e3-2499-40a1-8b5a-d8609059787f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:56:39.380114 dv-cinder-826510-6-smb devstack@keystone.service[92272]: warnings.warn(msg) Jun 02 13:56:39.380114 dv-cinder-826510-6-smb devstack@keystone.service[92272]: Jun 02 13:56:39.382040 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd56e3-2499-40a1-8b5a-d8609059787f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.410404 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 803/1603] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 2 13:56:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:39.411735 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21d174-1b18-4d09-aa82-f006a7de677f None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.412399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21d174-1b18-4d09-aa82-f006a7de677f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.412684 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21d174-1b18-4d09-aa82-f006a7de677f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.429668 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-dd21d174-1b18-4d09-aa82-f006a7de677f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:39.430892 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-dd21d174-1b18-4d09-aa82-f006a7de677f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:39.438990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 804/1604] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:39.440321 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21d174-1b18-4d09-aa82-f006a7de677f None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.449768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21d174-1b18-4d09-aa82-f006a7de677f None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.455027 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d4f23-3d3a-4c47-bffc-90aafeeeabcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.455994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d4f23-3d3a-4c47-bffc-90aafeeeabcd admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.456281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d4f23-3d3a-4c47-bffc-90aafeeeabcd admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.456558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d4f23-3d3a-4c47-bffc-90aafeeeabcd admin admin] PATH_INFO: `/v3/projects/d3e081cce4504edaa2ab083c5f2a82d4/users/b839f3c96b7d4893ae4a7500865ad760/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.470945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d4f23-3d3a-4c47-bffc-90aafeeeabcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e081cce4504edaa2ab083c5f2a82d4, user_id=b839f3c96b7d4893ae4a7500865ad760, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.473665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d4f23-3d3a-4c47-bffc-90aafeeeabcd admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.474757 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 801/1605] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:39 2022] PUT /identity/v3/projects/422c5c55bb85401a8c506931f222f566/users/f1c5a9040ded4bafbcd926c00eb7e9e0/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:39.475745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd56e3-2499-40a1-8b5a-d8609059787f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.536219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd56e3-2499-40a1-8b5a-d8609059787f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.540695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ecefa-0359-4ae8-b43e-c38add260d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.541350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ecefa-0359-4ae8-b43e-c38add260d1d admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.541630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ecefa-0359-4ae8-b43e-c38add260d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.541905 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ecefa-0359-4ae8-b43e-c38add260d1d admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.542577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ecefa-0359-4ae8-b43e-c38add260d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.544560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ecefa-0359-4ae8-b43e-c38add260d1d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.551589 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 805/1606] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:39 2022] PUT /identity/v3/projects/d3e081cce4504edaa2ab083c5f2a82d4/users/b839f3c96b7d4893ae4a7500865ad760/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:39.555876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d4f23-3d3a-4c47-bffc-90aafeeeabcd admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.615796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d4f23-3d3a-4c47-bffc-90aafeeeabcd admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.620484 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c03342-2b95-49fb-ad86-e7507b8c9031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.621370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c03342-2b95-49fb-ad86-e7507b8c9031 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.621657 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c03342-2b95-49fb-ad86-e7507b8c9031 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.621935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c03342-2b95-49fb-ad86-e7507b8c9031 admin admin] PATH_INFO: `/v3/projects/70c69e86eed54f6d9a4ca49f9cf45ce1/users/8288f45c6eae440fb4b8594b375d6400/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.632261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 802/1607] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:39 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:39.633239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ecefa-0359-4ae8-b43e-c38add260d1d admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.637724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c03342-2b95-49fb-ad86-e7507b8c9031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c69e86eed54f6d9a4ca49f9cf45ce1, user_id=8288f45c6eae440fb4b8594b375d6400, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.640751 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c03342-2b95-49fb-ad86-e7507b8c9031 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.646338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ecefa-0359-4ae8-b43e-c38add260d1d admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.651065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21484f4-0a2f-439d-b8ff-61cedc9fc8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.651979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21484f4-0a2f-439d-b8ff-61cedc9fc8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.652259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21484f4-0a2f-439d-b8ff-61cedc9fc8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.652532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21484f4-0a2f-439d-b8ff-61cedc9fc8e9 admin admin] PATH_INFO: `/v3/projects/ebbcc89541b443218dc2050f96b84196/users/bf2d59ffa0a145e591da7ddb2c25cf44/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.667655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21484f4-0a2f-439d-b8ff-61cedc9fc8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbcc89541b443218dc2050f96b84196, user_id=bf2d59ffa0a145e591da7ddb2c25cf44, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.670304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21484f4-0a2f-439d-b8ff-61cedc9fc8e9 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.777391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 806/1608] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:39 2022] PUT /identity/v3/projects/70c69e86eed54f6d9a4ca49f9cf45ce1/users/8288f45c6eae440fb4b8594b375d6400/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:39.789252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 803/1609] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:39 2022] PUT /identity/v3/projects/ebbcc89541b443218dc2050f96b84196/users/bf2d59ffa0a145e591da7ddb2c25cf44/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:39.789761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c03342-2b95-49fb-ad86-e7507b8c9031 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.789883 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21484f4-0a2f-439d-b8ff-61cedc9fc8e9 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.825988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:39.848646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c03342-2b95-49fb-ad86-e7507b8c9031 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.853379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73be3f-a8b6-400f-a873-e71802820bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.853537 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21484f4-0a2f-439d-b8ff-61cedc9fc8e9 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:39.854275 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73be3f-a8b6-400f-a873-e71802820bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.854557 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73be3f-a8b6-400f-a873-e71802820bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.854838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73be3f-a8b6-400f-a873-e71802820bdf admin admin] PATH_INFO: `/v3/projects/cc64d5fffe4d49a5a68beafef12602e4/users/b769ea7bd2d0425fb972efd16d794383/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.870403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73be3f-a8b6-400f-a873-e71802820bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc64d5fffe4d49a5a68beafef12602e4, user_id=b769ea7bd2d0425fb972efd16d794383, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.873128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73be3f-a8b6-400f-a873-e71802820bdf admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.876575 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:39.919154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c22ce-0f87-4329-99d4-b32358e961dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:39.919878 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c22ce-0f87-4329-99d4-b32358e961dc service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.920167 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c22ce-0f87-4329-99d4-b32358e961dc service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.920444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c22ce-0f87-4329-99d4-b32358e961dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:39.975170 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c22ce-0f87-4329-99d4-b32358e961dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:39.976815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c22ce-0f87-4329-99d4-b32358e961dc service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:39.977347 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 807/1610] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:39 2022] PUT /identity/v3/projects/cc64d5fffe4d49a5a68beafef12602e4/users/b769ea7bd2d0425fb972efd16d794383/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:39.978770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73be3f-a8b6-400f-a873-e71802820bdf admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:39.991850 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 804/1611] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:39.993166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f97f17-4b5f-483e-aa0a-08a4a4700e33 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:39.993452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f97f17-4b5f-483e-aa0a-08a4a4700e33 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:39.994375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f97f17-4b5f-483e-aa0a-08a4a4700e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.019868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-23f97f17-4b5f-483e-aa0a-08a4a4700e33 None None] MFA Rules not processed for user `f1c5a9040ded4bafbcd926c00eb7e9e0`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:40.021129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-23f97f17-4b5f-483e-aa0a-08a4a4700e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:40.044233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73be3f-a8b6-400f-a873-e71802820bdf admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:40.049359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4e533-bc95-4f42-845e-f14fd3a30287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:40.049998 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4e533-bc95-4f42-845e-f14fd3a30287 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.050287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4e533-bc95-4f42-845e-f14fd3a30287 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.050565 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4e533-bc95-4f42-845e-f14fd3a30287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.092908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 805/1612] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:40.092908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cd863-32cc-450e-9b2c-a435653af43d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.092908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cd863-32cc-450e-9b2c-a435653af43d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.092908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cd863-32cc-450e-9b2c-a435653af43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.111007 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ca0cd863-32cc-450e-9b2c-a435653af43d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:40.112224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ca0cd863-32cc-450e-9b2c-a435653af43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:40.123093 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4e533-bc95-4f42-845e-f14fd3a30287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:40.124574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4e533-bc95-4f42-845e-f14fd3a30287 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:40.136548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 808/1613] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:40.138332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4e533-bc95-4f42-845e-f14fd3a30287 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:40.151637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4e533-bc95-4f42-845e-f14fd3a30287 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:40.157663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92c994-58f7-4adc-b9d8-4ee705fdba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:40.158428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92c994-58f7-4adc-b9d8-4ee705fdba4f admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.158785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92c994-58f7-4adc-b9d8-4ee705fdba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.159130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92c994-58f7-4adc-b9d8-4ee705fdba4f admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.159885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92c994-58f7-4adc-b9d8-4ee705fdba4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:40.161479 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92c994-58f7-4adc-b9d8-4ee705fdba4f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:40.161753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:40.179745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 809/1614] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:40.179745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18433aa-bef7-4cea-a6af-4552e2fd1bda None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.179745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18433aa-bef7-4cea-a6af-4552e2fd1bda None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.179745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18433aa-bef7-4cea-a6af-4552e2fd1bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.184442 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 806/1615] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:40.189433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978d0c9-78e3-4050-aefc-4394f1bcc176 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.190026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978d0c9-78e3-4050-aefc-4394f1bcc176 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.190697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978d0c9-78e3-4050-aefc-4394f1bcc176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.199913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-b18433aa-bef7-4cea-a6af-4552e2fd1bda None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:40.201250 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-b18433aa-bef7-4cea-a6af-4552e2fd1bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:40.214632 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 810/1616] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:40.216645 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb00aca-71a8-4f8f-ad90-8d208853768b None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.218051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb00aca-71a8-4f8f-ad90-8d208853768b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.218051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb00aca-71a8-4f8f-ad90-8d208853768b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.218824 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-3978d0c9-78e3-4050-aefc-4394f1bcc176 None None] MFA Rules not processed for user `bf2d59ffa0a145e591da7ddb2c25cf44`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:40.220558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3978d0c9-78e3-4050-aefc-4394f1bcc176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:40.249465 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-9bb00aca-71a8-4f8f-ad90-8d208853768b None None] MFA Rules not processed for user `b769ea7bd2d0425fb972efd16d794383`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:40.250842 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9bb00aca-71a8-4f8f-ad90-8d208853768b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:40.301379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:40.306163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 807/1617] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:40.307528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978d0c9-78e3-4050-aefc-4394f1bcc176 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:40.332833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 811/1618] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:40.333946 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb00aca-71a8-4f8f-ad90-8d208853768b None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:40.348885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb00aca-71a8-4f8f-ad90-8d208853768b None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:40.355833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915cafc-0c51-4b70-a7d8-77db28a0d2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:40.356723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915cafc-0c51-4b70-a7d8-77db28a0d2d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.357008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915cafc-0c51-4b70-a7d8-77db28a0d2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.357284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915cafc-0c51-4b70-a7d8-77db28a0d2d7 admin admin] PATH_INFO: `/v3/projects/9e48729b7ad54bf1b1fc0cc786712aef/users/7606b199e35c4718817edb712cf507c0/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.372569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915cafc-0c51-4b70-a7d8-77db28a0d2d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e48729b7ad54bf1b1fc0cc786712aef, user_id=7606b199e35c4718817edb712cf507c0, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:40.375351 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915cafc-0c51-4b70-a7d8-77db28a0d2d7 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:40.381370 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978d0c9-78e3-4050-aefc-4394f1bcc176 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:40.385336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7ab66-05a3-4947-a8f3-ec439eda50e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:40.385962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7ab66-05a3-4947-a8f3-ec439eda50e2 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.386244 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7ab66-05a3-4947-a8f3-ec439eda50e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.386518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7ab66-05a3-4947-a8f3-ec439eda50e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.395265 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7ab66-05a3-4947-a8f3-ec439eda50e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:40.396727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7ab66-05a3-4947-a8f3-ec439eda50e2 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:40.405449 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 808/1619] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:40.406216 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7ab66-05a3-4947-a8f3-ec439eda50e2 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:40.414988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7ab66-05a3-4947-a8f3-ec439eda50e2 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:40.418692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93f5de-5911-4323-a105-f05b912228a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:40.419304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93f5de-5911-4323-a105-f05b912228a6 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.419622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93f5de-5911-4323-a105-f05b912228a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.419903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93f5de-5911-4323-a105-f05b912228a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.429171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93f5de-5911-4323-a105-f05b912228a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:40.433405 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93f5de-5911-4323-a105-f05b912228a6 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:40.440307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 809/1620] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:40.441213 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93f5de-5911-4323-a105-f05b912228a6 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:40.449644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93f5de-5911-4323-a105-f05b912228a6 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:40.453878 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9dcd3-7e60-419e-b651-18bf36cc8ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:40.454959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9dcd3-7e60-419e-b651-18bf36cc8ecb service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.454959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9dcd3-7e60-419e-b651-18bf36cc8ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.455388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9dcd3-7e60-419e-b651-18bf36cc8ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.465611 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9dcd3-7e60-419e-b651-18bf36cc8ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:40.467408 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9dcd3-7e60-419e-b651-18bf36cc8ecb service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:40.479423 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 810/1621] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:40.481026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f5083-6410-4088-8cb1-90ba5d2c5087 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.481314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f5083-6410-4088-8cb1-90ba5d2c5087 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.481638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f5083-6410-4088-8cb1-90ba5d2c5087 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.482967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 811/1622] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 2 13:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:56:40.484363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55326bc0-77bf-4472-9fca-996dce7506ea None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.484653 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55326bc0-77bf-4472-9fca-996dce7506ea None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.484969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55326bc0-77bf-4472-9fca-996dce7506ea None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.486584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 812/1623] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 2 13:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:56:40.487591 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55326bc0-77bf-4472-9fca-996dce7506ea None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:40.501649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 812/1624] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:40 2022] PUT /identity/v3/projects/9e48729b7ad54bf1b1fc0cc786712aef/users/7606b199e35c4718817edb712cf507c0/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:40.501649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930587bd-9871-419e-8ba9-0aaef3da8acf None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.501649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930587bd-9871-419e-8ba9-0aaef3da8acf None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.501649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930587bd-9871-419e-8ba9-0aaef3da8acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.507537 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55326bc0-77bf-4472-9fca-996dce7506ea None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:40.519418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-930587bd-9871-419e-8ba9-0aaef3da8acf None None] MFA Rules not processed for user `b9971f2bf0f2400b90168f6032a0e226`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:40.520776 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-930587bd-9871-419e-8ba9-0aaef3da8acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:40.590752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:40.599167 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 813/1625] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 13:56:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:40.600764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935813e-9d82-4e22-895b-d3bcfd2b63b0 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.601163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935813e-9d82-4e22-895b-d3bcfd2b63b0 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.601559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935813e-9d82-4e22-895b-d3bcfd2b63b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.609394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e6681-897f-47bf-9447-d98aea61bf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:40.610070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6681-897f-47bf-9447-d98aea61bf30 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.611892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6681-897f-47bf-9447-d98aea61bf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.613381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6681-897f-47bf-9447-d98aea61bf30 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.614132 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e6681-897f-47bf-9447-d98aea61bf30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:40.619369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e6681-897f-47bf-9447-d98aea61bf30 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:40.627770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-0935813e-9d82-4e22-895b-d3bcfd2b63b0 None None] MFA Rules not processed for user `b9971f2bf0f2400b90168f6032a0e226`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:40.628983 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0935813e-9d82-4e22-895b-d3bcfd2b63b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:40.647915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 814/1626] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 2 13:56:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:40.648875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935813e-9d82-4e22-895b-d3bcfd2b63b0 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:40.661150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935813e-9d82-4e22-895b-d3bcfd2b63b0 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:40.669685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d67dc-1f01-40cc-8e5d-55253657c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:40.669685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d67dc-1f01-40cc-8e5d-55253657c06f admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.670274 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d67dc-1f01-40cc-8e5d-55253657c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.670640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d67dc-1f01-40cc-8e5d-55253657c06f admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.672170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d67dc-1f01-40cc-8e5d-55253657c06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:40.675162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d67dc-1f01-40cc-8e5d-55253657c06f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:40.706298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 815/1627] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:40.706298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d67dc-1f01-40cc-8e5d-55253657c06f admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:40.772839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d67dc-1f01-40cc-8e5d-55253657c06f admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:40.778355 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 813/1628] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:40 2022] POST /identity/v3/projects => generated 365 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:40.778647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e6681-897f-47bf-9447-d98aea61bf30 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:40.826317 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d7adc-4b47-4f6a-83a6-8d1dd748f10d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:40.827112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d7adc-4b47-4f6a-83a6-8d1dd748f10d service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.827635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d7adc-4b47-4f6a-83a6-8d1dd748f10d service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.828016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d7adc-4b47-4f6a-83a6-8d1dd748f10d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.856761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:40.876286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e6681-897f-47bf-9447-d98aea61bf30 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:40.882587 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d90271-02ae-4879-b428-ee74c079549c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:40.883483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90271-02ae-4879-b428-ee74c079549c service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:40.883769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90271-02ae-4879-b428-ee74c079549c service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:40.884121 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90271-02ae-4879-b428-ee74c079549c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:40.933076 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d7adc-4b47-4f6a-83a6-8d1dd748f10d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:40.936039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d7adc-4b47-4f6a-83a6-8d1dd748f10d service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:40.954241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 816/1629] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:40.968619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d7adc-4b47-4f6a-83a6-8d1dd748f10d service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:41.002171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d90271-02ae-4879-b428-ee74c079549c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:41.003897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d90271-02ae-4879-b428-ee74c079549c service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:41.026312 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 814/1630] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:41.027157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d90271-02ae-4879-b428-ee74c079549c service nova] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:41.056251 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d7adc-4b47-4f6a-83a6-8d1dd748f10d service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:41.064070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188487fd-e758-4233-8ea1-f5caf6e2b31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:41.065995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188487fd-e758-4233-8ea1-f5caf6e2b31d admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:41.066260 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188487fd-e758-4233-8ea1-f5caf6e2b31d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:41.066539 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188487fd-e758-4233-8ea1-f5caf6e2b31d admin admin] PATH_INFO: `/v3/projects/9e48729b7ad54bf1b1fc0cc786712aef/users/7606b199e35c4718817edb712cf507c0/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:41.070949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188487fd-e758-4233-8ea1-f5caf6e2b31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e48729b7ad54bf1b1fc0cc786712aef, user_id=7606b199e35c4718817edb712cf507c0, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:41.072874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188487fd-e758-4233-8ea1-f5caf6e2b31d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:41.087153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 817/1631] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:40 2022] PUT /identity/v3/projects/9e48729b7ad54bf1b1fc0cc786712aef/users/7606b199e35c4718817edb712cf507c0/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:41.098328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024b5bb-85ea-4320-943d-ec2e1984f6cf None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:41.098654 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024b5bb-85ea-4320-943d-ec2e1984f6cf None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:41.098865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024b5bb-85ea-4320-943d-ec2e1984f6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:41.116304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d90271-02ae-4879-b428-ee74c079549c service nova] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:41.135297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f024b5bb-85ea-4320-943d-ec2e1984f6cf None None] MFA Rules not processed for user `7606b199e35c4718817edb712cf507c0`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:41.136886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f024b5bb-85ea-4320-943d-ec2e1984f6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:41.153468 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:41.204625 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdf860-0b28-468d-bace-07d3834204a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:41.205654 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdf860-0b28-468d-bace-07d3834204a4 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:41.205990 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdf860-0b28-468d-bace-07d3834204a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:41.208374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdf860-0b28-468d-bace-07d3834204a4 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:41.208374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdf860-0b28-468d-bace-07d3834204a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:41.211170 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdf860-0b28-468d-bace-07d3834204a4 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:41.261631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 818/1632] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:41.371574 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 815/1633] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:41 2022] POST /identity/v3/users => generated 289 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:41.375257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024b5bb-85ea-4320-943d-ec2e1984f6cf None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:41.390745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024b5bb-85ea-4320-943d-ec2e1984f6cf None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:41.408345 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fa8ae-45c8-4ad4-9f07-775ea64e6116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:41.409726 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fa8ae-45c8-4ad4-9f07-775ea64e6116 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:41.410029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fa8ae-45c8-4ad4-9f07-775ea64e6116 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:41.410315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fa8ae-45c8-4ad4-9f07-775ea64e6116 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:41.411064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fa8ae-45c8-4ad4-9f07-775ea64e6116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:41.413170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fa8ae-45c8-4ad4-9f07-775ea64e6116 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:41.414742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:41.420126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5ea5c-a1c2-43c8-8ede-7b8dcf50b0c3 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:41.424379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5ea5c-a1c2-43c8-8ede-7b8dcf50b0c3 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:41.424379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5ea5c-a1c2-43c8-8ede-7b8dcf50b0c3 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:41.424379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 816/1634] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 2 13:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:56:41.426794 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 819/1635] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:41.430739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5ea5c-a1c2-43c8-8ede-7b8dcf50b0c3 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:41.431292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad28509-4ae6-43f5-ad6b-0f5adca59ef5 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:41.431598 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad28509-4ae6-43f5-ad6b-0f5adca59ef5 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:41.431879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad28509-4ae6-43f5-ad6b-0f5adca59ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:41.449831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5ea5c-a1c2-43c8-8ede-7b8dcf50b0c3 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:41.457607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-aad28509-4ae6-43f5-ad6b-0f5adca59ef5 None None] MFA Rules not processed for user `b9971f2bf0f2400b90168f6032a0e226`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:41.457607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-aad28509-4ae6-43f5-ad6b-0f5adca59ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:41.458567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0560e-4c7d-40f7-bfd0-eee6d71438fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:41.460052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0560e-4c7d-40f7-bfd0-eee6d71438fc admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:41.460356 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0560e-4c7d-40f7-bfd0-eee6d71438fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:41.460762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0560e-4c7d-40f7-bfd0-eee6d71438fc admin admin] PATH_INFO: `/v3/projects/6e2e1c2cf92b4dad82c748be1199627d/users/f7a1a19a1baa4d29bcdf0e1709120895/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:41.480458 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0560e-4c7d-40f7-bfd0-eee6d71438fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2e1c2cf92b4dad82c748be1199627d, user_id=f7a1a19a1baa4d29bcdf0e1709120895, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:41.483177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0560e-4c7d-40f7-bfd0-eee6d71438fc admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:41.525875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 820/1636] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 13:56:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:41.624265 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 817/1637] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:41 2022] PUT /identity/v3/projects/6e2e1c2cf92b4dad82c748be1199627d/users/f7a1a19a1baa4d29bcdf0e1709120895/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:41.626607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad28509-4ae6-43f5-ad6b-0f5adca59ef5 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:41.635504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0560e-4c7d-40f7-bfd0-eee6d71438fc admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:41.719619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad28509-4ae6-43f5-ad6b-0f5adca59ef5 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:41.746958 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0560e-4c7d-40f7-bfd0-eee6d71438fc admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:41.753954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38b42e-d886-42d9-a390-daf0fd995045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:41.757364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38b42e-d886-42d9-a390-daf0fd995045 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:41.757364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38b42e-d886-42d9-a390-daf0fd995045 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:41.757364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38b42e-d886-42d9-a390-daf0fd995045 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:41.757364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38b42e-d886-42d9-a390-daf0fd995045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:41.757884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38b42e-d886-42d9-a390-daf0fd995045 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:41.770551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 818/1638] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:56:41.774751 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38b42e-d886-42d9-a390-daf0fd995045 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:41.777761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ec9e0-9c32-4a9d-a388-7860659ebe39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:41.778424 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ec9e0-9c32-4a9d-a388-7860659ebe39 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:41.778707 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ec9e0-9c32-4a9d-a388-7860659ebe39 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:41.778981 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ec9e0-9c32-4a9d-a388-7860659ebe39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:41.793756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38b42e-d886-42d9-a390-daf0fd995045 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:41.799889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a5903-0c7a-40d5-a9e5-3089c7e2e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:41.800793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a5903-0c7a-40d5-a9e5-3089c7e2e4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:41.801070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a5903-0c7a-40d5-a9e5-3089c7e2e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:41.801387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a5903-0c7a-40d5-a9e5-3089c7e2e4ab admin admin] PATH_INFO: `/v3/projects/6e2e1c2cf92b4dad82c748be1199627d/users/f7a1a19a1baa4d29bcdf0e1709120895/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:41.803947 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a5903-0c7a-40d5-a9e5-3089c7e2e4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2e1c2cf92b4dad82c748be1199627d, user_id=f7a1a19a1baa4d29bcdf0e1709120895, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:41.807567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a5903-0c7a-40d5-a9e5-3089c7e2e4ab admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:41.830549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 819/1639] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:41 2022] PUT /identity/v3/projects/6e2e1c2cf92b4dad82c748be1199627d/users/f7a1a19a1baa4d29bcdf0e1709120895/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:41.832416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409129-1310-40b9-9984-061bbfcd0a8b None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:41.832713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409129-1310-40b9-9984-061bbfcd0a8b None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:41.832997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409129-1310-40b9-9984-061bbfcd0a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:41.872674 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ec9e0-9c32-4a9d-a388-7860659ebe39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:41.874142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ec9e0-9c32-4a9d-a388-7860659ebe39 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:41.874379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-b6409129-1310-40b9-9984-061bbfcd0a8b None None] MFA Rules not processed for user `f7a1a19a1baa4d29bcdf0e1709120895`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:41.876001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b6409129-1310-40b9-9984-061bbfcd0a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:41.890887 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 821/1640] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:56:41.922873 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ec9e0-9c32-4a9d-a388-7860659ebe39 service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:41.948822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ec9e0-9c32-4a9d-a388-7860659ebe39 service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:41.988432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:41.995019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 820/1641] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:56:42.001665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6409129-1310-40b9-9984-061bbfcd0a8b None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:42.054403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e7061-6d43-4238-9b5f-7da9715cb8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:42.055499 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e7061-6d43-4238-9b5f-7da9715cb8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:42.055672 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e7061-6d43-4238-9b5f-7da9715cb8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:42.056062 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e7061-6d43-4238-9b5f-7da9715cb8b8 admin admin] PATH_INFO: `/v3/users/41064a325b0a4942be8b72bf140c462b` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:42.057542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e7061-6d43-4238-9b5f-7da9715cb8b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41064a325b0a4942be8b72bf140c462b)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:42.067976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e7061-6d43-4238-9b5f-7da9715cb8b8 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:42.090764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6409129-1310-40b9-9984-061bbfcd0a8b None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:42.094848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1529ab-495a-43c3-8018-fb5bbdb13c9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:42.095993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1529ab-495a-43c3-8018-fb5bbdb13c9b service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:42.095993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1529ab-495a-43c3-8018-fb5bbdb13c9b service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:42.096732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1529ab-495a-43c3-8018-fb5bbdb13c9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:42.151298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:42.181399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1529ab-495a-43c3-8018-fb5bbdb13c9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:42.183133 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1529ab-495a-43c3-8018-fb5bbdb13c9b service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:42.210838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 821/1642] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:42.310531 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1529ab-495a-43c3-8018-fb5bbdb13c9b service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:42.327759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1529ab-495a-43c3-8018-fb5bbdb13c9b service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:42.347017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9c6e7061-6d43-4238-9b5f-7da9715cb8b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41064a325b0a4942be8b72bf140c462b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:42.356545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be813835-b09f-45ce-8758-9722e11c338b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:42.356545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be813835-b09f-45ce-8758-9722e11c338b service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:42.356545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be813835-b09f-45ce-8758-9722e11c338b service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:42.356545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be813835-b09f-45ce-8758-9722e11c338b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:42.381934 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be813835-b09f-45ce-8758-9722e11c338b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:42.386550 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be813835-b09f-45ce-8758-9722e11c338b service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:42.392725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9c6e7061-6d43-4238-9b5f-7da9715cb8b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41064a325b0a4942be8b72bf140c462b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:42.409033 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9c6e7061-6d43-4238-9b5f-7da9715cb8b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41064a325b0a4942be8b72bf140c462b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:42.410181 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9c6e7061-6d43-4238-9b5f-7da9715cb8b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41064a325b0a4942be8b72bf140c462b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:42.416035 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 822/1643] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:56:42.502896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9c6e7061-6d43-4238-9b5f-7da9715cb8b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41064a325b0a4942be8b72bf140c462b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:42.510325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 822/1644] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:41 2022] DELETE /identity/v3/users/41064a325b0a4942be8b72bf140c462b => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:42.515057 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939fc0b-2eab-470c-b231-3db1b11aa1d3 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:42.515644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939fc0b-2eab-470c-b231-3db1b11aa1d3 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:42.515933 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939fc0b-2eab-470c-b231-3db1b11aa1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:42.534040 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-3939fc0b-2eab-470c-b231-3db1b11aa1d3 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:42.536367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3939fc0b-2eab-470c-b231-3db1b11aa1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:43.016474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 823/1645] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:43.026833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e7061-6d43-4238-9b5f-7da9715cb8b8 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:43.026833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9c6e7061-6d43-4238-9b5f-7da9715cb8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:43.026833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e7061-6d43-4238-9b5f-7da9715cb8b8 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:43.027949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba83fe4-1a09-452d-ad20-55a7dd90a133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:43.027949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba83fe4-1a09-452d-ad20-55a7dd90a133 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:43.027949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba83fe4-1a09-452d-ad20-55a7dd90a133 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:43.027949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba83fe4-1a09-452d-ad20-55a7dd90a133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:43.032979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba83fe4-1a09-452d-ad20-55a7dd90a133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:43.032979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba83fe4-1a09-452d-ad20-55a7dd90a133 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:43.032979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 823/1646] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:43.813772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939fc0b-2eab-470c-b231-3db1b11aa1d3 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:43.815344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3939fc0b-2eab-470c-b231-3db1b11aa1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:43.839361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939fc0b-2eab-470c-b231-3db1b11aa1d3 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:43.851480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:43.852721 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:43.855528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:43.855774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] PATH_INFO: `/v3/projects/138e1aa5e47542a0b8716574d7a5c9f6` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:43.857986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=138e1aa5e47542a0b8716574d7a5c9f6)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:43.862144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:43.946429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:44.060845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360efbd-1712-4344-b94d-bf4b6a1983f3 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:44.061710 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360efbd-1712-4344-b94d-bf4b6a1983f3 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:44.062135 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360efbd-1712-4344-b94d-bf4b6a1983f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:44.068652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138e1aa5e47542a0b8716574d7a5c9f6', 'request_id': 'req-4d6c34fc-b9ac-436b-b55e-607ec8a58349'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.150794 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-8360efbd-1712-4344-b94d-bf4b6a1983f3 None None] MFA Rules not processed for user `8288f45c6eae440fb4b8594b375d6400`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:44.152139 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8360efbd-1712-4344-b94d-bf4b6a1983f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:44.156458 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:44.198845 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138e1aa5e47542a0b8716574d7a5c9f6', 'request_id': 'req-4d6c34fc-b9ac-436b-b55e-607ec8a58349'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.214356 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138e1aa5e47542a0b8716574d7a5c9f6', 'request_id': 'req-4d6c34fc-b9ac-436b-b55e-607ec8a58349'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.228310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] The token cache is being invalidate because project 138e1aa5e47542a0b8716574d7a5c9f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:56:44.229209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.229907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.232810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 824/1647] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:56:43 2022] DELETE /identity/v3/projects/138e1aa5e47542a0b8716574d7a5c9f6 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:44.233661 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:44.235516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:44.237553 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 824/1648] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:56:44.238405 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360efbd-1712-4344-b94d-bf4b6a1983f3 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:44.378852 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360efbd-1712-4344-b94d-bf4b6a1983f3 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:44.386290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02b805-0be4-4486-9c84-7aba2e091013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:44.387337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b805-0be4-4486-9c84-7aba2e091013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:44.387756 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b805-0be4-4486-9c84-7aba2e091013 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:44.388136 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b805-0be4-4486-9c84-7aba2e091013 admin admin] PATH_INFO: `/v3/users/7606b199e35c4718817edb712cf507c0` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:44.389751 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02b805-0be4-4486-9c84-7aba2e091013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7606b199e35c4718817edb712cf507c0)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:44.391669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c34fc-b9ac-436b-b55e-607ec8a58349 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:44.393925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02b805-0be4-4486-9c84-7aba2e091013 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:44.410729 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b6213-264c-4428-b2d7-6e160e09cd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:44.412146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b6213-264c-4428-b2d7-6e160e09cd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:44.412610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b6213-264c-4428-b2d7-6e160e09cd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:44.413030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b6213-264c-4428-b2d7-6e160e09cd34 admin admin] PATH_INFO: `/v3/users/b769ea7bd2d0425fb972efd16d794383` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:44.427077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b6213-264c-4428-b2d7-6e160e09cd34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b769ea7bd2d0425fb972efd16d794383)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:44.428434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: WARNING py.warnings [None req-2b3b6213-264c-4428-b2d7-6e160e09cd34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:56:44.428434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: warnings.warn(msg) Jun 02 13:56:44.428434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: Jun 02 13:56:44.430051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b6213-264c-4428-b2d7-6e160e09cd34 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:44.685534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0f02b805-0be4-4486-9c84-7aba2e091013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7606b199e35c4718817edb712cf507c0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.713309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2b3b6213-264c-4428-b2d7-6e160e09cd34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b769ea7bd2d0425fb972efd16d794383'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.756448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0f02b805-0be4-4486-9c84-7aba2e091013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7606b199e35c4718817edb712cf507c0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.776046 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0f02b805-0be4-4486-9c84-7aba2e091013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7606b199e35c4718817edb712cf507c0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.777998 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0f02b805-0be4-4486-9c84-7aba2e091013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7606b199e35c4718817edb712cf507c0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.814848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2b3b6213-264c-4428-b2d7-6e160e09cd34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b769ea7bd2d0425fb972efd16d794383'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.847140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2b3b6213-264c-4428-b2d7-6e160e09cd34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b769ea7bd2d0425fb972efd16d794383'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.849017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2b3b6213-264c-4428-b2d7-6e160e09cd34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b769ea7bd2d0425fb972efd16d794383'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.879320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2b3b6213-264c-4428-b2d7-6e160e09cd34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b769ea7bd2d0425fb972efd16d794383'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.889296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 825/1649] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:44 2022] DELETE /identity/v3/users/b769ea7bd2d0425fb972efd16d794383 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:44.896739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98b5e0-984c-4079-9d0f-51e44923bf42 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:44.897103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98b5e0-984c-4079-9d0f-51e44923bf42 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:44.897458 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98b5e0-984c-4079-9d0f-51e44923bf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:44.908411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0f02b805-0be4-4486-9c84-7aba2e091013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7606b199e35c4718817edb712cf507c0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:44.927665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 825/1650] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:44 2022] DELETE /identity/v3/users/7606b199e35c4718817edb712cf507c0 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:44.930050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b10ec7-086d-4258-8c1b-d95e962268cf None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:44.931223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b10ec7-086d-4258-8c1b-d95e962268cf None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:44.932955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b10ec7-086d-4258-8c1b-d95e962268cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:44.944904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ce98b5e0-984c-4079-9d0f-51e44923bf42 None None] MFA Rules not processed for user `8288f45c6eae440fb4b8594b375d6400`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:44.948250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ce98b5e0-984c-4079-9d0f-51e44923bf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:44.992367 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-00b10ec7-086d-4258-8c1b-d95e962268cf None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:44.994509 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-00b10ec7-086d-4258-8c1b-d95e962268cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:45.119429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 826/1651] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:45.146433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98b5e0-984c-4079-9d0f-51e44923bf42 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:45.148414 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ce98b5e0-984c-4079-9d0f-51e44923bf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:45.150458 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 826/1652] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:45.233475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b10ec7-086d-4258-8c1b-d95e962268cf None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:45.235990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-00b10ec7-086d-4258-8c1b-d95e962268cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:45.330551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:45.370869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b10ec7-086d-4258-8c1b-d95e962268cf None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:45.373343 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98b5e0-984c-4079-9d0f-51e44923bf42 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:45.378051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a36af9-0495-45cb-8d77-3166b0e92585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:45.378709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a36af9-0495-45cb-8d77-3166b0e92585 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:45.379131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a36af9-0495-45cb-8d77-3166b0e92585 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:45.379576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a36af9-0495-45cb-8d77-3166b0e92585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:45.393309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ae9dc-2813-47b2-a79f-0da9252b9b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:45.393988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ae9dc-2813-47b2-a79f-0da9252b9b00 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:45.394275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ae9dc-2813-47b2-a79f-0da9252b9b00 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:45.394553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ae9dc-2813-47b2-a79f-0da9252b9b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:45.398403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a36af9-0495-45cb-8d77-3166b0e92585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:45.398524 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f21ae9dc-2813-47b2-a79f-0da9252b9b00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:45.400020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a36af9-0495-45cb-8d77-3166b0e92585 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:45.419177 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 827/1653] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:45.420889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ae9dc-2813-47b2-a79f-0da9252b9b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:45.423402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ae9dc-2813-47b2-a79f-0da9252b9b00 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:45.435739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 827/1654] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:56:46.368791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40eee-7d83-4bbc-99d1-13b4dc4ee32c None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:46.373191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40eee-7d83-4bbc-99d1-13b4dc4ee32c None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:46.373511 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40eee-7d83-4bbc-99d1-13b4dc4ee32c None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:46.378713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 828/1655] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 2 13:56:46 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:56:46.390162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde783b-4b74-4363-8eda-58ba54935344 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:46.391505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde783b-4b74-4363-8eda-58ba54935344 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:46.391778 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde783b-4b74-4363-8eda-58ba54935344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:46.451334 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:46.467412 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb40eee-7d83-4bbc-99d1-13b4dc4ee32c None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:46.470015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ffb40eee-7d83-4bbc-99d1-13b4dc4ee32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:46.473562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-6fde783b-4b74-4363-8eda-58ba54935344 None None] MFA Rules not processed for user `d95c75980e114aa488424fb115add647`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:46.474815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6fde783b-4b74-4363-8eda-58ba54935344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:46.484785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 828/1656] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 13:56:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:46.498462 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde783b-4b74-4363-8eda-58ba54935344 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:46.498870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb40eee-7d83-4bbc-99d1-13b4dc4ee32c None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:46.502495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6fde783b-4b74-4363-8eda-58ba54935344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:46.504780 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f695218-2202-44b1-be76-2e44d359d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:46.505850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f695218-2202-44b1-be76-2e44d359d7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:46.506422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f695218-2202-44b1-be76-2e44d359d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:46.506843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f695218-2202-44b1-be76-2e44d359d7b5 admin admin] PATH_INFO: `/v3/projects/9e48729b7ad54bf1b1fc0cc786712aef` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:46.508432 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f695218-2202-44b1-be76-2e44d359d7b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e48729b7ad54bf1b1fc0cc786712aef)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:46.510031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: WARNING py.warnings [None req-2f695218-2202-44b1-be76-2e44d359d7b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:56:46.510031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: warnings.warn(msg) Jun 02 13:56:46.510031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: Jun 02 13:56:46.515104 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f695218-2202-44b1-be76-2e44d359d7b5 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:46.537819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde783b-4b74-4363-8eda-58ba54935344 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:46.563805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33690559-6f27-4402-b1f7-faafd6fc96d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:46.563805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33690559-6f27-4402-b1f7-faafd6fc96d0 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:46.563805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33690559-6f27-4402-b1f7-faafd6fc96d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:46.563805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33690559-6f27-4402-b1f7-faafd6fc96d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:46.584449 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33690559-6f27-4402-b1f7-faafd6fc96d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:46.587156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33690559-6f27-4402-b1f7-faafd6fc96d0 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:46.607240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 829/1657] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:46.625198 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33690559-6f27-4402-b1f7-faafd6fc96d0 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:46.625198 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-33690559-6f27-4402-b1f7-faafd6fc96d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:46.643569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33690559-6f27-4402-b1f7-faafd6fc96d0 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:46.649799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:46.650631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:46.650807 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:46.651090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] PATH_INFO: `/v3/projects/cc64d5fffe4d49a5a68beafef12602e4` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:46.652361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc64d5fffe4d49a5a68beafef12602e4)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:46.655718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:46.707819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2f695218-2202-44b1-be76-2e44d359d7b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e48729b7ad54bf1b1fc0cc786712aef', 'request_id': 'req-2f695218-2202-44b1-be76-2e44d359d7b5'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:46.799393 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2f695218-2202-44b1-be76-2e44d359d7b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e48729b7ad54bf1b1fc0cc786712aef', 'request_id': 'req-2f695218-2202-44b1-be76-2e44d359d7b5'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:46.832676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc64d5fffe4d49a5a68beafef12602e4', 'request_id': 'req-d445aef9-4cc6-4b7f-afeb-e1b61337f204'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:46.846548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2f695218-2202-44b1-be76-2e44d359d7b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e48729b7ad54bf1b1fc0cc786712aef', 'request_id': 'req-2f695218-2202-44b1-be76-2e44d359d7b5'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:46.874482 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2f695218-2202-44b1-be76-2e44d359d7b5 admin admin] The token cache is being invalidate because project 9e48729b7ad54bf1b1fc0cc786712aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:56:46.875305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2f695218-2202-44b1-be76-2e44d359d7b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:46.878138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2f695218-2202-44b1-be76-2e44d359d7b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:46.881861 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 829/1658] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:56:46 2022] DELETE /identity/v3/projects/9e48729b7ad54bf1b1fc0cc786712aef => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:46.886637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12166b59-a20e-4113-83c0-0e312a7f192b None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:46.886935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12166b59-a20e-4113-83c0-0e312a7f192b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:46.887220 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12166b59-a20e-4113-83c0-0e312a7f192b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:46.897289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc64d5fffe4d49a5a68beafef12602e4', 'request_id': 'req-d445aef9-4cc6-4b7f-afeb-e1b61337f204'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:46.905237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc64d5fffe4d49a5a68beafef12602e4', 'request_id': 'req-d445aef9-4cc6-4b7f-afeb-e1b61337f204'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:46.925097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] The token cache is being invalidate because project cc64d5fffe4d49a5a68beafef12602e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:56:46.925373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:46.926330 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:46.932131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 830/1659] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:56:46 2022] DELETE /identity/v3/projects/cc64d5fffe4d49a5a68beafef12602e4 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:56:46.933283 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:46.935849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:46.937965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-12166b59-a20e-4113-83c0-0e312a7f192b None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:46.939151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-12166b59-a20e-4113-83c0-0e312a7f192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:47.076812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 830/1660] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:47.078216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12166b59-a20e-4113-83c0-0e312a7f192b None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:47.079734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-12166b59-a20e-4113-83c0-0e312a7f192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:47.103904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12166b59-a20e-4113-83c0-0e312a7f192b None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:47.110029 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445aef9-4cc6-4b7f-afeb-e1b61337f204 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:47.115660 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d7c44-965b-4380-9188-3724108afb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:47.119289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d7c44-965b-4380-9188-3724108afb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:47.120066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d7c44-965b-4380-9188-3724108afb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:47.120226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e06d75-8030-440f-9aac-8b8b29197127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:47.121085 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e06d75-8030-440f-9aac-8b8b29197127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:47.121363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e06d75-8030-440f-9aac-8b8b29197127 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:47.121523 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d7c44-965b-4380-9188-3724108afb02 admin admin] PATH_INFO: `/v3/users/bf2d59ffa0a145e591da7ddb2c25cf44` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:47.121616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e06d75-8030-440f-9aac-8b8b29197127 admin admin] PATH_INFO: `/v3/users/f7a1a19a1baa4d29bcdf0e1709120895` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:47.124520 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d7c44-965b-4380-9188-3724108afb02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2d59ffa0a145e591da7ddb2c25cf44)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:47.124649 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e06d75-8030-440f-9aac-8b8b29197127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a1a19a1baa4d29bcdf0e1709120895)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:47.128988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e06d75-8030-440f-9aac-8b8b29197127 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:47.129096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d7c44-965b-4380-9188-3724108afb02 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:47.398765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-82e06d75-8030-440f-9aac-8b8b29197127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a1a19a1baa4d29bcdf0e1709120895'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:47.434138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-693d7c44-965b-4380-9188-3724108afb02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2d59ffa0a145e591da7ddb2c25cf44'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:47.467183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-693d7c44-965b-4380-9188-3724108afb02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2d59ffa0a145e591da7ddb2c25cf44'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:47.482473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-693d7c44-965b-4380-9188-3724108afb02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2d59ffa0a145e591da7ddb2c25cf44'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:47.485489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-693d7c44-965b-4380-9188-3724108afb02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2d59ffa0a145e591da7ddb2c25cf44'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:47.488994 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-82e06d75-8030-440f-9aac-8b8b29197127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a1a19a1baa4d29bcdf0e1709120895'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:47.517821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-82e06d75-8030-440f-9aac-8b8b29197127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a1a19a1baa4d29bcdf0e1709120895'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:47.520342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-82e06d75-8030-440f-9aac-8b8b29197127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a1a19a1baa4d29bcdf0e1709120895'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:47.542126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-82e06d75-8030-440f-9aac-8b8b29197127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a1a19a1baa4d29bcdf0e1709120895'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:47.555950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 831/1661] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:46 2022] DELETE /identity/v3/users/f7a1a19a1baa4d29bcdf0e1709120895 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:47.558179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bfa07-7c00-47b5-9a39-36faf3974b3b None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:47.565466 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bfa07-7c00-47b5-9a39-36faf3974b3b None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:47.565466 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bfa07-7c00-47b5-9a39-36faf3974b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:47.590140 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-693d7c44-965b-4380-9188-3724108afb02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2d59ffa0a145e591da7ddb2c25cf44'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:47.599652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 831/1662] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:47 2022] DELETE /identity/v3/users/bf2d59ffa0a145e591da7ddb2c25cf44 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:47.604285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8572cc2-11fb-403f-a217-9dc9b7e9288d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:47.604785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8572cc2-11fb-403f-a217-9dc9b7e9288d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:47.605193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8572cc2-11fb-403f-a217-9dc9b7e9288d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:47.611254 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ae4bfa07-7c00-47b5-9a39-36faf3974b3b None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:47.618564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ae4bfa07-7c00-47b5-9a39-36faf3974b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:47.658067 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-a8572cc2-11fb-403f-a217-9dc9b7e9288d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:47.659341 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a8572cc2-11fb-403f-a217-9dc9b7e9288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:47.708436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:47.775592 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 832/1663] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:47.776702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bfa07-7c00-47b5-9a39-36faf3974b3b None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:47.787421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bfa07-7c00-47b5-9a39-36faf3974b3b None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:47.793250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a1b21-17f9-44b8-a0ac-a6d7c3ee8d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:47.794067 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1b21-17f9-44b8-a0ac-a6d7c3ee8d7b admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:47.794520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1b21-17f9-44b8-a0ac-a6d7c3ee8d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:47.794903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1b21-17f9-44b8-a0ac-a6d7c3ee8d7b admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:47.795857 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a1b21-17f9-44b8-a0ac-a6d7c3ee8d7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:47.796942 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a1b21-17f9-44b8-a0ac-a6d7c3ee8d7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:47.798809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a1b21-17f9-44b8-a0ac-a6d7c3ee8d7b admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:47.816799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 833/1664] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:47.818213 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a1b21-17f9-44b8-a0ac-a6d7c3ee8d7b admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:47.839982 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a1b21-17f9-44b8-a0ac-a6d7c3ee8d7b admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:47.845536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 832/1665] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:56:47.853359 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045dd9c3-7410-48de-bad2-abca57fa6a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:47.855597 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dd9c3-7410-48de-bad2-abca57fa6a06 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:47.858513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dd9c3-7410-48de-bad2-abca57fa6a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:47.859483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dd9c3-7410-48de-bad2-abca57fa6a06 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:47.863535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045dd9c3-7410-48de-bad2-abca57fa6a06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:47.869649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8572cc2-11fb-403f-a217-9dc9b7e9288d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:47.872993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a8572cc2-11fb-403f-a217-9dc9b7e9288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:47.886515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045dd9c3-7410-48de-bad2-abca57fa6a06 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:48.020098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8572cc2-11fb-403f-a217-9dc9b7e9288d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:48.025474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b98b7-3b42-491b-be55-e3223c4062fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:48.026345 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b98b7-3b42-491b-be55-e3223c4062fe service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:48.026762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b98b7-3b42-491b-be55-e3223c4062fe service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:48.027270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b98b7-3b42-491b-be55-e3223c4062fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:48.031839 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 834/1666] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:47 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:48.033548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267904ed-6ab5-4544-b327-6d1f401a34dd None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:48.033848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267904ed-6ab5-4544-b327-6d1f401a34dd None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:48.034133 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267904ed-6ab5-4544-b327-6d1f401a34dd None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:48.042444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 835/1667] 10.222.0.39 () {54 vars in 960 bytes} [Thu Jun 2 13:56:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:56:48.043392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267904ed-6ab5-4544-b327-6d1f401a34dd None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:48.081847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b98b7-3b42-491b-be55-e3223c4062fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:48.085761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b98b7-3b42-491b-be55-e3223c4062fe service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:48.113821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 833/1668] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:48.116261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01119b1d-3540-40d3-bae5-52dbd3ed8246 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:48.116710 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01119b1d-3540-40d3-bae5-52dbd3ed8246 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:48.118033 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01119b1d-3540-40d3-bae5-52dbd3ed8246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:48.217234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-01119b1d-3540-40d3-bae5-52dbd3ed8246 None None] MFA Rules not processed for user `b387ad13a6c843d0b9a43bc8f5f7fa13`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:48.217996 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267904ed-6ab5-4544-b327-6d1f401a34dd None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:48.219036 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-01119b1d-3540-40d3-bae5-52dbd3ed8246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:48.219999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add30e5-73a2-4736-9c70-0c2b2878a6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:48.219999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add30e5-73a2-4736-9c70-0c2b2878a6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:48.219999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add30e5-73a2-4736-9c70-0c2b2878a6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:48.219999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add30e5-73a2-4736-9c70-0c2b2878a6e5 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:48.221523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add30e5-73a2-4736-9c70-0c2b2878a6e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:48.222648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add30e5-73a2-4736-9c70-0c2b2878a6e5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:48.371719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 836/1669] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:48 2022] POST /identity/v3/users => generated 292 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:48.377585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add30e5-73a2-4736-9c70-0c2b2878a6e5 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:48.407362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add30e5-73a2-4736-9c70-0c2b2878a6e5 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:48.428439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c99fb-e44e-433d-9754-a646872b55fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:48.429005 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c99fb-e44e-433d-9754-a646872b55fb admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:48.429291 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c99fb-e44e-433d-9754-a646872b55fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:48.429572 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c99fb-e44e-433d-9754-a646872b55fb admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:48.430316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c99fb-e44e-433d-9754-a646872b55fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:48.435390 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c99fb-e44e-433d-9754-a646872b55fb admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:48.462076 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:48.462721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 834/1670] 10.222.0.39 () {58 vars in 1057 bytes} [Thu Jun 2 13:56:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:48.472789 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 837/1671] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:48.474580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01119b1d-3540-40d3-bae5-52dbd3ed8246 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:48.490922 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c99fb-e44e-433d-9754-a646872b55fb admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:48.505722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01119b1d-3540-40d3-bae5-52dbd3ed8246 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:48.538334 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139f792-57b7-4726-9795-418215af7b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:48.539156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139f792-57b7-4726-9795-418215af7b7a admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:48.539291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139f792-57b7-4726-9795-418215af7b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:48.540575 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c99fb-e44e-433d-9754-a646872b55fb admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:48.541496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139f792-57b7-4726-9795-418215af7b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:48.545071 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139f792-57b7-4726-9795-418215af7b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:48.545071 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139f792-57b7-4726-9795-418215af7b7a admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:48.563589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91593adc-0c93-48f2-9e41-6fd4c2a58ecf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:48.564237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91593adc-0c93-48f2-9e41-6fd4c2a58ecf service placement] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:48.564537 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91593adc-0c93-48f2-9e41-6fd4c2a58ecf service placement] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:48.564805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91593adc-0c93-48f2-9e41-6fd4c2a58ecf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:48.569922 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-91593adc-0c93-48f2-9e41-6fd4c2a58ecf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:48.587443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 835/1672] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:48.588092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139f792-57b7-4726-9795-418215af7b7a admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:48.620671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91593adc-0c93-48f2-9e41-6fd4c2a58ecf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:48.622336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91593adc-0c93-48f2-9e41-6fd4c2a58ecf service placement] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:48.627019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139f792-57b7-4726-9795-418215af7b7a admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:48.642604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe991f-1adf-4fe4-a659-96ef7e849671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:48.643547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe991f-1adf-4fe4-a659-96ef7e849671 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:48.643839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe991f-1adf-4fe4-a659-96ef7e849671 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:48.644129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe991f-1adf-4fe4-a659-96ef7e849671 admin admin] PATH_INFO: `/v3/projects/8789c1f67c684d72bee883461fcc7a95/users/a9b6bbc18da94ebe8fc83895b7f80c0f/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:48.655095 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 838/1673] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:56:48.684418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe991f-1adf-4fe4-a659-96ef7e849671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8789c1f67c684d72bee883461fcc7a95, user_id=a9b6bbc18da94ebe8fc83895b7f80c0f, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:48.695300 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe991f-1adf-4fe4-a659-96ef7e849671 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:48.814819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 836/1674] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:48 2022] PUT /identity/v3/projects/8789c1f67c684d72bee883461fcc7a95/users/a9b6bbc18da94ebe8fc83895b7f80c0f/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:48.826379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e12762-c5e2-48f6-853a-e8ba3ce3eea3 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:48.826869 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e12762-c5e2-48f6-853a-e8ba3ce3eea3 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:48.827231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e12762-c5e2-48f6-853a-e8ba3ce3eea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:48.895943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-30e12762-c5e2-48f6-853a-e8ba3ce3eea3 None None] MFA Rules not processed for user `a9b6bbc18da94ebe8fc83895b7f80c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:48.897436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-30e12762-c5e2-48f6-853a-e8ba3ce3eea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:49.002246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe991f-1adf-4fe4-a659-96ef7e849671 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:49.006016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-71fe991f-1adf-4fe4-a659-96ef7e849671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:49.104520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 839/1675] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:49.110324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e12762-c5e2-48f6-853a-e8ba3ce3eea3 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:49.202581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe991f-1adf-4fe4-a659-96ef7e849671 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:49.213530 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8300551-f49c-4d47-a3d3-8042477dd8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:49.214997 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8300551-f49c-4d47-a3d3-8042477dd8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:49.216909 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8300551-f49c-4d47-a3d3-8042477dd8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:49.217772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8300551-f49c-4d47-a3d3-8042477dd8ab admin admin] PATH_INFO: `/v3/projects/6e2e1c2cf92b4dad82c748be1199627d` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:49.222806 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8300551-f49c-4d47-a3d3-8042477dd8ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2e1c2cf92b4dad82c748be1199627d)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:49.226361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8300551-f49c-4d47-a3d3-8042477dd8ab admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:49.283863 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e12762-c5e2-48f6-853a-e8ba3ce3eea3 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:49.303500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60bbc9-1616-4e95-a336-ebfeb47f9175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:49.303500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60bbc9-1616-4e95-a336-ebfeb47f9175 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:49.303500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60bbc9-1616-4e95-a336-ebfeb47f9175 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:49.303500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60bbc9-1616-4e95-a336-ebfeb47f9175 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:49.304002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60bbc9-1616-4e95-a336-ebfeb47f9175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:49.304002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60bbc9-1616-4e95-a336-ebfeb47f9175 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:49.463318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c8300551-f49c-4d47-a3d3-8042477dd8ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2e1c2cf92b4dad82c748be1199627d', 'request_id': 'req-c8300551-f49c-4d47-a3d3-8042477dd8ab'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:49.479672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 840/1676] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:49 2022] POST /identity/v3/projects => generated 385 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:49.484074 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60bbc9-1616-4e95-a336-ebfeb47f9175 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:49.582570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c8300551-f49c-4d47-a3d3-8042477dd8ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2e1c2cf92b4dad82c748be1199627d', 'request_id': 'req-c8300551-f49c-4d47-a3d3-8042477dd8ab'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:49.605932 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c8300551-f49c-4d47-a3d3-8042477dd8ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2e1c2cf92b4dad82c748be1199627d', 'request_id': 'req-c8300551-f49c-4d47-a3d3-8042477dd8ab'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:49.632013 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60bbc9-1616-4e95-a336-ebfeb47f9175 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:49.638529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c8300551-f49c-4d47-a3d3-8042477dd8ab admin admin] The token cache is being invalidate because project 6e2e1c2cf92b4dad82c748be1199627d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:56:49.641319 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c8300551-f49c-4d47-a3d3-8042477dd8ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:49.644965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c8300551-f49c-4d47-a3d3-8042477dd8ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:49.656129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 837/1677] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:56:49 2022] DELETE /identity/v3/projects/6e2e1c2cf92b4dad82c748be1199627d => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:49.657837 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba179169-a122-4bae-9aa4-5c6e58446fc9 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:49.658137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba179169-a122-4bae-9aa4-5c6e58446fc9 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:49.658514 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba179169-a122-4bae-9aa4-5c6e58446fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:49.673154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917a47a-9cff-46cd-b335-29cfaf9a7d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:49.673942 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917a47a-9cff-46cd-b335-29cfaf9a7d72 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:49.674117 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917a47a-9cff-46cd-b335-29cfaf9a7d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:49.674373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917a47a-9cff-46cd-b335-29cfaf9a7d72 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:49.675077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917a47a-9cff-46cd-b335-29cfaf9a7d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:49.679654 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917a47a-9cff-46cd-b335-29cfaf9a7d72 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:49.688136 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-ba179169-a122-4bae-9aa4-5c6e58446fc9 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:49.689349 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ba179169-a122-4bae-9aa4-5c6e58446fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:49.705929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 838/1678] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:49.708870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5fa81-81eb-4ef8-9b2a-0529b5eed3cc None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:49.709395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5fa81-81eb-4ef8-9b2a-0529b5eed3cc None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:49.709815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5fa81-81eb-4ef8-9b2a-0529b5eed3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:49.730810 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-a0f5fa81-81eb-4ef8-9b2a-0529b5eed3cc None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:49.732881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a0f5fa81-81eb-4ef8-9b2a-0529b5eed3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:49.749107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 839/1679] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:49.754159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:49.767820 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5fa81-81eb-4ef8-9b2a-0529b5eed3cc None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:49.768525 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 841/1680] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:49 2022] POST /identity/v3/users => generated 299 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:56:49.769758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917a47a-9cff-46cd-b335-29cfaf9a7d72 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:49.771977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c917a47a-9cff-46cd-b335-29cfaf9a7d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:49.778662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5fa81-81eb-4ef8-9b2a-0529b5eed3cc None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:49.813535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27b8d8-27ff-45eb-8cd7-9dfd8dd03485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:49.814227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27b8d8-27ff-45eb-8cd7-9dfd8dd03485 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:49.814514 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27b8d8-27ff-45eb-8cd7-9dfd8dd03485 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:49.815169 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27b8d8-27ff-45eb-8cd7-9dfd8dd03485 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:49.815947 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27b8d8-27ff-45eb-8cd7-9dfd8dd03485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:49.816254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27b8d8-27ff-45eb-8cd7-9dfd8dd03485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:49.818064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27b8d8-27ff-45eb-8cd7-9dfd8dd03485 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:49.832743 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917a47a-9cff-46cd-b335-29cfaf9a7d72 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:49.836318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 840/1681] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:49.840838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27b8d8-27ff-45eb-8cd7-9dfd8dd03485 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:49.860562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852fd89-54e3-4b0f-bc1d-a0ea86404616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:49.860562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852fd89-54e3-4b0f-bc1d-a0ea86404616 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:49.860562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852fd89-54e3-4b0f-bc1d-a0ea86404616 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:49.860562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852fd89-54e3-4b0f-bc1d-a0ea86404616 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:49.865654 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852fd89-54e3-4b0f-bc1d-a0ea86404616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:49.869145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27b8d8-27ff-45eb-8cd7-9dfd8dd03485 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:49.871594 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852fd89-54e3-4b0f-bc1d-a0ea86404616 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:49.877191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53299c8e-75dc-41e4-853b-c3660bcea2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:49.877191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53299c8e-75dc-41e4-853b-c3660bcea2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:49.877191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53299c8e-75dc-41e4-853b-c3660bcea2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:49.877191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53299c8e-75dc-41e4-853b-c3660bcea2e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:49.883948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53299c8e-75dc-41e4-853b-c3660bcea2e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:49.883948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53299c8e-75dc-41e4-853b-c3660bcea2e2 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:49.931907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 842/1682] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:49.949110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852fd89-54e3-4b0f-bc1d-a0ea86404616 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:49.958732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-7852fd89-54e3-4b0f-bc1d-a0ea86404616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:49.996979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 841/1683] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:49 2022] POST /identity/v3/projects => generated 407 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:49.997171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852fd89-54e3-4b0f-bc1d-a0ea86404616 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:49.999081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53299c8e-75dc-41e4-853b-c3660bcea2e2 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:50.164360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:50.166239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:50.168597 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:50.169084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] PATH_INFO: `/v3/projects/ebbcc89541b443218dc2050f96b84196` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:50.169693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53299c8e-75dc-41e4-853b-c3660bcea2e2 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:50.174070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebbcc89541b443218dc2050f96b84196)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:50.180857 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:50.182699 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daaa04-fdef-47af-a1f7-eaf37c8db5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:50.185459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daaa04-fdef-47af-a1f7-eaf37c8db5d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:50.185459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daaa04-fdef-47af-a1f7-eaf37c8db5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:50.185459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daaa04-fdef-47af-a1f7-eaf37c8db5d0 admin admin] PATH_INFO: `/v3/projects/e62c9e63f0ab48d0b3b1fd39c5143cac/users/d2d3023c87e14c06be246c89391aae77/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:50.241113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25daaa04-fdef-47af-a1f7-eaf37c8db5d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e62c9e63f0ab48d0b3b1fd39c5143cac, user_id=d2d3023c87e14c06be246c89391aae77, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:50.244025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25daaa04-fdef-47af-a1f7-eaf37c8db5d0 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:50.353770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 842/1684] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:49 2022] PUT /identity/v3/projects/e62c9e63f0ab48d0b3b1fd39c5143cac/users/d2d3023c87e14c06be246c89391aae77/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:50.355025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daaa04-fdef-47af-a1f7-eaf37c8db5d0 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:50.363380 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-25daaa04-fdef-47af-a1f7-eaf37c8db5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:50.401826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebbcc89541b443218dc2050f96b84196', 'request_id': 'req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:50.498693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daaa04-fdef-47af-a1f7-eaf37c8db5d0 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:50.549787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebbcc89541b443218dc2050f96b84196', 'request_id': 'req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:50.577257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebbcc89541b443218dc2050f96b84196', 'request_id': 'req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:50.587434 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80771e7f-bafe-403b-ba9f-bc6fea544b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:50.593875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80771e7f-bafe-403b-ba9f-bc6fea544b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:50.594184 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80771e7f-bafe-403b-ba9f-bc6fea544b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:50.594467 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80771e7f-bafe-403b-ba9f-bc6fea544b24 admin admin] PATH_INFO: `/v3/users/39779aae74b443d1b91d707936fc1046` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:50.599647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80771e7f-bafe-403b-ba9f-bc6fea544b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39779aae74b443d1b91d707936fc1046)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:50.607093 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80771e7f-bafe-403b-ba9f-bc6fea544b24 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:50.668768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] The token cache is being invalidate because project ebbcc89541b443218dc2050f96b84196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:56:50.669140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:50.670338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:50.677341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 843/1685] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:56:49 2022] DELETE /identity/v3/projects/ebbcc89541b443218dc2050f96b84196 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:50.678390 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:50.680785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:50.697700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca39f7-ed61-4b6f-97e5-db82fdc6dbab admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:50.741082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5299d5-cac5-4dc5-b286-7b47657d2603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:50.741783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5299d5-cac5-4dc5-b286-7b47657d2603 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:50.742068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5299d5-cac5-4dc5-b286-7b47657d2603 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:50.742600 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5299d5-cac5-4dc5-b286-7b47657d2603 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:50.743496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5299d5-cac5-4dc5-b286-7b47657d2603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:50.745744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5299d5-cac5-4dc5-b286-7b47657d2603 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:50.835745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 844/1686] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:50 2022] POST /identity/v3/users => generated 304 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:50.838436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-80771e7f-bafe-403b-ba9f-bc6fea544b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39779aae74b443d1b91d707936fc1046'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:50.839017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5299d5-cac5-4dc5-b286-7b47657d2603 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:50.848018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-bf5299d5-cac5-4dc5-b286-7b47657d2603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:50.867507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-80771e7f-bafe-403b-ba9f-bc6fea544b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39779aae74b443d1b91d707936fc1046'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:50.876533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5299d5-cac5-4dc5-b286-7b47657d2603 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:50.878689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-80771e7f-bafe-403b-ba9f-bc6fea544b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39779aae74b443d1b91d707936fc1046'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:50.879312 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-80771e7f-bafe-403b-ba9f-bc6fea544b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39779aae74b443d1b91d707936fc1046'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:50.886343 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f223f7-074e-46f4-9da2-fbb105a6c75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:50.887365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f223f7-074e-46f4-9da2-fbb105a6c75e admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:50.887879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f223f7-074e-46f4-9da2-fbb105a6c75e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:50.888351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f223f7-074e-46f4-9da2-fbb105a6c75e admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:50.889491 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f223f7-074e-46f4-9da2-fbb105a6c75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:50.892036 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f223f7-074e-46f4-9da2-fbb105a6c75e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:50.908643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 845/1687] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:50.910447 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4761b-7bd5-4449-9174-2fa08b7190bc None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:50.911062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4761b-7bd5-4449-9174-2fa08b7190bc None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:50.911578 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4761b-7bd5-4449-9174-2fa08b7190bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:50.919673 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:50.934448 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-1ad4761b-7bd5-4449-9174-2fa08b7190bc None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:50.935944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1ad4761b-7bd5-4449-9174-2fa08b7190bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:50.947374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 846/1688] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:50.949107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf75c2d-b3eb-4519-be7c-aa6bf83dc559 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:50.949401 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf75c2d-b3eb-4519-be7c-aa6bf83dc559 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:50.949712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf75c2d-b3eb-4519-be7c-aa6bf83dc559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:50.988102 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-4cf75c2d-b3eb-4519-be7c-aa6bf83dc559 None None] MFA Rules not processed for user `199a0c82abd34b5f88063d79d89da19d`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:50.989510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4cf75c2d-b3eb-4519-be7c-aa6bf83dc559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:51.032897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-80771e7f-bafe-403b-ba9f-bc6fea544b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39779aae74b443d1b91d707936fc1046'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:51.037434 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 843/1689] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:50 2022] DELETE /identity/v3/users/39779aae74b443d1b91d707936fc1046 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:51.038477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80771e7f-bafe-403b-ba9f-bc6fea544b24 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:51.041185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-80771e7f-bafe-403b-ba9f-bc6fea544b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:51.145044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 847/1690] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:51.146811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf75c2d-b3eb-4519-be7c-aa6bf83dc559 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:51.148306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4cf75c2d-b3eb-4519-be7c-aa6bf83dc559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:51.180961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf75c2d-b3eb-4519-be7c-aa6bf83dc559 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:51.209475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80771e7f-bafe-403b-ba9f-bc6fea544b24 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:51.215319 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eb5ce-dbb4-4e60-b823-8a0c0b395ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:51.216884 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb5ce-dbb4-4e60-b823-8a0c0b395ceb admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:51.218791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb5ce-dbb4-4e60-b823-8a0c0b395ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:51.219085 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb5ce-dbb4-4e60-b823-8a0c0b395ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:51.220138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eb5ce-dbb4-4e60-b823-8a0c0b395ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:51.223973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eb5ce-dbb4-4e60-b823-8a0c0b395ceb admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:51.239247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 844/1691] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:51.261032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3792f-26ba-4800-a82a-2dfbaa5f05a0 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:51.261283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3792f-26ba-4800-a82a-2dfbaa5f05a0 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:51.261535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3792f-26ba-4800-a82a-2dfbaa5f05a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:51.274924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c110ff-f6c5-4b72-ade3-b6f1b5163138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:51.276291 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c110ff-f6c5-4b72-ade3-b6f1b5163138 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:51.276906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c110ff-f6c5-4b72-ade3-b6f1b5163138 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:51.277288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c110ff-f6c5-4b72-ade3-b6f1b5163138 admin admin] PATH_INFO: `/v3/projects/e62c9e63f0ab48d0b3b1fd39c5143cac/users/d2d3023c87e14c06be246c89391aae77/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:51.293527 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c110ff-f6c5-4b72-ade3-b6f1b5163138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e62c9e63f0ab48d0b3b1fd39c5143cac, user_id=d2d3023c87e14c06be246c89391aae77, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:51.303326 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c110ff-f6c5-4b72-ade3-b6f1b5163138 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:51.314148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-3cf3792f-26ba-4800-a82a-2dfbaa5f05a0 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:51.318814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3cf3792f-26ba-4800-a82a-2dfbaa5f05a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:51.337266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 848/1692] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:51 2022] PUT /identity/v3/projects/e62c9e63f0ab48d0b3b1fd39c5143cac/users/d2d3023c87e14c06be246c89391aae77/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:51.337266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fd19c-867d-4eba-b5af-5b952591dd7d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:51.337266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fd19c-867d-4eba-b5af-5b952591dd7d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:51.337266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fd19c-867d-4eba-b5af-5b952591dd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:51.369147 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-8d0fd19c-867d-4eba-b5af-5b952591dd7d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:51.371383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8d0fd19c-867d-4eba-b5af-5b952591dd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:51.474066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 845/1693] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:51.476995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3792f-26ba-4800-a82a-2dfbaa5f05a0 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:51.478164 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3cf3792f-26ba-4800-a82a-2dfbaa5f05a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:51.564666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 849/1694] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:51.565591 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fd19c-867d-4eba-b5af-5b952591dd7d None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:51.584446 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fd19c-867d-4eba-b5af-5b952591dd7d None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:51.608998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2539850-c264-489d-a02a-aa4bb017688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:51.609710 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2539850-c264-489d-a02a-aa4bb017688f admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:51.609993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2539850-c264-489d-a02a-aa4bb017688f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:51.610265 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2539850-c264-489d-a02a-aa4bb017688f admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:51.611172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2539850-c264-489d-a02a-aa4bb017688f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:51.612849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2539850-c264-489d-a02a-aa4bb017688f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:51.619648 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3792f-26ba-4800-a82a-2dfbaa5f05a0 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:51.632202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0e52a-f918-470d-9c1c-bf48e5dc4d70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:51.633963 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0e52a-f918-470d-9c1c-bf48e5dc4d70 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:51.634263 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0e52a-f918-470d-9c1c-bf48e5dc4d70 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:51.634598 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0e52a-f918-470d-9c1c-bf48e5dc4d70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:51.646516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 850/1695] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:51.650166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14700423-484b-4328-8bd6-c6c26dcb9255 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:51.650461 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14700423-484b-4328-8bd6-c6c26dcb9255 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:51.650738 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14700423-484b-4328-8bd6-c6c26dcb9255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:51.717236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0e52a-f918-470d-9c1c-bf48e5dc4d70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:51.719255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0e52a-f918-470d-9c1c-bf48e5dc4d70 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:51.726580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-14700423-484b-4328-8bd6-c6c26dcb9255 None None] MFA Rules not processed for user `d2d3023c87e14c06be246c89391aae77`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:51.735844 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-14700423-484b-4328-8bd6-c6c26dcb9255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:51.741052 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 846/1696] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:51.746778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0e52a-f918-470d-9c1c-bf48e5dc4d70 service nova] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:51.784707 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0e52a-f918-470d-9c1c-bf48e5dc4d70 service nova] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:51.795832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8016cd-bbfc-490a-9afa-95f961c84437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:51.797098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8016cd-bbfc-490a-9afa-95f961c84437 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:51.798187 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8016cd-bbfc-490a-9afa-95f961c84437 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:51.799946 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8016cd-bbfc-490a-9afa-95f961c84437 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:51.803492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8016cd-bbfc-490a-9afa-95f961c84437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:51.803806 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8016cd-bbfc-490a-9afa-95f961c84437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:51.805523 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8016cd-bbfc-490a-9afa-95f961c84437 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:51.822649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 847/1697] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:51.826230 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8016cd-bbfc-490a-9afa-95f961c84437 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:51.842749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-be8016cd-bbfc-490a-9afa-95f961c84437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:51.982741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8016cd-bbfc-490a-9afa-95f961c84437 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:51.994411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de4aa6-4ae6-40cf-8aad-2264fcb39c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:51.995625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de4aa6-4ae6-40cf-8aad-2264fcb39c6d service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:51.996663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de4aa6-4ae6-40cf-8aad-2264fcb39c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:51.997184 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de4aa6-4ae6-40cf-8aad-2264fcb39c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:52.013784 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de4aa6-4ae6-40cf-8aad-2264fcb39c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:52.018320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 851/1698] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:52.018320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14700423-484b-4328-8bd6-c6c26dcb9255 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:52.018517 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de4aa6-4ae6-40cf-8aad-2264fcb39c6d service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:52.030107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 848/1699] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:52.031907 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de4aa6-4ae6-40cf-8aad-2264fcb39c6d service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:52.034638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14700423-484b-4328-8bd6-c6c26dcb9255 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:52.039794 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab705a-9e9e-4ee0-9b2d-a36b6e8c31a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:52.041115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab705a-9e9e-4ee0-9b2d-a36b6e8c31a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:52.041408 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab705a-9e9e-4ee0-9b2d-a36b6e8c31a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:52.041695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab705a-9e9e-4ee0-9b2d-a36b6e8c31a9 admin admin] PATH_INFO: `/v3/projects/4b9375015e9e48728dcb963e03e0b054/users/0d675d0380834275b04a7272aa0c1ad8/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:52.042561 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de4aa6-4ae6-40cf-8aad-2264fcb39c6d service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:52.048609 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6f6a0-fad5-435c-9ca7-2e0f59b24445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:52.049382 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6f6a0-fad5-435c-9ca7-2e0f59b24445 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:52.049793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6f6a0-fad5-435c-9ca7-2e0f59b24445 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:52.050182 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6f6a0-fad5-435c-9ca7-2e0f59b24445 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:52.051160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6f6a0-fad5-435c-9ca7-2e0f59b24445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:52.053340 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6f6a0-fad5-435c-9ca7-2e0f59b24445 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:52.059793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab705a-9e9e-4ee0-9b2d-a36b6e8c31a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9375015e9e48728dcb963e03e0b054, user_id=0d675d0380834275b04a7272aa0c1ad8, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:52.063479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab705a-9e9e-4ee0-9b2d-a36b6e8c31a9 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:52.122708 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:52.189614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 852/1700] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:52 2022] PUT /identity/v3/projects/4b9375015e9e48728dcb963e03e0b054/users/0d675d0380834275b04a7272aa0c1ad8/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:52.194900 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 849/1701] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:52 2022] POST /identity/v3/projects => generated 357 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:52.194900 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6f6a0-fad5-435c-9ca7-2e0f59b24445 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:52.196238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a322d-0c29-4bac-a044-d15cb5844c49 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:52.196665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a322d-0c29-4bac-a044-d15cb5844c49 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:52.197092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a322d-0c29-4bac-a044-d15cb5844c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:52.201804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-27d6f6a0-fad5-435c-9ca7-2e0f59b24445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:52.235216 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-af6a322d-0c29-4bac-a044-d15cb5844c49 None None] MFA Rules not processed for user `b839f3c96b7d4893ae4a7500865ad760`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:52.236475 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-af6a322d-0c29-4bac-a044-d15cb5844c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:52.305180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6f6a0-fad5-435c-9ca7-2e0f59b24445 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:52.312837 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b42c2-1060-4bb6-90b4-264ba27fb76f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:52.313509 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b42c2-1060-4bb6-90b4-264ba27fb76f service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:52.313792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b42c2-1060-4bb6-90b4-264ba27fb76f service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:52.314070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b42c2-1060-4bb6-90b4-264ba27fb76f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:52.343116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 853/1702] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:52.344010 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a322d-0c29-4bac-a044-d15cb5844c49 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:52.499895 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b42c2-1060-4bb6-90b4-264ba27fb76f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:52.501376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b42c2-1060-4bb6-90b4-264ba27fb76f service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:52.513849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a322d-0c29-4bac-a044-d15cb5844c49 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:52.522699 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d48ae-9350-4d79-8315-f7dc5bcc98f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:52.526466 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d48ae-9350-4d79-8315-f7dc5bcc98f9 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:52.526774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d48ae-9350-4d79-8315-f7dc5bcc98f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:52.527092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d48ae-9350-4d79-8315-f7dc5bcc98f9 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:52.528373 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 850/1703] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:52.532177 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cf632-2930-4cfc-a719-f4ce1ab3c10a None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:52.532483 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cf632-2930-4cfc-a719-f4ce1ab3c10a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:52.532918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cf632-2930-4cfc-a719-f4ce1ab3c10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:52.547045 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d48ae-9350-4d79-8315-f7dc5bcc98f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:52.551128 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d48ae-9350-4d79-8315-f7dc5bcc98f9 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:52.578958 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-616cf632-2930-4cfc-a719-f4ce1ab3c10a None None] MFA Rules not processed for user `0d675d0380834275b04a7272aa0c1ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:52.580192 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-616cf632-2930-4cfc-a719-f4ce1ab3c10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:52.662777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 851/1704] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:52.662777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43235f-941b-49ac-9076-09a925b3895b None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:52.662777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43235f-941b-49ac-9076-09a925b3895b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:52.662777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43235f-941b-49ac-9076-09a925b3895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:52.686152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-6e43235f-941b-49ac-9076-09a925b3895b None None] MFA Rules not processed for user `b839f3c96b7d4893ae4a7500865ad760`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:52.686152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6e43235f-941b-49ac-9076-09a925b3895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:52.696446 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 852/1705] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:52.697532 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43235f-941b-49ac-9076-09a925b3895b None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:52.710198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43235f-941b-49ac-9076-09a925b3895b None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:52.714988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 854/1706] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:52 2022] POST /identity/v3/users => generated 279 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:52.716438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d48ae-9350-4d79-8315-f7dc5bcc98f9 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:52.717383 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311f771-b016-492b-8fda-6257464bb355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:52.718092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311f771-b016-492b-8fda-6257464bb355 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:52.718403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311f771-b016-492b-8fda-6257464bb355 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:52.718682 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311f771-b016-492b-8fda-6257464bb355 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:52.719410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311f771-b016-492b-8fda-6257464bb355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:52.721637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311f771-b016-492b-8fda-6257464bb355 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:52.742006 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d48ae-9350-4d79-8315-f7dc5bcc98f9 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:52.751717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f152636-0eaf-4c90-b2cb-471e3d9e3ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:52.754979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f152636-0eaf-4c90-b2cb-471e3d9e3ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:52.754979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f152636-0eaf-4c90-b2cb-471e3d9e3ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:52.754979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f152636-0eaf-4c90-b2cb-471e3d9e3ecc admin admin] PATH_INFO: `/v3/users/a9b6bbc18da94ebe8fc83895b7f80c0f` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:52.755862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f152636-0eaf-4c90-b2cb-471e3d9e3ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b6bbc18da94ebe8fc83895b7f80c0f)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:52.763683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f152636-0eaf-4c90-b2cb-471e3d9e3ecc admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:52.826364 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 853/1707] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:52 2022] POST /identity/v3/projects => generated 407 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:52.828639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311f771-b016-492b-8fda-6257464bb355 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:52.830358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7311f771-b016-492b-8fda-6257464bb355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:52.952669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311f771-b016-492b-8fda-6257464bb355 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:52.965987 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:52.967229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:52.967642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:52.968578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] PATH_INFO: `/v3/projects/261283c8e8c4447b96e01502e6923d7d` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:52.973389 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=261283c8e8c4447b96e01502e6923d7d)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:52.975462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:53.015937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:53.085902 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2f152636-0eaf-4c90-b2cb-471e3d9e3ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b6bbc18da94ebe8fc83895b7f80c0f'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:53.144757 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261283c8e8c4447b96e01502e6923d7d', 'request_id': 'req-838a9381-8e76-4bc7-ba87-e80377a04be2'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:53.211498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2f152636-0eaf-4c90-b2cb-471e3d9e3ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b6bbc18da94ebe8fc83895b7f80c0f'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:53.229660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2f152636-0eaf-4c90-b2cb-471e3d9e3ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b6bbc18da94ebe8fc83895b7f80c0f'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:53.230640 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2f152636-0eaf-4c90-b2cb-471e3d9e3ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b6bbc18da94ebe8fc83895b7f80c0f'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:53.241688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2f152636-0eaf-4c90-b2cb-471e3d9e3ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b6bbc18da94ebe8fc83895b7f80c0f'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:53.249746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 855/1708] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:52 2022] DELETE /identity/v3/users/a9b6bbc18da94ebe8fc83895b7f80c0f => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:53.250899 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f152636-0eaf-4c90-b2cb-471e3d9e3ecc admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:53.257121 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2f152636-0eaf-4c90-b2cb-471e3d9e3ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:53.275477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261283c8e8c4447b96e01502e6923d7d', 'request_id': 'req-838a9381-8e76-4bc7-ba87-e80377a04be2'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:53.284635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261283c8e8c4447b96e01502e6923d7d', 'request_id': 'req-838a9381-8e76-4bc7-ba87-e80377a04be2'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:53.298601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:53.311989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] The token cache is being invalidate because project 261283c8e8c4447b96e01502e6923d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:56:53.312272 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:53.315040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:53.317234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 854/1709] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:56:52 2022] DELETE /identity/v3/projects/261283c8e8c4447b96e01502e6923d7d => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:53.322091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:53.326515 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:53.427264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f152636-0eaf-4c90-b2cb-471e3d9e3ecc admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:53.435476 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49366477-bbf5-460a-992d-0a35703003cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:53.438891 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49366477-bbf5-460a-992d-0a35703003cb service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:53.439368 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49366477-bbf5-460a-992d-0a35703003cb service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:53.442501 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49366477-bbf5-460a-992d-0a35703003cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:53.445761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-49366477-bbf5-460a-992d-0a35703003cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:53.474225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a9381-8e76-4bc7-ba87-e80377a04be2 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:53.602650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49366477-bbf5-460a-992d-0a35703003cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:53.604446 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49366477-bbf5-460a-992d-0a35703003cb service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:53.615102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64ab95-739d-4afa-b624-537a82c59af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:53.615817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64ab95-739d-4afa-b624-537a82c59af0 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:53.616108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64ab95-739d-4afa-b624-537a82c59af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:53.616391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64ab95-739d-4afa-b624-537a82c59af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:53.617732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64ab95-739d-4afa-b624-537a82c59af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:53.619435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64ab95-739d-4afa-b624-537a82c59af0 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:53.634494 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 855/1710] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:53.634494 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64ab95-739d-4afa-b624-537a82c59af0 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:53.634781 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 856/1711] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:53.635505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0f899-e74d-4af9-8569-b948f960efd4 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:53.635635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ca64ab95-739d-4afa-b624-537a82c59af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:53.635723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0f899-e74d-4af9-8569-b948f960efd4 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:53.636691 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0f899-e74d-4af9-8569-b948f960efd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:53.649583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64ab95-739d-4afa-b624-537a82c59af0 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:53.655670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696b060-30a2-41aa-8c3f-e15f769943ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:53.655670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696b060-30a2-41aa-8c3f-e15f769943ed admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:53.655987 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696b060-30a2-41aa-8c3f-e15f769943ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:53.656351 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696b060-30a2-41aa-8c3f-e15f769943ed admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:53.657123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696b060-30a2-41aa-8c3f-e15f769943ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:53.659145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696b060-30a2-41aa-8c3f-e15f769943ed admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:53.674988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-86f0f899-e74d-4af9-8569-b948f960efd4 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:53.678406 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-86f0f899-e74d-4af9-8569-b948f960efd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:53.690886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 857/1712] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:53.693146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca48224-d2d0-4d50-b697-b65aa04537d9 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:53.693623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca48224-d2d0-4d50-b697-b65aa04537d9 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:53.694014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca48224-d2d0-4d50-b697-b65aa04537d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:53.719486 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-8ca48224-d2d0-4d50-b697-b65aa04537d9 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:53.720896 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8ca48224-d2d0-4d50-b697-b65aa04537d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:53.732347 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 858/1713] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:53.732759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca48224-d2d0-4d50-b697-b65aa04537d9 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:53.746209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca48224-d2d0-4d50-b697-b65aa04537d9 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:53.753111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b854d76-0673-4fd5-8eb8-b1e5cb452886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:53.753926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b854d76-0673-4fd5-8eb8-b1e5cb452886 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:53.754286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b854d76-0673-4fd5-8eb8-b1e5cb452886 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:53.754636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b854d76-0673-4fd5-8eb8-b1e5cb452886 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:53.755501 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b854d76-0673-4fd5-8eb8-b1e5cb452886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:53.757192 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b854d76-0673-4fd5-8eb8-b1e5cb452886 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:53.770762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 859/1714] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:53.772477 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b854d76-0673-4fd5-8eb8-b1e5cb452886 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:53.774785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2b854d76-0673-4fd5-8eb8-b1e5cb452886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:53.897047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 856/1715] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:53 2022] POST /identity/v3/users => generated 310 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:53.897047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373debd4-05c4-4152-9e57-627bf69f97c5 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:53.897047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373debd4-05c4-4152-9e57-627bf69f97c5 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:53.897047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373debd4-05c4-4152-9e57-627bf69f97c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:53.913423 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b854d76-0673-4fd5-8eb8-b1e5cb452886 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:53.926566 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005339cd-a9ee-410d-a5a5-715a81d29ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:53.927776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005339cd-a9ee-410d-a5a5-715a81d29ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:53.928164 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005339cd-a9ee-410d-a5a5-715a81d29ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:53.928548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005339cd-a9ee-410d-a5a5-715a81d29ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:53.937592 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-373debd4-05c4-4152-9e57-627bf69f97c5 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:53.943222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-373debd4-05c4-4152-9e57-627bf69f97c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:53.948278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005339cd-a9ee-410d-a5a5-715a81d29ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:53.950019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005339cd-a9ee-410d-a5a5-715a81d29ac6 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:53.965890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 857/1716] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:53.965890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373debd4-05c4-4152-9e57-627bf69f97c5 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:53.974273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 860/1717] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:53.975224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005339cd-a9ee-410d-a5a5-715a81d29ac6 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:53.985438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373debd4-05c4-4152-9e57-627bf69f97c5 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:53.992741 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005339cd-a9ee-410d-a5a5-715a81d29ac6 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:53.997992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e41d4-756c-4c11-a7e0-03ef6adf29b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:54.000569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e41d4-756c-4c11-a7e0-03ef6adf29b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:54.000569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e41d4-756c-4c11-a7e0-03ef6adf29b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:54.000569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e41d4-756c-4c11-a7e0-03ef6adf29b4 admin admin] PATH_INFO: `/v3/projects/7455ce2663824098ad7d21e6c26d11fc/users/d3b40e517a9b43d897ddf6496bdbe448/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:54.008856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308bc67-71dc-4182-826b-2ea8f95ea5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:54.009662 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308bc67-71dc-4182-826b-2ea8f95ea5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:54.010165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308bc67-71dc-4182-826b-2ea8f95ea5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:54.010487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308bc67-71dc-4182-826b-2ea8f95ea5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:54.011360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308bc67-71dc-4182-826b-2ea8f95ea5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:54.014683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308bc67-71dc-4182-826b-2ea8f95ea5e8 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:54.037324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e41d4-756c-4c11-a7e0-03ef6adf29b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7455ce2663824098ad7d21e6c26d11fc, user_id=d3b40e517a9b43d897ddf6496bdbe448, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:54.038062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 861/1718] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:54.039200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308bc67-71dc-4182-826b-2ea8f95ea5e8 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:54.039980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e41d4-756c-4c11-a7e0-03ef6adf29b4 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:54.054328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308bc67-71dc-4182-826b-2ea8f95ea5e8 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:54.059328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0cda2-cc4f-404d-866e-93cac6d071ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:54.060154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0cda2-cc4f-404d-866e-93cac6d071ee admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:54.060520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0cda2-cc4f-404d-866e-93cac6d071ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:54.060867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0cda2-cc4f-404d-866e-93cac6d071ee admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:54.061791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0cda2-cc4f-404d-866e-93cac6d071ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:54.062168 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0cda2-cc4f-404d-866e-93cac6d071ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:54.063993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0cda2-cc4f-404d-866e-93cac6d071ee admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:54.084687 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 862/1719] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:54.088613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0cda2-cc4f-404d-866e-93cac6d071ee admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:54.101052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0cda2-cc4f-404d-866e-93cac6d071ee admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:54.106314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babef847-a2fe-4dc7-85df-ebc4a1cf3501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:54.107377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babef847-a2fe-4dc7-85df-ebc4a1cf3501 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:54.107794 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babef847-a2fe-4dc7-85df-ebc4a1cf3501 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:54.108316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babef847-a2fe-4dc7-85df-ebc4a1cf3501 admin admin] PATH_INFO: `/v3/projects/07593cd458cd46f8b62f74642adb5797/users/57887928075a4e1a8952755f90712dac/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:54.146484 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babef847-a2fe-4dc7-85df-ebc4a1cf3501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07593cd458cd46f8b62f74642adb5797, user_id=57887928075a4e1a8952755f90712dac, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:54.146484 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babef847-a2fe-4dc7-85df-ebc4a1cf3501 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:54.174503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 858/1720] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:53 2022] PUT /identity/v3/projects/7455ce2663824098ad7d21e6c26d11fc/users/d3b40e517a9b43d897ddf6496bdbe448/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:54.175844 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e41d4-756c-4c11-a7e0-03ef6adf29b4 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:54.272774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 863/1721] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:54 2022] PUT /identity/v3/projects/07593cd458cd46f8b62f74642adb5797/users/57887928075a4e1a8952755f90712dac/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:54.274477 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91896a-42b9-4099-bd86-25d543e47618 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:54.274936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91896a-42b9-4099-bd86-25d543e47618 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:54.278252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91896a-42b9-4099-bd86-25d543e47618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:54.367514 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-7e91896a-42b9-4099-bd86-25d543e47618 None None] MFA Rules not processed for user `d3b40e517a9b43d897ddf6496bdbe448`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:54.372465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-7e91896a-42b9-4099-bd86-25d543e47618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:54.396815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e41d4-756c-4c11-a7e0-03ef6adf29b4 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:54.521961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 864/1722] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:54 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:54.521961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb73c2-511e-4a30-949c-92aa2b81f6a0 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:54.522733 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb73c2-511e-4a30-949c-92aa2b81f6a0 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:54.524530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb73c2-511e-4a30-949c-92aa2b81f6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:54.556803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655ffde-b917-4653-b744-78db25c8af15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:54.559612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655ffde-b917-4653-b744-78db25c8af15 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:54.560116 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655ffde-b917-4653-b744-78db25c8af15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:54.560702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655ffde-b917-4653-b744-78db25c8af15 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:54.563646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655ffde-b917-4653-b744-78db25c8af15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:54.567339 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655ffde-b917-4653-b744-78db25c8af15 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:54.571620 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-bceb73c2-511e-4a30-949c-92aa2b81f6a0 None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:54.573740 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-bceb73c2-511e-4a30-949c-92aa2b81f6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:54.699932 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 859/1723] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:54 2022] POST /identity/v3/projects => generated 363 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:54.700976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655ffde-b917-4653-b744-78db25c8af15 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:54.754325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 865/1724] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 13:56:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:54.755268 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb73c2-511e-4a30-949c-92aa2b81f6a0 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:54.779977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb73c2-511e-4a30-949c-92aa2b81f6a0 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:54.841460 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655ffde-b917-4653-b744-78db25c8af15 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:54.850944 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6440d3-cde3-4250-b762-aae23fbd7e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:54.853585 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6440d3-cde3-4250-b762-aae23fbd7e61 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:54.854457 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6440d3-cde3-4250-b762-aae23fbd7e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:54.854457 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6440d3-cde3-4250-b762-aae23fbd7e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:54.855759 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6440d3-cde3-4250-b762-aae23fbd7e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:54.859206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6440d3-cde3-4250-b762-aae23fbd7e61 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:54.898031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 860/1725] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:54.898031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6440d3-cde3-4250-b762-aae23fbd7e61 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:54.925711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6440d3-cde3-4250-b762-aae23fbd7e61 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:54.942051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426feb-6056-4a00-93db-d9763e5a4647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:54.942835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426feb-6056-4a00-93db-d9763e5a4647 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:54.943199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426feb-6056-4a00-93db-d9763e5a4647 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:54.944143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426feb-6056-4a00-93db-d9763e5a4647 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:54.945565 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7426feb-6056-4a00-93db-d9763e5a4647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:54.955349 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7426feb-6056-4a00-93db-d9763e5a4647 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:55.022202 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8350fc-eacc-43c7-82ee-9c634068bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:55.022762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8350fc-eacc-43c7-82ee-9c634068bdec admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:55.023409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8350fc-eacc-43c7-82ee-9c634068bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:55.023409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8350fc-eacc-43c7-82ee-9c634068bdec admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:55.023999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8350fc-eacc-43c7-82ee-9c634068bdec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:55.027774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8350fc-eacc-43c7-82ee-9c634068bdec admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:55.091261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 861/1726] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:54 2022] POST /identity/v3/users => generated 282 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:55.092201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426feb-6056-4a00-93db-d9763e5a4647 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:55.121819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426feb-6056-4a00-93db-d9763e5a4647 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:55.154925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df4542-faf8-4606-9850-d49f66ad0769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:55.156459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4542-faf8-4606-9850-d49f66ad0769 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:55.156748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4542-faf8-4606-9850-d49f66ad0769 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:55.157027 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4542-faf8-4606-9850-d49f66ad0769 admin admin] PATH_INFO: `/v3/projects/07593cd458cd46f8b62f74642adb5797/users/57887928075a4e1a8952755f90712dac/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:55.165464 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df4542-faf8-4606-9850-d49f66ad0769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07593cd458cd46f8b62f74642adb5797, user_id=57887928075a4e1a8952755f90712dac, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:55.168235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df4542-faf8-4606-9850-d49f66ad0769 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:55.190543 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:55.204317 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 862/1727] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:55 2022] PUT /identity/v3/projects/07593cd458cd46f8b62f74642adb5797/users/57887928075a4e1a8952755f90712dac/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:55.205394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df4542-faf8-4606-9850-d49f66ad0769 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:55.207263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 866/1728] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:54 2022] POST /identity/v3/projects => generated 355 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:55.209473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46267b-c178-44ab-8dc5-6d7081dbbd53 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:55.210050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46267b-c178-44ab-8dc5-6d7081dbbd53 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:55.210050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46267b-c178-44ab-8dc5-6d7081dbbd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:55.277925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-9e46267b-c178-44ab-8dc5-6d7081dbbd53 None None] MFA Rules not processed for user `57887928075a4e1a8952755f90712dac`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:55.279123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9e46267b-c178-44ab-8dc5-6d7081dbbd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:55.353156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df4542-faf8-4606-9850-d49f66ad0769 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:55.380614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 867/1729] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:55 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:55.381758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46267b-c178-44ab-8dc5-6d7081dbbd53 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:55.506713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38184c97-c930-4dd5-8a63-f70965a7ea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:55.507351 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38184c97-c930-4dd5-8a63-f70965a7ea9e admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:55.507658 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38184c97-c930-4dd5-8a63-f70965a7ea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:55.507930 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38184c97-c930-4dd5-8a63-f70965a7ea9e admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:55.512604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38184c97-c930-4dd5-8a63-f70965a7ea9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:55.512604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38184c97-c930-4dd5-8a63-f70965a7ea9e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:55.534281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46267b-c178-44ab-8dc5-6d7081dbbd53 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:55.557799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 863/1730] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:55.559332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38184c97-c930-4dd5-8a63-f70965a7ea9e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:55.563728 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bc9e7-7b6c-4b83-85c9-5c4e0194bac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:55.563728 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bc9e7-7b6c-4b83-85c9-5c4e0194bac8 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:55.563728 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bc9e7-7b6c-4b83-85c9-5c4e0194bac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:55.565913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-38184c97-c930-4dd5-8a63-f70965a7ea9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:55.567480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bc9e7-7b6c-4b83-85c9-5c4e0194bac8 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:55.570116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bc9e7-7b6c-4b83-85c9-5c4e0194bac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:55.578558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bc9e7-7b6c-4b83-85c9-5c4e0194bac8 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:55.603588 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:55.720432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 868/1731] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:55 2022] POST /identity/v3/users => generated 284 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:55.721520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bc9e7-7b6c-4b83-85c9-5c4e0194bac8 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:55.728161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-157bc9e7-7b6c-4b83-85c9-5c4e0194bac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:55.769951 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38184c97-c930-4dd5-8a63-f70965a7ea9e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:55.786490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be209e-2aea-4de2-897b-140e7e95aae7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:55.787884 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be209e-2aea-4de2-897b-140e7e95aae7 service swift] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:55.788886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be209e-2aea-4de2-897b-140e7e95aae7 service swift] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:55.790360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be209e-2aea-4de2-897b-140e7e95aae7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:55.930364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bc9e7-7b6c-4b83-85c9-5c4e0194bac8 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:55.950576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368d39e-b887-4dde-b9c6-8d325ac836ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:55.950576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d39e-b887-4dde-b9c6-8d325ac836ab service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:55.950576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d39e-b887-4dde-b9c6-8d325ac836ab service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:55.950576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d39e-b887-4dde-b9c6-8d325ac836ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:55.968119 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368d39e-b887-4dde-b9c6-8d325ac836ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:55.969656 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368d39e-b887-4dde-b9c6-8d325ac836ab service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:55.988786 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be209e-2aea-4de2-897b-140e7e95aae7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:55.990743 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be209e-2aea-4de2-897b-140e7e95aae7 service swift] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:55.993865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 869/1732] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:55 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:55.995269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4206a76-7b5f-44e3-996e-ea9587d766b5 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:55.995595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4206a76-7b5f-44e3-996e-ea9587d766b5 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:55.995969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4206a76-7b5f-44e3-996e-ea9587d766b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:56.019108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 864/1733] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 13:56:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:56:56.021967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be209e-2aea-4de2-897b-140e7e95aae7 service swift] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:56.037915 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-b4206a76-7b5f-44e3-996e-ea9587d766b5 None None] MFA Rules not processed for user `b839f3c96b7d4893ae4a7500865ad760`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:56.038732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b4206a76-7b5f-44e3-996e-ea9587d766b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:56.066372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be209e-2aea-4de2-897b-140e7e95aae7 service swift] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:56.091595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72158e72-3608-4f3a-9e8b-cfda278ffb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:56.092426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72158e72-3608-4f3a-9e8b-cfda278ffb6d admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:56.099263 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72158e72-3608-4f3a-9e8b-cfda278ffb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:56.099677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72158e72-3608-4f3a-9e8b-cfda278ffb6d admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:56.100539 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72158e72-3608-4f3a-9e8b-cfda278ffb6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:56.106830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72158e72-3608-4f3a-9e8b-cfda278ffb6d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:56.166360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 865/1734] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:56.167443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72158e72-3608-4f3a-9e8b-cfda278ffb6d admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:56.185214 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-72158e72-3608-4f3a-9e8b-cfda278ffb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:56.206701 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 870/1735] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:56.209468 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4206a76-7b5f-44e3-996e-ea9587d766b5 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:56.225247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72158e72-3608-4f3a-9e8b-cfda278ffb6d admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:56.240430 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:56.241325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:56.246588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:56.250364 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] PATH_INFO: `/v3/projects/8789c1f67c684d72bee883461fcc7a95` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:56.252081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4206a76-7b5f-44e3-996e-ea9587d766b5 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:56.257410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8789c1f67c684d72bee883461fcc7a95)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:56.271537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:56.272872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558e57-dba7-4efc-a3b2-57f8499f3f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:56.275252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558e57-dba7-4efc-a3b2-57f8499f3f58 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:56.275739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558e57-dba7-4efc-a3b2-57f8499f3f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:56.276281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558e57-dba7-4efc-a3b2-57f8499f3f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:56.277334 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc558e57-dba7-4efc-a3b2-57f8499f3f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:56.283058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc558e57-dba7-4efc-a3b2-57f8499f3f58 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:56.325361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 871/1736] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:56.333335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ab2d-a10c-4f7c-a05a-3434b6528e36 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:56.333628 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ab2d-a10c-4f7c-a05a-3434b6528e36 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:56.333915 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ab2d-a10c-4f7c-a05a-3434b6528e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:56.525340 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-fd15ab2d-a10c-4f7c-a05a-3434b6528e36 None None] MFA Rules not processed for user `d95c75980e114aa488424fb115add647`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:56.532876 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-fd15ab2d-a10c-4f7c-a05a-3434b6528e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:56.547832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8789c1f67c684d72bee883461fcc7a95', 'request_id': 'req-fb5cd7e8-96c9-4372-9a38-6709365a3a58'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:56.656938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8789c1f67c684d72bee883461fcc7a95', 'request_id': 'req-fb5cd7e8-96c9-4372-9a38-6709365a3a58'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:56.672851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8789c1f67c684d72bee883461fcc7a95', 'request_id': 'req-fb5cd7e8-96c9-4372-9a38-6709365a3a58'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:56.709313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 872/1737] 10.222.0.58 () {58 vars in 1015 bytes} [Thu Jun 2 13:56:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:56.712832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15ab2d-a10c-4f7c-a05a-3434b6528e36 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:56.717588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] The token cache is being invalidate because project 8789c1f67c684d72bee883461fcc7a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:56:56.718812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:56.720581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:56.744704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 866/1738] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:56:56 2022] DELETE /identity/v3/projects/8789c1f67c684d72bee883461fcc7a95 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:56.745304 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:56.750783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:56.995223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15ab2d-a10c-4f7c-a05a-3434b6528e36 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:57.018677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cd7e8-96c9-4372-9a38-6709365a3a58 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:57.019287 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57227ea-467b-4922-9fd3-4955201c2259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:57.020527 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57227ea-467b-4922-9fd3-4955201c2259 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:57.021501 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57227ea-467b-4922-9fd3-4955201c2259 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:57.023092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57227ea-467b-4922-9fd3-4955201c2259 admin admin] PATH_INFO: `/v3/projects/b0413126bbcb49ce92bc66084fe4c0c8/users/a551a6d493be43d58bc96ffce973c616/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:57.037544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ef64b-a084-46e9-a3c9-131784f3d1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:57.040759 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ef64b-a084-46e9-a3c9-131784f3d1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:57.047330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ef64b-a084-46e9-a3c9-131784f3d1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:57.047814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ef64b-a084-46e9-a3c9-131784f3d1f2 admin admin] PATH_INFO: `/v3/projects/5edd1cff85e14e24b9f75be146464bfa/users/d7d268f180684e149fe2a270b4b8b89c/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:57.084677 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57227ea-467b-4922-9fd3-4955201c2259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0413126bbcb49ce92bc66084fe4c0c8, user_id=a551a6d493be43d58bc96ffce973c616, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:57.097982 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57227ea-467b-4922-9fd3-4955201c2259 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:57.107065 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ef64b-a084-46e9-a3c9-131784f3d1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5edd1cff85e14e24b9f75be146464bfa, user_id=d7d268f180684e149fe2a270b4b8b89c, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:57.111434 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ef64b-a084-46e9-a3c9-131784f3d1f2 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:57.525001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:57.600037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 867/1740] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:56 2022] PUT /identity/v3/projects/5edd1cff85e14e24b9f75be146464bfa/users/d7d268f180684e149fe2a270b4b8b89c/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:57.600037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ef64b-a084-46e9-a3c9-131784f3d1f2 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:57.602736 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 873/1740] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:56 2022] PUT /identity/v3/projects/b0413126bbcb49ce92bc66084fe4c0c8/users/a551a6d493be43d58bc96ffce973c616/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:57.603999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57227ea-467b-4922-9fd3-4955201c2259 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:57.609823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-774ef64b-a084-46e9-a3c9-131784f3d1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:57.610805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b57227ea-467b-4922-9fd3-4955201c2259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:57.763582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57227ea-467b-4922-9fd3-4955201c2259 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:57.769862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47894235-9c6f-4af2-9cf3-466f65239bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:57.773157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894235-9c6f-4af2-9cf3-466f65239bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:57.773157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894235-9c6f-4af2-9cf3-466f65239bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:57.773157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894235-9c6f-4af2-9cf3-466f65239bf7 admin admin] PATH_INFO: `/v3/users/d2d3023c87e14c06be246c89391aae77` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:57.773157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47894235-9c6f-4af2-9cf3-466f65239bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d3023c87e14c06be246c89391aae77)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:57.775028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47894235-9c6f-4af2-9cf3-466f65239bf7 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:57.833983 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ef64b-a084-46e9-a3c9-131784f3d1f2 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:57.988613 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe40874-337b-46a8-9fad-0f73df00e1c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:57.990061 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe40874-337b-46a8-9fad-0f73df00e1c6 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:57.991014 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe40874-337b-46a8-9fad-0f73df00e1c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:57.992004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe40874-337b-46a8-9fad-0f73df00e1c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:57.995979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-fbe40874-337b-46a8-9fad-0f73df00e1c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:58.020396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe40874-337b-46a8-9fad-0f73df00e1c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:58.023877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe40874-337b-46a8-9fad-0f73df00e1c6 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:58.037762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 868/1741] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:58.038712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe40874-337b-46a8-9fad-0f73df00e1c6 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:58.040743 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-fbe40874-337b-46a8-9fad-0f73df00e1c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:58.153764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe40874-337b-46a8-9fad-0f73df00e1c6 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:58.158475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e0fd7-4d37-4001-ad59-27aede98e765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:58.159145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e0fd7-4d37-4001-ad59-27aede98e765 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:58.159507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e0fd7-4d37-4001-ad59-27aede98e765 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:58.159889 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e0fd7-4d37-4001-ad59-27aede98e765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:58.163649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1b6e0fd7-4d37-4001-ad59-27aede98e765 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:58.313608 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-47894235-9c6f-4af2-9cf3-466f65239bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d3023c87e14c06be246c89391aae77'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:58.371572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e0fd7-4d37-4001-ad59-27aede98e765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:58.373405 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e0fd7-4d37-4001-ad59-27aede98e765 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:58.387143 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-47894235-9c6f-4af2-9cf3-466f65239bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d3023c87e14c06be246c89391aae77'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:58.412866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 869/1742] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:58 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:58.414526 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113a58a-d939-42bc-bca2-40a63636935a None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:58.415717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-47894235-9c6f-4af2-9cf3-466f65239bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d3023c87e14c06be246c89391aae77'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:58.416630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113a58a-d939-42bc-bca2-40a63636935a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:58.416755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113a58a-d939-42bc-bca2-40a63636935a None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:58.420993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 870/1743] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 2 13:56:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:56:58.421377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-47894235-9c6f-4af2-9cf3-466f65239bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d3023c87e14c06be246c89391aae77'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:58.421826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113a58a-d939-42bc-bca2-40a63636935a None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:58.426082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c113a58a-d939-42bc-bca2-40a63636935a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:58.449403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-47894235-9c6f-4af2-9cf3-466f65239bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d3023c87e14c06be246c89391aae77'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:58.473204 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 874/1744] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:57 2022] DELETE /identity/v3/users/d2d3023c87e14c06be246c89391aae77 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:58.474619 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47894235-9c6f-4af2-9cf3-466f65239bf7 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:58.482697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113a58a-d939-42bc-bca2-40a63636935a None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:58.489785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-47894235-9c6f-4af2-9cf3-466f65239bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:58.671437 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78f34d-44b0-4add-baee-ab9cffcd38bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:58.683329 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78f34d-44b0-4add-baee-ab9cffcd38bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:58.686718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78f34d-44b0-4add-baee-ab9cffcd38bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:58.702915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78f34d-44b0-4add-baee-ab9cffcd38bb admin admin] PATH_INFO: `/v3/users/f1c5a9040ded4bafbcd926c00eb7e9e0` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:58.707135 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78f34d-44b0-4add-baee-ab9cffcd38bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c5a9040ded4bafbcd926c00eb7e9e0)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:58.728669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78f34d-44b0-4add-baee-ab9cffcd38bb admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:58.756103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47894235-9c6f-4af2-9cf3-466f65239bf7 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:58.767671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:58.780698 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e876e2-cce9-4105-a91b-0fad7d251dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:58.782831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e876e2-cce9-4105-a91b-0fad7d251dfd admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:58.785423 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e876e2-cce9-4105-a91b-0fad7d251dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:58.786004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e876e2-cce9-4105-a91b-0fad7d251dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:58.787978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e876e2-cce9-4105-a91b-0fad7d251dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:58.792577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e876e2-cce9-4105-a91b-0fad7d251dfd admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:58.834772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 875/1745] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:58.836771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc47d6-a4c3-4b48-9e27-6d64d5e57ddc None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:58.837296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc47d6-a4c3-4b48-9e27-6d64d5e57ddc None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:58.837889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc47d6-a4c3-4b48-9e27-6d64d5e57ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:58.914589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-fefc47d6-a4c3-4b48-9e27-6d64d5e57ddc None None] MFA Rules not processed for user `a551a6d493be43d58bc96ffce973c616`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:58.915854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-fefc47d6-a4c3-4b48-9e27-6d64d5e57ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:59.080457 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0f78f34d-44b0-4add-baee-ab9cffcd38bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c5a9040ded4bafbcd926c00eb7e9e0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:59.130240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0f78f34d-44b0-4add-baee-ab9cffcd38bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c5a9040ded4bafbcd926c00eb7e9e0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:59.144185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0f78f34d-44b0-4add-baee-ab9cffcd38bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c5a9040ded4bafbcd926c00eb7e9e0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:59.144924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0f78f34d-44b0-4add-baee-ab9cffcd38bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c5a9040ded4bafbcd926c00eb7e9e0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:59.171381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 876/1746] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:59.173106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390f768-a4b6-429b-b52e-54c6d91a72d8 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:59.173652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390f768-a4b6-429b-b52e-54c6d91a72d8 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:59.174141 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390f768-a4b6-429b-b52e-54c6d91a72d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:59.202193 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-9390f768-a4b6-429b-b52e-54c6d91a72d8 None None] MFA Rules not processed for user `199a0c82abd34b5f88063d79d89da19d`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:59.226724 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9390f768-a4b6-429b-b52e-54c6d91a72d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:59.241884 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0f78f34d-44b0-4add-baee-ab9cffcd38bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c5a9040ded4bafbcd926c00eb7e9e0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:59.264739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 871/1747] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:58 2022] DELETE /identity/v3/users/f1c5a9040ded4bafbcd926c00eb7e9e0 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:59.268168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ed291-fe41-4bec-ab33-9432fcdc2ffc None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:59.269418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ed291-fe41-4bec-ab33-9432fcdc2ffc None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:59.269864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ed291-fe41-4bec-ab33-9432fcdc2ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:59.323534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-0c2ed291-fe41-4bec-ab33-9432fcdc2ffc None None] MFA Rules not processed for user `d95c75980e114aa488424fb115add647`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:59.325904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0c2ed291-fe41-4bec-ab33-9432fcdc2ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:59.418386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 877/1748] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:59.419513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390f768-a4b6-429b-b52e-54c6d91a72d8 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:59.422997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9390f768-a4b6-429b-b52e-54c6d91a72d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:59.440621 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 872/1749] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 13:56:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:59.443132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ed291-fe41-4bec-ab33-9432fcdc2ffc None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:59.449002 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0c2ed291-fe41-4bec-ab33-9432fcdc2ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:59.479561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390f768-a4b6-429b-b52e-54c6d91a72d8 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:59.682447 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920e700-7142-44b9-a78e-42c652e1b4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:59.685638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920e700-7142-44b9-a78e-42c652e1b4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:59.686133 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920e700-7142-44b9-a78e-42c652e1b4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:59.687108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920e700-7142-44b9-a78e-42c652e1b4f1 admin admin] PATH_INFO: `/v3/projects/5edd1cff85e14e24b9f75be146464bfa/users/d7d268f180684e149fe2a270b4b8b89c/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:59.694521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920e700-7142-44b9-a78e-42c652e1b4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5edd1cff85e14e24b9f75be146464bfa, user_id=d7d268f180684e149fe2a270b4b8b89c, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:59.697752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920e700-7142-44b9-a78e-42c652e1b4f1 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:59.719440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ed291-fe41-4bec-ab33-9432fcdc2ffc None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:59.732877 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 878/1750] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:59 2022] PUT /identity/v3/projects/5edd1cff85e14e24b9f75be146464bfa/users/d7d268f180684e149fe2a270b4b8b89c/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:59.737491 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7ffc5-b367-4535-a543-15c7f9b77cf6 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:59.738130 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7ffc5-b367-4535-a543-15c7f9b77cf6 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:59.739711 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7ffc5-b367-4535-a543-15c7f9b77cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:59.779224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-54e7ffc5-b367-4535-a543-15c7f9b77cf6 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:59.781814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-54e7ffc5-b367-4535-a543-15c7f9b77cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:59.850492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090074e-3248-46c3-a2ab-a7ab503f3404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:59.853487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090074e-3248-46c3-a2ab-a7ab503f3404 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:59.854080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090074e-3248-46c3-a2ab-a7ab503f3404 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:59.855387 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090074e-3248-46c3-a2ab-a7ab503f3404 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:59.858325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090074e-3248-46c3-a2ab-a7ab503f3404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:59.863436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090074e-3248-46c3-a2ab-a7ab503f3404 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:59.916666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 879/1751] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:59.917837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7ffc5-b367-4535-a543-15c7f9b77cf6 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:59.920990 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-54e7ffc5-b367-4535-a543-15c7f9b77cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:59.995763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7ffc5-b367-4535-a543-15c7f9b77cf6 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:00.018129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 873/1752] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:59 2022] POST /identity/v3/projects => generated 363 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:00.019769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095109e-0613-400a-b399-15cf0507879d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:00.022087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095109e-0613-400a-b399-15cf0507879d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:00.023639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095109e-0613-400a-b399-15cf0507879d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:00.101937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-d095109e-0613-400a-b399-15cf0507879d None None] MFA Rules not processed for user `d7d268f180684e149fe2a270b4b8b89c`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:00.104443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d095109e-0613-400a-b399-15cf0507879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:00.170115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884c710-ebfb-4779-965d-0855830175af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:00.171004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884c710-ebfb-4779-965d-0855830175af service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:00.171408 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884c710-ebfb-4779-965d-0855830175af service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:00.171832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884c710-ebfb-4779-965d-0855830175af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:00.188981 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884c710-ebfb-4779-965d-0855830175af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:00.190860 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884c710-ebfb-4779-965d-0855830175af service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:00.202881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 880/1753] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:00.204157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884c710-ebfb-4779-965d-0855830175af service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:00.214397 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884c710-ebfb-4779-965d-0855830175af service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:00.218481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095b598-773e-49c9-96f1-4b704c89bc65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:00.219830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b598-773e-49c9-96f1-4b704c89bc65 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:00.219830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b598-773e-49c9-96f1-4b704c89bc65 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:00.219830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b598-773e-49c9-96f1-4b704c89bc65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:00.252621 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 874/1754] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:00 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:00.252621 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095109e-0613-400a-b399-15cf0507879d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:00.252621 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d095109e-0613-400a-b399-15cf0507879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:00.332967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095b598-773e-49c9-96f1-4b704c89bc65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:00.335782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095b598-773e-49c9-96f1-4b704c89bc65 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:00.349444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095109e-0613-400a-b399-15cf0507879d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:00.354767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:00.355962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:00.357221 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:00.357221 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] PATH_INFO: `/v3/projects/e62c9e63f0ab48d0b3b1fd39c5143cac` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:00.359497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e62c9e63f0ab48d0b3b1fd39c5143cac)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:00.361760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:00.369453 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 881/1755] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:00.371108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095b598-773e-49c9-96f1-4b704c89bc65 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:00.391218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095b598-773e-49c9-96f1-4b704c89bc65 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:00.401349 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbea6a-8d9f-4690-9443-2264977101e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:00.402621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbea6a-8d9f-4690-9443-2264977101e0 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:00.402972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbea6a-8d9f-4690-9443-2264977101e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:00.403994 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbea6a-8d9f-4690-9443-2264977101e0 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:00.404687 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbea6a-8d9f-4690-9443-2264977101e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:00.407165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbea6a-8d9f-4690-9443-2264977101e0 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:00.532090 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e62c9e63f0ab48d0b3b1fd39c5143cac', 'request_id': 'req-57f0ee50-ba11-4e15-acd2-4de4e4bba840'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:00.572791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 882/1756] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:00 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:00.579646 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbea6a-8d9f-4690-9443-2264977101e0 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:00.579646 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6ccbea6a-8d9f-4690-9443-2264977101e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:00.673139 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e62c9e63f0ab48d0b3b1fd39c5143cac', 'request_id': 'req-57f0ee50-ba11-4e15-acd2-4de4e4bba840'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:00.691546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e62c9e63f0ab48d0b3b1fd39c5143cac', 'request_id': 'req-57f0ee50-ba11-4e15-acd2-4de4e4bba840'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:00.691798 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbea6a-8d9f-4690-9443-2264977101e0 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:00.719092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] The token cache is being invalidate because project e62c9e63f0ab48d0b3b1fd39c5143cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:00.719389 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:00.732101 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:00.738304 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 875/1757] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:00 2022] DELETE /identity/v3/projects/e62c9e63f0ab48d0b3b1fd39c5143cac => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:00.739329 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:00.741791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:00.743625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:00.782175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b225c4-89e6-4917-9ce0-de2fd6d9a9a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:00.782907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b225c4-89e6-4917-9ce0-de2fd6d9a9a1 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:00.783198 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b225c4-89e6-4917-9ce0-de2fd6d9a9a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:00.783617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b225c4-89e6-4917-9ce0-de2fd6d9a9a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:00.785789 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-93b225c4-89e6-4917-9ce0-de2fd6d9a9a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:00.803570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:00.921741 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b225c4-89e6-4917-9ce0-de2fd6d9a9a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:00.923497 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b225c4-89e6-4917-9ce0-de2fd6d9a9a1 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:00.933301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0ee50-ba11-4e15-acd2-4de4e4bba840 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:00.935137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 883/1758] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:00 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:00.937468 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286f3a-12c2-4c66-a8a8-9a2eae46a954 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:00.937834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286f3a-12c2-4c66-a8a8-9a2eae46a954 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:00.938372 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286f3a-12c2-4c66-a8a8-9a2eae46a954 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:00.940359 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 884/1759] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 2 13:57:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:57:00.947302 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825d657-e547-4d1a-816d-9fe85b36863d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:00.952513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825d657-e547-4d1a-816d-9fe85b36863d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:00.952513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825d657-e547-4d1a-816d-9fe85b36863d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:00.959497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01fa74-f188-465f-a794-813cc562535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:00.959497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01fa74-f188-465f-a794-813cc562535b admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:00.964194 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01fa74-f188-465f-a794-813cc562535b admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:00.965521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01fa74-f188-465f-a794-813cc562535b admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:00.968352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01fa74-f188-465f-a794-813cc562535b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:00.971822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01fa74-f188-465f-a794-813cc562535b admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:00.990398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 876/1760] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:01.000469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-8825d657-e547-4d1a-816d-9fe85b36863d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:01.001792 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8825d657-e547-4d1a-816d-9fe85b36863d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:01.013273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ea2f-7eba-48e8-ac55-3e77f60b17e4 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:01.013273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ea2f-7eba-48e8-ac55-3e77f60b17e4 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:01.013273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ea2f-7eba-48e8-ac55-3e77f60b17e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:01.038716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 885/1761] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:01.039045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-5c85ea2f-7eba-48e8-ac55-3e77f60b17e4 None None] MFA Rules not processed for user `b9971f2bf0f2400b90168f6032a0e226`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:01.039720 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825d657-e547-4d1a-816d-9fe85b36863d None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:01.040700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5c85ea2f-7eba-48e8-ac55-3e77f60b17e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:01.057323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825d657-e547-4d1a-816d-9fe85b36863d None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:01.078289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba05ad-e24a-4eff-abfe-9100b5784aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:01.079207 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba05ad-e24a-4eff-abfe-9100b5784aec admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:01.079518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba05ad-e24a-4eff-abfe-9100b5784aec admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:01.079808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba05ad-e24a-4eff-abfe-9100b5784aec admin admin] PATH_INFO: `/v3/projects/7327dd11d4fd4a1fa02672a901e3f763/users/114be40c271846a290af77197153dba6/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:01.112139 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba05ad-e24a-4eff-abfe-9100b5784aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=7327dd11d4fd4a1fa02672a901e3f763, user_id=114be40c271846a290af77197153dba6, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:01.120872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba05ad-e24a-4eff-abfe-9100b5784aec admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:01.191022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 877/1762] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 2 13:57:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:01.192581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111b365-f8de-4ed2-9e4b-7c80c071c71d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:01.192944 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111b365-f8de-4ed2-9e4b-7c80c071c71d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:01.194270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111b365-f8de-4ed2-9e4b-7c80c071c71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:01.255445 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-7111b365-f8de-4ed2-9e4b-7c80c071c71d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:01.259787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7111b365-f8de-4ed2-9e4b-7c80c071c71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:01.287962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 886/1763] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:01 2022] PUT /identity/v3/projects/7327dd11d4fd4a1fa02672a901e3f763/users/114be40c271846a290af77197153dba6/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:01.287962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba05ad-e24a-4eff-abfe-9100b5784aec admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:01.287962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-30ba05ad-e24a-4eff-abfe-9100b5784aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:01.472637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 878/1764] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:01.477440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111b365-f8de-4ed2-9e4b-7c80c071c71d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:01.487872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba05ad-e24a-4eff-abfe-9100b5784aec admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:01.489787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111b365-f8de-4ed2-9e4b-7c80c071c71d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:01.493067 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29747544-5414-4ff1-b6b7-c953ba5727dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:01.494214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747544-5414-4ff1-b6b7-c953ba5727dd service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:01.494744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747544-5414-4ff1-b6b7-c953ba5727dd service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:01.495171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747544-5414-4ff1-b6b7-c953ba5727dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:01.497469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-29747544-5414-4ff1-b6b7-c953ba5727dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:01.497738 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58bfd8-bec4-4b91-83f5-c64e7f60c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:01.499576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58bfd8-bec4-4b91-83f5-c64e7f60c8be admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:01.499924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58bfd8-bec4-4b91-83f5-c64e7f60c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:01.500386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58bfd8-bec4-4b91-83f5-c64e7f60c8be admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:01.501244 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58bfd8-bec4-4b91-83f5-c64e7f60c8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:01.503105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58bfd8-bec4-4b91-83f5-c64e7f60c8be admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:01.523166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 879/1765] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:01.524548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58bfd8-bec4-4b91-83f5-c64e7f60c8be admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:01.540258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58bfd8-bec4-4b91-83f5-c64e7f60c8be admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:01.546723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d3c37-6d91-4557-98cf-27a02aa59a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:01.547924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d3c37-6d91-4557-98cf-27a02aa59a6e admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:01.548434 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d3c37-6d91-4557-98cf-27a02aa59a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:01.549166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d3c37-6d91-4557-98cf-27a02aa59a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:01.550267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d3c37-6d91-4557-98cf-27a02aa59a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:01.550871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d3c37-6d91-4557-98cf-27a02aa59a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:01.554714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d3c37-6d91-4557-98cf-27a02aa59a6e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:01.599103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 880/1766] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:01.604504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d3c37-6d91-4557-98cf-27a02aa59a6e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:01.604504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ed5d3c37-6d91-4557-98cf-27a02aa59a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:01.618011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29747544-5414-4ff1-b6b7-c953ba5727dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:01.619986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29747544-5414-4ff1-b6b7-c953ba5727dd service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:01.636867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 887/1767] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:01 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:01.637887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29747544-5414-4ff1-b6b7-c953ba5727dd service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:01.655638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29747544-5414-4ff1-b6b7-c953ba5727dd service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:01.666638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f491d2-e44e-432c-86cd-a7611b8bdae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:01.668827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f491d2-e44e-432c-86cd-a7611b8bdae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:01.672059 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f491d2-e44e-432c-86cd-a7611b8bdae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:01.672619 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f491d2-e44e-432c-86cd-a7611b8bdae3 admin admin] PATH_INFO: `/v3/projects/7327dd11d4fd4a1fa02672a901e3f763/users/114be40c271846a290af77197153dba6/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:01.678495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f491d2-e44e-432c-86cd-a7611b8bdae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7327dd11d4fd4a1fa02672a901e3f763, user_id=114be40c271846a290af77197153dba6, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:01.686555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f491d2-e44e-432c-86cd-a7611b8bdae3 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:01.742411 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 888/1768] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:01 2022] PUT /identity/v3/projects/7327dd11d4fd4a1fa02672a901e3f763/users/114be40c271846a290af77197153dba6/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:01.742411 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f491d2-e44e-432c-86cd-a7611b8bdae3 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:01.862064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d3c37-6d91-4557-98cf-27a02aa59a6e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:01.953506 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f491d2-e44e-432c-86cd-a7611b8bdae3 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:01.959298 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b0ee4-f5e9-4a77-8627-3b6ef886a324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:01.960139 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b0ee4-f5e9-4a77-8627-3b6ef886a324 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:01.960566 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b0ee4-f5e9-4a77-8627-3b6ef886a324 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:01.960960 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b0ee4-f5e9-4a77-8627-3b6ef886a324 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:01.962118 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b0ee4-f5e9-4a77-8627-3b6ef886a324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:01.965734 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b0ee4-f5e9-4a77-8627-3b6ef886a324 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:02.038049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3b3d7-0d5f-486b-8e5c-200ea53a4ff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:02.038801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b3d7-0d5f-486b-8e5c-200ea53a4ff9 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:02.039431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b3d7-0d5f-486b-8e5c-200ea53a4ff9 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:02.039778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b3d7-0d5f-486b-8e5c-200ea53a4ff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:02.051871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3b3d7-0d5f-486b-8e5c-200ea53a4ff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:02.054285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3b3d7-0d5f-486b-8e5c-200ea53a4ff9 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:02.077533 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 881/1769] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:02.078622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3b3d7-0d5f-486b-8e5c-200ea53a4ff9 service nova] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:02.085172 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e4c3b3d7-0d5f-486b-8e5c-200ea53a4ff9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:02.116093 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3b3d7-0d5f-486b-8e5c-200ea53a4ff9 service nova] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:02.123037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:02.124202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:02.124564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:02.124846 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] PATH_INFO: `/v3/projects/422c5c55bb85401a8c506931f222f566` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:02.126196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=422c5c55bb85401a8c506931f222f566)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:02.128714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:02.158489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 889/1770] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:01 2022] POST /identity/v3/projects => generated 387 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:02.158489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9222067-3875-4b4c-8875-43ee70de369b None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:02.158489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9222067-3875-4b4c-8875-43ee70de369b None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:02.158489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9222067-3875-4b4c-8875-43ee70de369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:02.237509 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-e9222067-3875-4b4c-8875-43ee70de369b None None] MFA Rules not processed for user `114be40c271846a290af77197153dba6`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:02.239489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e9222067-3875-4b4c-8875-43ee70de369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:02.354733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422c5c55bb85401a8c506931f222f566', 'request_id': 'req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:02.467439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 890/1771] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:02 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:02.468350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9222067-3875-4b4c-8875-43ee70de369b None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:02.479073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:02.481315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422c5c55bb85401a8c506931f222f566', 'request_id': 'req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:02.492002 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422c5c55bb85401a8c506931f222f566', 'request_id': 'req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:02.526547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] The token cache is being invalidate because project 422c5c55bb85401a8c506931f222f566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:02.527819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:02.529901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:02.534878 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 882/1772] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:02 2022] DELETE /identity/v3/projects/422c5c55bb85401a8c506931f222f566 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:02.535770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:02.540893 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:02.661719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9222067-3875-4b4c-8875-43ee70de369b None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:02.695893 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261c2be-612f-4e4f-aa8c-b9e87cb9a3a9 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:02.708637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9735e3-c2f6-4540-8a89-e5c89f328f35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:02.709320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9735e3-c2f6-4540-8a89-e5c89f328f35 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:02.709606 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9735e3-c2f6-4540-8a89-e5c89f328f35 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:02.709885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9735e3-c2f6-4540-8a89-e5c89f328f35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:02.717899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1f9735e3-c2f6-4540-8a89-e5c89f328f35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:02.759263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f9364-273a-4a15-871f-d0c060f43420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:02.760064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f9364-273a-4a15-871f-d0c060f43420 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:02.761232 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f9364-273a-4a15-871f-d0c060f43420 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:02.782168 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f9364-273a-4a15-871f-d0c060f43420 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:02.791084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f9364-273a-4a15-871f-d0c060f43420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:02.804166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f9364-273a-4a15-871f-d0c060f43420 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:02.862594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9735e3-c2f6-4540-8a89-e5c89f328f35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:02.868123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9735e3-c2f6-4540-8a89-e5c89f328f35 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:02.906899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 883/1773] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:02 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:02.910772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac5c7d-fb6c-40bb-9656-b96fade0f7a3 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:02.911079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac5c7d-fb6c-40bb-9656-b96fade0f7a3 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:02.911369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac5c7d-fb6c-40bb-9656-b96fade0f7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:02.963769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-33ac5c7d-fb6c-40bb-9656-b96fade0f7a3 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:02.965163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-33ac5c7d-fb6c-40bb-9656-b96fade0f7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:02.975390 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 884/1774] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:02.984904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd926b8-dcda-4aee-8372-f388cef1e04a None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:02.985247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd926b8-dcda-4aee-8372-f388cef1e04a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:02.985550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd926b8-dcda-4aee-8372-f388cef1e04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:03.001022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 891/1775] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:02 2022] POST /identity/v3/users => generated 294 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:03.001428 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f9364-273a-4a15-871f-d0c060f43420 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:03.004829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-fa4f9364-273a-4a15-871f-d0c060f43420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:03.026165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f9364-273a-4a15-871f-d0c060f43420 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:03.028391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-ecd926b8-dcda-4aee-8372-f388cef1e04a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:03.029656 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ecd926b8-dcda-4aee-8372-f388cef1e04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:03.055748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16b00b-bbed-4ba5-89f9-9d6edbe82b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:03.055967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 885/1776] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:03.055967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd926b8-dcda-4aee-8372-f388cef1e04a None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:03.056126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b00b-bbed-4ba5-89f9-9d6edbe82b89 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:03.056126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b00b-bbed-4ba5-89f9-9d6edbe82b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:03.056126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b00b-bbed-4ba5-89f9-9d6edbe82b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:03.056126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16b00b-bbed-4ba5-89f9-9d6edbe82b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:03.056126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16b00b-bbed-4ba5-89f9-9d6edbe82b89 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:03.070677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd926b8-dcda-4aee-8372-f388cef1e04a None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:03.077297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea34d5b-614a-4de1-8491-59e9aeea10b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:03.077971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea34d5b-614a-4de1-8491-59e9aeea10b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:03.078312 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea34d5b-614a-4de1-8491-59e9aeea10b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:03.078596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea34d5b-614a-4de1-8491-59e9aeea10b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:03.079353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea34d5b-614a-4de1-8491-59e9aeea10b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:03.079912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea34d5b-614a-4de1-8491-59e9aeea10b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:03.082088 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea34d5b-614a-4de1-8491-59e9aeea10b5 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:03.084554 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 892/1777] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:03.087719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16b00b-bbed-4ba5-89f9-9d6edbe82b89 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:03.106502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16b00b-bbed-4ba5-89f9-9d6edbe82b89 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:03.109600 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 886/1778] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:03.110530 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea34d5b-614a-4de1-8491-59e9aeea10b5 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:03.118496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15cfcd-f3e1-462e-a515-8487ee7d4af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:03.118496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15cfcd-f3e1-462e-a515-8487ee7d4af8 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:03.118496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15cfcd-f3e1-462e-a515-8487ee7d4af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:03.118496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15cfcd-f3e1-462e-a515-8487ee7d4af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:03.118968 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15cfcd-f3e1-462e-a515-8487ee7d4af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:03.118968 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15cfcd-f3e1-462e-a515-8487ee7d4af8 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:03.141406 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 893/1779] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:03.142732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15cfcd-f3e1-462e-a515-8487ee7d4af8 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:03.147988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea34d5b-614a-4de1-8491-59e9aeea10b5 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:03.157257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15cfcd-f3e1-462e-a515-8487ee7d4af8 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:03.164965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066167bb-ca15-4826-a259-8393e1c7c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:03.165649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066167bb-ca15-4826-a259-8393e1c7c0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:03.165935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066167bb-ca15-4826-a259-8393e1c7c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:03.166231 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066167bb-ca15-4826-a259-8393e1c7c0d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:03.166933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066167bb-ca15-4826-a259-8393e1c7c0d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:03.174292 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd18054-ec50-48b5-9f46-710505a7724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:03.174888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066167bb-ca15-4826-a259-8393e1c7c0d1 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:03.181626 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd18054-ec50-48b5-9f46-710505a7724f admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:03.182277 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd18054-ec50-48b5-9f46-710505a7724f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:03.182632 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd18054-ec50-48b5-9f46-710505a7724f admin admin] PATH_INFO: `/v3/projects/8261acfb655a48ce8d8a82e861df057d/users/aaf1b68198714afa9e30dbb5486f0288/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:03.230974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd18054-ec50-48b5-9f46-710505a7724f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8261acfb655a48ce8d8a82e861df057d, user_id=aaf1b68198714afa9e30dbb5486f0288, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:03.236230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd18054-ec50-48b5-9f46-710505a7724f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:03.362009 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 887/1780] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:03 2022] POST /identity/v3/projects => generated 403 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:03.362009 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066167bb-ca15-4826-a259-8393e1c7c0d1 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:03.365118 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 894/1781] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:03 2022] PUT /identity/v3/projects/8261acfb655a48ce8d8a82e861df057d/users/aaf1b68198714afa9e30dbb5486f0288/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:03.375136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd18054-ec50-48b5-9f46-710505a7724f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:03.504011 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066167bb-ca15-4826-a259-8393e1c7c0d1 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:03.511826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776ae3f-8fa5-4b16-975d-3ed790c2349b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:03.512542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ae3f-8fa5-4b16-975d-3ed790c2349b service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:03.512898 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ae3f-8fa5-4b16-975d-3ed790c2349b service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:03.513107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ae3f-8fa5-4b16-975d-3ed790c2349b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:03.515626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3776ae3f-8fa5-4b16-975d-3ed790c2349b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:03.520351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd18054-ec50-48b5-9f46-710505a7724f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:03.626523 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776ae3f-8fa5-4b16-975d-3ed790c2349b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:03.628108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776ae3f-8fa5-4b16-975d-3ed790c2349b service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:03.643358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 888/1782] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:03 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:03.646376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62995ac-d956-4e40-9fdd-67c278946d1b None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:03.646702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62995ac-d956-4e40-9fdd-67c278946d1b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:03.647236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62995ac-d956-4e40-9fdd-67c278946d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:03.674153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b6461-043e-49dc-917f-ad0612b6d614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:03.674882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b6461-043e-49dc-917f-ad0612b6d614 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:03.675110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b6461-043e-49dc-917f-ad0612b6d614 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:03.675384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b6461-043e-49dc-917f-ad0612b6d614 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:03.676158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b6461-043e-49dc-917f-ad0612b6d614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:03.678290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b6461-043e-49dc-917f-ad0612b6d614 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:03.697057 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:03.736918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f62995ac-d956-4e40-9fdd-67c278946d1b None None] MFA Rules not processed for user `aaf1b68198714afa9e30dbb5486f0288`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:03.738222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f62995ac-d956-4e40-9fdd-67c278946d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:03.830528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 895/1783] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:03 2022] POST /identity/v3/users => generated 302 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:03.834650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b6461-043e-49dc-917f-ad0612b6d614 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:03.860659 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b6461-043e-49dc-917f-ad0612b6d614 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:03.865548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 889/1784] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:03.870362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62995ac-d956-4e40-9fdd-67c278946d1b None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:03.885415 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b32b9a-f5fc-441a-a15a-ad78afac6659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:03.897647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32b9a-f5fc-441a-a15a-ad78afac6659 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:03.897647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32b9a-f5fc-441a-a15a-ad78afac6659 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:03.897873 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62995ac-d956-4e40-9fdd-67c278946d1b None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:03.897959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32b9a-f5fc-441a-a15a-ad78afac6659 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:03.897959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b32b9a-f5fc-441a-a15a-ad78afac6659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:03.897959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b32b9a-f5fc-441a-a15a-ad78afac6659 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:03.898150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733161cf-e106-4e2e-b5e7-d59c72ff44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:03.898150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733161cf-e106-4e2e-b5e7-d59c72ff44df admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:03.898150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733161cf-e106-4e2e-b5e7-d59c72ff44df admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:03.898150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733161cf-e106-4e2e-b5e7-d59c72ff44df admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:03.898403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733161cf-e106-4e2e-b5e7-d59c72ff44df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:03.898403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733161cf-e106-4e2e-b5e7-d59c72ff44df admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:03.908298 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 896/1785] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:03.914276 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b32b9a-f5fc-441a-a15a-ad78afac6659 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:03.933309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b32b9a-f5fc-441a-a15a-ad78afac6659 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:03.939972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae700fd-0e64-4aba-a98e-78a9249d66d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:03.941437 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae700fd-0e64-4aba-a98e-78a9249d66d8 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:03.941835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae700fd-0e64-4aba-a98e-78a9249d66d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:03.942192 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae700fd-0e64-4aba-a98e-78a9249d66d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:03.943105 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae700fd-0e64-4aba-a98e-78a9249d66d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:03.945791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae700fd-0e64-4aba-a98e-78a9249d66d8 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:03.963496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 897/1786] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:03.966164 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae700fd-0e64-4aba-a98e-78a9249d66d8 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:03.979279 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae700fd-0e64-4aba-a98e-78a9249d66d8 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:04.015342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452691a0-c88d-4fb7-ae5a-30a514c093e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:04.016363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452691a0-c88d-4fb7-ae5a-30a514c093e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:04.016632 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452691a0-c88d-4fb7-ae5a-30a514c093e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:04.016911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452691a0-c88d-4fb7-ae5a-30a514c093e7 admin admin] PATH_INFO: `/v3/projects/744cd4752a8949d4bc4c595ca38f5235/users/b506f1c3e6b44741ac16f78224e76c21/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:04.018248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 890/1787] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:03 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:04.023121 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733161cf-e106-4e2e-b5e7-d59c72ff44df admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:04.039524 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452691a0-c88d-4fb7-ae5a-30a514c093e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=744cd4752a8949d4bc4c595ca38f5235, user_id=b506f1c3e6b44741ac16f78224e76c21, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:04.042814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452691a0-c88d-4fb7-ae5a-30a514c093e7 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:04.172626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733161cf-e106-4e2e-b5e7-d59c72ff44df admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:04.187736 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 898/1788] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:03 2022] PUT /identity/v3/projects/744cd4752a8949d4bc4c595ca38f5235/users/b506f1c3e6b44741ac16f78224e76c21/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:04.197396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1bab0-8892-4b02-b5de-55be8f5d030c None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:04.198653 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1bab0-8892-4b02-b5de-55be8f5d030c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:04.202562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1bab0-8892-4b02-b5de-55be8f5d030c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:04.238543 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d570e8-787f-448a-89d2-471d4b2b9231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:04.255611 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d570e8-787f-448a-89d2-471d4b2b9231 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:04.258289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d570e8-787f-448a-89d2-471d4b2b9231 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:04.259378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d570e8-787f-448a-89d2-471d4b2b9231 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:04.262174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d570e8-787f-448a-89d2-471d4b2b9231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:04.267557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-e3b1bab0-8892-4b02-b5de-55be8f5d030c None None] MFA Rules not processed for user `b506f1c3e6b44741ac16f78224e76c21`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:04.269173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e3b1bab0-8892-4b02-b5de-55be8f5d030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:04.270002 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d570e8-787f-448a-89d2-471d4b2b9231 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:04.407776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 899/1789] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:04.433423 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1bab0-8892-4b02-b5de-55be8f5d030c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:04.461921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 891/1790] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:04 2022] POST /identity/v3/users => generated 294 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:04.471090 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d570e8-787f-448a-89d2-471d4b2b9231 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:04.503258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d570e8-787f-448a-89d2-471d4b2b9231 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:04.649892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1bab0-8892-4b02-b5de-55be8f5d030c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:04.663437 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf31b3-58c6-4032-9279-ff90221bed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:04.666195 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf31b3-58c6-4032-9279-ff90221bed70 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:04.666854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf31b3-58c6-4032-9279-ff90221bed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:04.669855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf31b3-58c6-4032-9279-ff90221bed70 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:04.670899 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880e70-7d06-43e9-bd05-9749ef96148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:04.671990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf31b3-58c6-4032-9279-ff90221bed70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:04.673445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880e70-7d06-43e9-bd05-9749ef96148e admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:04.673689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880e70-7d06-43e9-bd05-9749ef96148e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:04.674090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880e70-7d06-43e9-bd05-9749ef96148e admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:04.674721 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24880e70-7d06-43e9-bd05-9749ef96148e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:04.677565 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf31b3-58c6-4032-9279-ff90221bed70 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:04.682106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24880e70-7d06-43e9-bd05-9749ef96148e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:04.727788 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 892/1791] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:04.731859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf31b3-58c6-4032-9279-ff90221bed70 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:04.753104 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:04.761858 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf31b3-58c6-4032-9279-ff90221bed70 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:04.767774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f6bd4-a0bb-4584-96c2-4cbfc10f051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:04.768469 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f6bd4-a0bb-4584-96c2-4cbfc10f051c admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:04.768790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f6bd4-a0bb-4584-96c2-4cbfc10f051c admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:04.769379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f6bd4-a0bb-4584-96c2-4cbfc10f051c admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:04.770350 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f6bd4-a0bb-4584-96c2-4cbfc10f051c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:04.772064 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f6bd4-a0bb-4584-96c2-4cbfc10f051c admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:04.812670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 893/1792] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:04.813514 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 900/1793] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:04 2022] POST /identity/v3/projects => generated 405 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:04.814522 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f6bd4-a0bb-4584-96c2-4cbfc10f051c admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:04.817728 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880e70-7d06-43e9-bd05-9749ef96148e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:04.834912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f6bd4-a0bb-4584-96c2-4cbfc10f051c admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:04.924672 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb373ddd-0d7c-42b0-b1e3-065be9519734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:04.926008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb373ddd-0d7c-42b0-b1e3-065be9519734 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:04.926395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb373ddd-0d7c-42b0-b1e3-065be9519734 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:04.926806 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb373ddd-0d7c-42b0-b1e3-065be9519734 admin admin] PATH_INFO: `/v3/projects/ac4fdcb5c89a48a1a36ac8ad6d24c878/users/7368aea3f037465eae844cd858071b23/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:04.968525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb373ddd-0d7c-42b0-b1e3-065be9519734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4fdcb5c89a48a1a36ac8ad6d24c878, user_id=7368aea3f037465eae844cd858071b23, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:04.975024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880e70-7d06-43e9-bd05-9749ef96148e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:04.976113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb373ddd-0d7c-42b0-b1e3-065be9519734 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:04.980691 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7adcd-e2ee-4a97-a229-58df8b8975c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:04.981813 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7adcd-e2ee-4a97-a229-58df8b8975c9 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:04.982244 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7adcd-e2ee-4a97-a229-58df8b8975c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:04.983243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7adcd-e2ee-4a97-a229-58df8b8975c9 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:04.985383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7adcd-e2ee-4a97-a229-58df8b8975c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:04.987904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7adcd-e2ee-4a97-a229-58df8b8975c9 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:05.088848 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 894/1794] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:04 2022] PUT /identity/v3/projects/ac4fdcb5c89a48a1a36ac8ad6d24c878/users/7368aea3f037465eae844cd858071b23/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:05.090733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a1e22-a749-4700-9792-9f2fbf610f94 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:05.091027 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a1e22-a749-4700-9792-9f2fbf610f94 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:05.091302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a1e22-a749-4700-9792-9f2fbf610f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:05.130387 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-3b7a1e22-a749-4700-9792-9f2fbf610f94 None None] MFA Rules not processed for user `7368aea3f037465eae844cd858071b23`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:05.131770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3b7a1e22-a749-4700-9792-9f2fbf610f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:05.132829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 901/1795] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:04 2022] POST /identity/v3/users => generated 309 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:05.137133 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7adcd-e2ee-4a97-a229-58df8b8975c9 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:05.169963 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7adcd-e2ee-4a97-a229-58df8b8975c9 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:05.255923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 895/1796] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:05.261441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a1e22-a749-4700-9792-9f2fbf610f94 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:05.305911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:05.319688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7780e10-e6c7-43af-92f5-561cf5ec31b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:05.321105 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7780e10-e6c7-43af-92f5-561cf5ec31b9 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:05.322093 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7780e10-e6c7-43af-92f5-561cf5ec31b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:05.325296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7780e10-e6c7-43af-92f5-561cf5ec31b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:05.330056 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7780e10-e6c7-43af-92f5-561cf5ec31b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:05.333810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7780e10-e6c7-43af-92f5-561cf5ec31b9 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:05.359255 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 902/1797] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:05.360210 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7780e10-e6c7-43af-92f5-561cf5ec31b9 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:05.371826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7780e10-e6c7-43af-92f5-561cf5ec31b9 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:05.378271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1657c-7b62-40d2-82ed-a6c9cf0954bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:05.379508 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1657c-7b62-40d2-82ed-a6c9cf0954bd admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:05.379804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1657c-7b62-40d2-82ed-a6c9cf0954bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:05.380131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1657c-7b62-40d2-82ed-a6c9cf0954bd admin admin] PATH_INFO: `/v3/projects/1699f17a01c049438db476f03a12867e/users/e887d4f59ff848a78203f3fb8ed8e662/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:05.422074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a1e22-a749-4700-9792-9f2fbf610f94 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:05.427201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1657c-7b62-40d2-82ed-a6c9cf0954bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1699f17a01c049438db476f03a12867e, user_id=e887d4f59ff848a78203f3fb8ed8e662, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:05.430290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1657c-7b62-40d2-82ed-a6c9cf0954bd admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:05.439258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f6018-5c3f-45ba-b53e-ad341e7081fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:05.440000 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f6018-5c3f-45ba-b53e-ad341e7081fe admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:05.440287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f6018-5c3f-45ba-b53e-ad341e7081fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:05.440569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f6018-5c3f-45ba-b53e-ad341e7081fe admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:05.441748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f6018-5c3f-45ba-b53e-ad341e7081fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:05.444387 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f6018-5c3f-45ba-b53e-ad341e7081fe admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:05.574049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 903/1798] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:05 2022] PUT /identity/v3/projects/1699f17a01c049438db476f03a12867e/users/e887d4f59ff848a78203f3fb8ed8e662/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:05.578985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1657c-7b62-40d2-82ed-a6c9cf0954bd admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:05.605248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 896/1799] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:05 2022] POST /identity/v3/projects => generated 385 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:05.608819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f6018-5c3f-45ba-b53e-ad341e7081fe admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:05.717272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1657c-7b62-40d2-82ed-a6c9cf0954bd admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:05.801235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f43a2b-e39c-4781-a1ac-6ed346abb3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:05.803636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f43a2b-e39c-4781-a1ac-6ed346abb3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:05.803636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f43a2b-e39c-4781-a1ac-6ed346abb3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:05.803636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f43a2b-e39c-4781-a1ac-6ed346abb3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:05.808161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f43a2b-e39c-4781-a1ac-6ed346abb3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:05.813454 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f43a2b-e39c-4781-a1ac-6ed346abb3e7 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:05.837461 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 904/1800] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:05.838942 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f43a2b-e39c-4781-a1ac-6ed346abb3e7 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:05.851527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f6018-5c3f-45ba-b53e-ad341e7081fe admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:05.866866 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f43a2b-e39c-4781-a1ac-6ed346abb3e7 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:05.867296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a31fc-011f-4e2b-ad04-ced1bd24260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:05.867296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a31fc-011f-4e2b-ad04-ced1bd24260d admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:05.867296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a31fc-011f-4e2b-ad04-ced1bd24260d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:05.867296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a31fc-011f-4e2b-ad04-ced1bd24260d admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:05.867595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a31fc-011f-4e2b-ad04-ced1bd24260d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:05.867676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771a368-31d5-4b0f-bfef-ca44dcdbf227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:05.867757 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771a368-31d5-4b0f-bfef-ca44dcdbf227 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:05.868335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771a368-31d5-4b0f-bfef-ca44dcdbf227 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:05.868949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771a368-31d5-4b0f-bfef-ca44dcdbf227 admin admin] PATH_INFO: `/v3/projects/1699f17a01c049438db476f03a12867e/users/e887d4f59ff848a78203f3fb8ed8e662/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:05.871817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771a368-31d5-4b0f-bfef-ca44dcdbf227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1699f17a01c049438db476f03a12867e, user_id=e887d4f59ff848a78203f3fb8ed8e662, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:05.872211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a31fc-011f-4e2b-ad04-ced1bd24260d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:05.875536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771a368-31d5-4b0f-bfef-ca44dcdbf227 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:05.894887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 905/1801] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:05 2022] PUT /identity/v3/projects/1699f17a01c049438db476f03a12867e/users/e887d4f59ff848a78203f3fb8ed8e662/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:05.911051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c8f5b-fe52-4872-b48f-eb6639454559 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:05.911352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c8f5b-fe52-4872-b48f-eb6639454559 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:05.911714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c8f5b-fe52-4872-b48f-eb6639454559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:05.951500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ef8c8f5b-fe52-4872-b48f-eb6639454559 None None] MFA Rules not processed for user `e887d4f59ff848a78203f3fb8ed8e662`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:05.954639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ef8c8f5b-fe52-4872-b48f-eb6639454559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:06.010443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 897/1802] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:05 2022] POST /identity/v3/users => generated 299 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:06.015690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a31fc-011f-4e2b-ad04-ced1bd24260d admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:06.071414 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a31fc-011f-4e2b-ad04-ced1bd24260d admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:06.104226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 906/1803] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:05 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:06.163062 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db999b11-dff9-40cd-a27a-4f53c4c85d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:06.163876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db999b11-dff9-40cd-a27a-4f53c4c85d69 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:06.164232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db999b11-dff9-40cd-a27a-4f53c4c85d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:06.169073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db999b11-dff9-40cd-a27a-4f53c4c85d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:06.169073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db999b11-dff9-40cd-a27a-4f53c4c85d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:06.169073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db999b11-dff9-40cd-a27a-4f53c4c85d69 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:06.182484 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 898/1804] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:06.186765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c8f5b-fe52-4872-b48f-eb6639454559 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:06.211793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c8f5b-fe52-4872-b48f-eb6639454559 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:06.229041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052445e-e53f-4bcf-88c1-82f838837866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:06.230110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052445e-e53f-4bcf-88c1-82f838837866 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:06.235286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052445e-e53f-4bcf-88c1-82f838837866 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:06.235286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052445e-e53f-4bcf-88c1-82f838837866 admin admin] PATH_INFO: `/v3/projects/4a7dd873cd1348a9b3e554634d9da962/users/76eb1d8d307d46d99831094765abdeaf/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:06.306630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052445e-e53f-4bcf-88c1-82f838837866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7dd873cd1348a9b3e554634d9da962, user_id=76eb1d8d307d46d99831094765abdeaf, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:06.321789 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052445e-e53f-4bcf-88c1-82f838837866 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:06.470924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9ec6a-6de1-4e1e-b8b2-12c614cde5f2 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:06.471369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9ec6a-6de1-4e1e-b8b2-12c614cde5f2 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:06.471764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9ec6a-6de1-4e1e-b8b2-12c614cde5f2 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:06.473550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 899/1805] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 2 13:57:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:57:06.497131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9520d47-9d1e-4db2-8cdd-53fdfa1d9335 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:06.497511 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9520d47-9d1e-4db2-8cdd-53fdfa1d9335 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:06.521693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9520d47-9d1e-4db2-8cdd-53fdfa1d9335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:06.536664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:06.546553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 907/1806] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:06 2022] PUT /identity/v3/projects/4a7dd873cd1348a9b3e554634d9da962/users/76eb1d8d307d46d99831094765abdeaf/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:06.549181 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-e9520d47-9d1e-4db2-8cdd-53fdfa1d9335 None None] MFA Rules not processed for user `b9971f2bf0f2400b90168f6032a0e226`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:06.550528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052445e-e53f-4bcf-88c1-82f838837866 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:06.559829 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e9520d47-9d1e-4db2-8cdd-53fdfa1d9335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:06.633700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:06.762636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052445e-e53f-4bcf-88c1-82f838837866 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:06.781301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b8bc0-44b2-4a5c-a066-57ef576de0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:06.786344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b8bc0-44b2-4a5c-a066-57ef576de0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:06.787125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b8bc0-44b2-4a5c-a066-57ef576de0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:06.788901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b8bc0-44b2-4a5c-a066-57ef576de0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:06.792365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b8bc0-44b2-4a5c-a066-57ef576de0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:06.800737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b8bc0-44b2-4a5c-a066-57ef576de0c2 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:06.824327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 900/1807] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 2 13:57:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:06.853941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 908/1808] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:06.857977 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9520d47-9d1e-4db2-8cdd-53fdfa1d9335 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:06.882112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9520d47-9d1e-4db2-8cdd-53fdfa1d9335 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:06.901755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f427f0-acc8-4383-96fb-be06d8776a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:06.903243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f427f0-acc8-4383-96fb-be06d8776a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:06.903879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f427f0-acc8-4383-96fb-be06d8776a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:06.905543 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f427f0-acc8-4383-96fb-be06d8776a1c admin admin] PATH_INFO: `/v3/projects/4a7dd873cd1348a9b3e554634d9da962/users/76eb1d8d307d46d99831094765abdeaf/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:06.911374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b8bc0-44b2-4a5c-a066-57ef576de0c2 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:06.913103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f427f0-acc8-4383-96fb-be06d8776a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7dd873cd1348a9b3e554634d9da962, user_id=76eb1d8d307d46d99831094765abdeaf, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:06.916947 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f427f0-acc8-4383-96fb-be06d8776a1c admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:06.945542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 901/1809] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:06 2022] PUT /identity/v3/projects/4a7dd873cd1348a9b3e554634d9da962/users/76eb1d8d307d46d99831094765abdeaf/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:06.960864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825d462-cf46-4734-bbaf-fd33ef8b174e None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:06.961137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825d462-cf46-4734-bbaf-fd33ef8b174e None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:06.961425 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825d462-cf46-4734-bbaf-fd33ef8b174e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:07.028862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-9825d462-cf46-4734-bbaf-fd33ef8b174e None None] MFA Rules not processed for user `76eb1d8d307d46d99831094765abdeaf`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:07.031862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9825d462-cf46-4734-bbaf-fd33ef8b174e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:07.064324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b8bc0-44b2-4a5c-a066-57ef576de0c2 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:07.179714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff2354-aecf-4ebe-ad18-3274e2e0ac55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:07.180747 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff2354-aecf-4ebe-ad18-3274e2e0ac55 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:07.181271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff2354-aecf-4ebe-ad18-3274e2e0ac55 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:07.181698 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff2354-aecf-4ebe-ad18-3274e2e0ac55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:07.227168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 902/1810] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:07.300842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff2354-aecf-4ebe-ad18-3274e2e0ac55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:07.302864 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff2354-aecf-4ebe-ad18-3274e2e0ac55 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:07.333672 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825d462-cf46-4734-bbaf-fd33ef8b174e None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:07.333933 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 909/1811] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:06 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:07.336299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9825d462-cf46-4734-bbaf-fd33ef8b174e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:07.503150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff2354-aecf-4ebe-ad18-3274e2e0ac55 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:07.507046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-36ff2354-aecf-4ebe-ad18-3274e2e0ac55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:07.543490 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff2354-aecf-4ebe-ad18-3274e2e0ac55 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:07.552322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb314c-3730-4b75-83ee-4daa610594fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:07.556124 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb314c-3730-4b75-83ee-4daa610594fe service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:07.556124 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb314c-3730-4b75-83ee-4daa610594fe service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:07.556124 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb314c-3730-4b75-83ee-4daa610594fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:07.579155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb314c-3730-4b75-83ee-4daa610594fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:07.579392 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825d462-cf46-4734-bbaf-fd33ef8b174e None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:07.583123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb314c-3730-4b75-83ee-4daa610594fe service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:07.599862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48224b9a-233b-4f5d-8d24-64496db62762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:07.600607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48224b9a-233b-4f5d-8d24-64496db62762 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:07.602059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48224b9a-233b-4f5d-8d24-64496db62762 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:07.602059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48224b9a-233b-4f5d-8d24-64496db62762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:07.633793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48224b9a-233b-4f5d-8d24-64496db62762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:07.636755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 910/1812] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:07.637513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48224b9a-233b-4f5d-8d24-64496db62762 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:07.672461 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 903/1813] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:07.674522 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:07.912731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:08.076094 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb314c-3730-4b75-83ee-4daa610594fe service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:08.197536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb314c-3730-4b75-83ee-4daa610594fe service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:08.202913 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c149388-92c7-4d2c-a744-b2125dec4d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:08.203952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c149388-92c7-4d2c-a744-b2125dec4d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:08.204327 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c149388-92c7-4d2c-a744-b2125dec4d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:08.204708 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c149388-92c7-4d2c-a744-b2125dec4d09 admin admin] PATH_INFO: `/v3/users/b506f1c3e6b44741ac16f78224e76c21` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:08.206001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c149388-92c7-4d2c-a744-b2125dec4d09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b506f1c3e6b44741ac16f78224e76c21)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:08.208266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c149388-92c7-4d2c-a744-b2125dec4d09 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:08.808737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2c149388-92c7-4d2c-a744-b2125dec4d09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b506f1c3e6b44741ac16f78224e76c21'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:08.971347 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2c149388-92c7-4d2c-a744-b2125dec4d09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b506f1c3e6b44741ac16f78224e76c21'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:08.983683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2c149388-92c7-4d2c-a744-b2125dec4d09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b506f1c3e6b44741ac16f78224e76c21'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:08.984331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2c149388-92c7-4d2c-a744-b2125dec4d09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b506f1c3e6b44741ac16f78224e76c21'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:08.991198 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2c149388-92c7-4d2c-a744-b2125dec4d09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b506f1c3e6b44741ac16f78224e76c21'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:08.999317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 911/1814] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:08 2022] DELETE /identity/v3/users/b506f1c3e6b44741ac16f78224e76c21 => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:09.003354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7c505-5072-49a5-8f2e-c49e354fd250 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:09.003789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7c505-5072-49a5-8f2e-c49e354fd250 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:09.003883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7c505-5072-49a5-8f2e-c49e354fd250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:09.038824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-6be7c505-5072-49a5-8f2e-c49e354fd250 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:09.040114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6be7c505-5072-49a5-8f2e-c49e354fd250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:09.110049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 904/1815] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:09.120026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c149388-92c7-4d2c-a744-b2125dec4d09 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:09.121336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2c149388-92c7-4d2c-a744-b2125dec4d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:09.181971 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c149388-92c7-4d2c-a744-b2125dec4d09 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:09.186599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93970b9-b0d6-48cf-87f4-4adb6005453f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:09.187254 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93970b9-b0d6-48cf-87f4-4adb6005453f service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:09.187590 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93970b9-b0d6-48cf-87f4-4adb6005453f service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:09.187865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93970b9-b0d6-48cf-87f4-4adb6005453f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:09.199524 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93970b9-b0d6-48cf-87f4-4adb6005453f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:09.201582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93970b9-b0d6-48cf-87f4-4adb6005453f service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:09.204306 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:09.213464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 912/1816] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:09.754109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7c505-5072-49a5-8f2e-c49e354fd250 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:09.754109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6be7c505-5072-49a5-8f2e-c49e354fd250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:09.760976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7c505-5072-49a5-8f2e-c49e354fd250 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:09.766507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:09.768541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93970b9-b0d6-48cf-87f4-4adb6005453f service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:09.770086 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d93970b9-b0d6-48cf-87f4-4adb6005453f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:09.779092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:09.780130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:09.781105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] PATH_INFO: `/v3/projects/744cd4752a8949d4bc4c595ca38f5235` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:09.785151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=744cd4752a8949d4bc4c595ca38f5235)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:09.788023 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:09.869384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93970b9-b0d6-48cf-87f4-4adb6005453f service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:09.874100 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1936d94-e4e5-4c66-8695-ab65ce6431a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:09.875074 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1936d94-e4e5-4c66-8695-ab65ce6431a3 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:09.875545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1936d94-e4e5-4c66-8695-ab65ce6431a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:09.875901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1936d94-e4e5-4c66-8695-ab65ce6431a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:09.878234 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d1936d94-e4e5-4c66-8695-ab65ce6431a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:09.930575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744cd4752a8949d4bc4c595ca38f5235', 'request_id': 'req-96cf8263-410c-45b8-aee5-a1d9c16a0096'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:09.951859 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1936d94-e4e5-4c66-8695-ab65ce6431a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:09.951859 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1936d94-e4e5-4c66-8695-ab65ce6431a3 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:09.961211 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 913/1817] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:10.032429 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744cd4752a8949d4bc4c595ca38f5235', 'request_id': 'req-96cf8263-410c-45b8-aee5-a1d9c16a0096'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:10.044188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744cd4752a8949d4bc4c595ca38f5235', 'request_id': 'req-96cf8263-410c-45b8-aee5-a1d9c16a0096'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:10.055073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] The token cache is being invalidate because project 744cd4752a8949d4bc4c595ca38f5235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:10.055366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:10.056065 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:10.057829 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 905/1818] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:09 2022] DELETE /identity/v3/projects/744cd4752a8949d4bc4c595ca38f5235 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:10.061688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1936d94-e4e5-4c66-8695-ab65ce6431a3 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:10.072750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1936d94-e4e5-4c66-8695-ab65ce6431a3 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:10.138405 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d08b10-b6da-4a17-8055-20e658a02b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:10.141335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d08b10-b6da-4a17-8055-20e658a02b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:10.141335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d08b10-b6da-4a17-8055-20e658a02b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:10.141335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d08b10-b6da-4a17-8055-20e658a02b6f admin admin] PATH_INFO: `/v3/users/e887d4f59ff848a78203f3fb8ed8e662` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:10.141335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d08b10-b6da-4a17-8055-20e658a02b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e887d4f59ff848a78203f3fb8ed8e662)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:10.142934 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d08b10-b6da-4a17-8055-20e658a02b6f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:10.205787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:10.379518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a2d08b10-b6da-4a17-8055-20e658a02b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e887d4f59ff848a78203f3fb8ed8e662'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:10.519387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a2d08b10-b6da-4a17-8055-20e658a02b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e887d4f59ff848a78203f3fb8ed8e662'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:10.533542 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a2d08b10-b6da-4a17-8055-20e658a02b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e887d4f59ff848a78203f3fb8ed8e662'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:10.534252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a2d08b10-b6da-4a17-8055-20e658a02b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e887d4f59ff848a78203f3fb8ed8e662'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:10.542792 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a2d08b10-b6da-4a17-8055-20e658a02b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e887d4f59ff848a78203f3fb8ed8e662'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:10.549137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 914/1819] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:10 2022] DELETE /identity/v3/users/e887d4f59ff848a78203f3fb8ed8e662 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:11.051936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:11.053483 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:11.090040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf8263-410c-45b8-aee5-a1d9c16a0096 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:11.163906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3f17b-9652-48c6-a0db-fb228397184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:11.165429 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3f17b-9652-48c6-a0db-fb228397184d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:11.165940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3f17b-9652-48c6-a0db-fb228397184d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:11.166335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3f17b-9652-48c6-a0db-fb228397184d admin admin] PATH_INFO: `/v3/projects/1699f17a01c049438db476f03a12867e` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:11.167710 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3f17b-9652-48c6-a0db-fb228397184d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1699f17a01c049438db476f03a12867e)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:11.170503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3f17b-9652-48c6-a0db-fb228397184d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:11.309948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-63e3f17b-9652-48c6-a0db-fb228397184d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1699f17a01c049438db476f03a12867e', 'request_id': 'req-63e3f17b-9652-48c6-a0db-fb228397184d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:11.445362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-63e3f17b-9652-48c6-a0db-fb228397184d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1699f17a01c049438db476f03a12867e', 'request_id': 'req-63e3f17b-9652-48c6-a0db-fb228397184d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:11.452098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-63e3f17b-9652-48c6-a0db-fb228397184d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1699f17a01c049438db476f03a12867e', 'request_id': 'req-63e3f17b-9652-48c6-a0db-fb228397184d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:11.462489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-63e3f17b-9652-48c6-a0db-fb228397184d admin admin] The token cache is being invalidate because project 1699f17a01c049438db476f03a12867e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:11.462776 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-63e3f17b-9652-48c6-a0db-fb228397184d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:11.463434 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-63e3f17b-9652-48c6-a0db-fb228397184d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:11.465284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 906/1820] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:11 2022] DELETE /identity/v3/projects/1699f17a01c049438db476f03a12867e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:11.470827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fc004-c8d3-4144-a9cb-ff63ab3b6c7a None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:11.472786 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fc004-c8d3-4144-a9cb-ff63ab3b6c7a None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:11.472786 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fc004-c8d3-4144-a9cb-ff63ab3b6c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:11.490325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-a75fc004-c8d3-4144-a9cb-ff63ab3b6c7a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:11.491538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a75fc004-c8d3-4144-a9cb-ff63ab3b6c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:11.549505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 915/1821] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:11.557364 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571c52d-f163-4353-aeb8-670a30842598 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:11.557657 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571c52d-f163-4353-aeb8-670a30842598 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:11.557942 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571c52d-f163-4353-aeb8-670a30842598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:11.575822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-2571c52d-f163-4353-aeb8-670a30842598 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:11.577021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2571c52d-f163-4353-aeb8-670a30842598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:11.584985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 907/1822] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:11.589255 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fc004-c8d3-4144-a9cb-ff63ab3b6c7a None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:11.599678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fc004-c8d3-4144-a9cb-ff63ab3b6c7a None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:11.604311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c53f3-745b-4f86-8bff-1e52667824a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:11.604967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c53f3-745b-4f86-8bff-1e52667824a7 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:11.605255 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c53f3-745b-4f86-8bff-1e52667824a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:11.605535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c53f3-745b-4f86-8bff-1e52667824a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:11.606259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c53f3-745b-4f86-8bff-1e52667824a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:11.606567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c53f3-745b-4f86-8bff-1e52667824a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:11.608872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c53f3-745b-4f86-8bff-1e52667824a7 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:11.620619 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 916/1823] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:11.624960 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571c52d-f163-4353-aeb8-670a30842598 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:11.634848 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571c52d-f163-4353-aeb8-670a30842598 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:11.639716 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45b34e-2bce-4b1f-87a3-bd89055411f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:11.640376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45b34e-2bce-4b1f-87a3-bd89055411f3 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:11.640660 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45b34e-2bce-4b1f-87a3-bd89055411f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:11.640941 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45b34e-2bce-4b1f-87a3-bd89055411f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:11.641835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45b34e-2bce-4b1f-87a3-bd89055411f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:11.643780 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45b34e-2bce-4b1f-87a3-bd89055411f3 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:11.763576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 908/1824] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:11 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:11.764531 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c53f3-745b-4f86-8bff-1e52667824a7 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:11.775041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c53f3-745b-4f86-8bff-1e52667824a7 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:11.832107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:11.841939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e80c1a-0709-48af-becb-1e2d65c51dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:11.842608 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e80c1a-0709-48af-becb-1e2d65c51dfd admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:11.842887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e80c1a-0709-48af-becb-1e2d65c51dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:11.843157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e80c1a-0709-48af-becb-1e2d65c51dfd admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:11.843882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e80c1a-0709-48af-becb-1e2d65c51dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:11.845797 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e80c1a-0709-48af-becb-1e2d65c51dfd admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:11.953160 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 917/1825] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:11 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:11.957298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45b34e-2bce-4b1f-87a3-bd89055411f3 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:11.968082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45b34e-2bce-4b1f-87a3-bd89055411f3 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:11.972861 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32e382-2407-4a3c-a196-fb078e7b04ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:11.973563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32e382-2407-4a3c-a196-fb078e7b04ba admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:11.973849 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32e382-2407-4a3c-a196-fb078e7b04ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:11.974123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32e382-2407-4a3c-a196-fb078e7b04ba admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:11.974962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32e382-2407-4a3c-a196-fb078e7b04ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:11.976651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32e382-2407-4a3c-a196-fb078e7b04ba admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:11.987730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 909/1826] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:11.991579 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e80c1a-0709-48af-becb-1e2d65c51dfd admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:12.001692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e80c1a-0709-48af-becb-1e2d65c51dfd admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:12.007779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b209422-65b4-4efa-9107-7f492a1d3995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:12.007779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b209422-65b4-4efa-9107-7f492a1d3995 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:12.007779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b209422-65b4-4efa-9107-7f492a1d3995 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:12.007779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b209422-65b4-4efa-9107-7f492a1d3995 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:12.008542 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b209422-65b4-4efa-9107-7f492a1d3995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:12.010146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b209422-65b4-4efa-9107-7f492a1d3995 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:12.026295 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 918/1827] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:12.027051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32e382-2407-4a3c-a196-fb078e7b04ba admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:12.038172 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32e382-2407-4a3c-a196-fb078e7b04ba admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:12.047676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbaf03-47cd-497a-a764-906d93be49d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:12.049032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbaf03-47cd-497a-a764-906d93be49d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:12.049032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbaf03-47cd-497a-a764-906d93be49d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:12.049231 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbaf03-47cd-497a-a764-906d93be49d0 admin admin] PATH_INFO: `/v3/projects/f5ea289f9aeb443c9c1160118f95715f/users/44c2a1329aec48a483cd405b3753c52c/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:12.070721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbaf03-47cd-497a-a764-906d93be49d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ea289f9aeb443c9c1160118f95715f, user_id=44c2a1329aec48a483cd405b3753c52c, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:12.073832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbaf03-47cd-497a-a764-906d93be49d0 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:12.165733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 910/1828] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:12 2022] PUT /identity/v3/projects/f5ea289f9aeb443c9c1160118f95715f/users/44c2a1329aec48a483cd405b3753c52c/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:12.178501 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f044696-a65a-4d43-8e3d-df103c09d8a7 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:12.178613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f044696-a65a-4d43-8e3d-df103c09d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:12.178852 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f044696-a65a-4d43-8e3d-df103c09d8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:12.209471 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-4f044696-a65a-4d43-8e3d-df103c09d8a7 None None] MFA Rules not processed for user `44c2a1329aec48a483cd405b3753c52c`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:12.210771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4f044696-a65a-4d43-8e3d-df103c09d8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:12.281139 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 919/1829] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:12.286143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbaf03-47cd-497a-a764-906d93be49d0 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:12.388853 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbaf03-47cd-497a-a764-906d93be49d0 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:12.392397 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328e392-dd98-4c0d-afcf-dfbd0be5c6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:12.393070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328e392-dd98-4c0d-afcf-dfbd0be5c6df admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:12.393359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328e392-dd98-4c0d-afcf-dfbd0be5c6df admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:12.393645 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328e392-dd98-4c0d-afcf-dfbd0be5c6df admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:12.394341 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328e392-dd98-4c0d-afcf-dfbd0be5c6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:12.396527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328e392-dd98-4c0d-afcf-dfbd0be5c6df admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:12.598582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 911/1830] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:12 2022] POST /identity/v3/projects => generated 379 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:12.602645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f044696-a65a-4d43-8e3d-df103c09d8a7 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:12.613892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f044696-a65a-4d43-8e3d-df103c09d8a7 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:12.669829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253a4c5-1330-480d-9c7c-18167360d8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:12.670502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253a4c5-1330-480d-9c7c-18167360d8ce admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:12.671205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253a4c5-1330-480d-9c7c-18167360d8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:12.671205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253a4c5-1330-480d-9c7c-18167360d8ce admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:12.671796 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253a4c5-1330-480d-9c7c-18167360d8ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:12.673714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253a4c5-1330-480d-9c7c-18167360d8ce admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:12.803303 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 920/1831] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:12 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:12.807570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328e392-dd98-4c0d-afcf-dfbd0be5c6df admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:12.818471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328e392-dd98-4c0d-afcf-dfbd0be5c6df admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:12.823436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2716e-e43c-4f84-93dc-4777b8b9104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:12.824367 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2716e-e43c-4f84-93dc-4777b8b9104f admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:12.824705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2716e-e43c-4f84-93dc-4777b8b9104f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:12.825073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2716e-e43c-4f84-93dc-4777b8b9104f admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:12.825925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2716e-e43c-4f84-93dc-4777b8b9104f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:12.827853 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2716e-e43c-4f84-93dc-4777b8b9104f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:12.839619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 912/1832] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:12.844522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253a4c5-1330-480d-9c7c-18167360d8ce admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:12.854570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253a4c5-1330-480d-9c7c-18167360d8ce admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:12.860358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57372f35-1b94-4f6a-a40c-4c336d9336fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:12.861324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57372f35-1b94-4f6a-a40c-4c336d9336fb admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:12.861674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57372f35-1b94-4f6a-a40c-4c336d9336fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:12.862014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57372f35-1b94-4f6a-a40c-4c336d9336fb admin admin] PATH_INFO: `/v3/projects/e0e280023ab344cba0d629e366560477/users/ab4bd50b03f047c997dcdfd3b55ff53c/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:12.877044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57372f35-1b94-4f6a-a40c-4c336d9336fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e280023ab344cba0d629e366560477, user_id=ab4bd50b03f047c997dcdfd3b55ff53c, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:12.879733 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57372f35-1b94-4f6a-a40c-4c336d9336fb admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:12.974909 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 921/1833] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:12 2022] PUT /identity/v3/projects/e0e280023ab344cba0d629e366560477/users/ab4bd50b03f047c997dcdfd3b55ff53c/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:12.978888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2716e-e43c-4f84-93dc-4777b8b9104f admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:12.990893 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2716e-e43c-4f84-93dc-4777b8b9104f admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:13.048887 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e5945-6453-4d0a-a7ce-15ad14227d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:13.049622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e5945-6453-4d0a-a7ce-15ad14227d81 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:13.049936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e5945-6453-4d0a-a7ce-15ad14227d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:13.050212 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e5945-6453-4d0a-a7ce-15ad14227d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:13.050945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e5945-6453-4d0a-a7ce-15ad14227d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:13.052583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e5945-6453-4d0a-a7ce-15ad14227d81 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:13.063400 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 913/1834] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:13.067633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57372f35-1b94-4f6a-a40c-4c336d9336fb admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:13.077835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57372f35-1b94-4f6a-a40c-4c336d9336fb admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:13.084983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4deecc8-2645-432a-a608-ee79fe8724ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:13.085884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deecc8-2645-432a-a608-ee79fe8724ed admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:13.086169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deecc8-2645-432a-a608-ee79fe8724ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:13.086451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deecc8-2645-432a-a608-ee79fe8724ed admin admin] PATH_INFO: `/v3/projects/e0e280023ab344cba0d629e366560477/users/ab4bd50b03f047c997dcdfd3b55ff53c/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:13.088490 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4deecc8-2645-432a-a608-ee79fe8724ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e280023ab344cba0d629e366560477, user_id=ab4bd50b03f047c997dcdfd3b55ff53c, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:13.091709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4deecc8-2645-432a-a608-ee79fe8724ed admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:13.096231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:13.103925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 922/1835] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:13 2022] PUT /identity/v3/projects/e0e280023ab344cba0d629e366560477/users/ab4bd50b03f047c997dcdfd3b55ff53c/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:13.114930 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926ba7a-153c-4edb-a289-61397a4943a2 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:13.115406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926ba7a-153c-4edb-a289-61397a4943a2 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:13.115536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926ba7a-153c-4edb-a289-61397a4943a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:13.141714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-4926ba7a-153c-4edb-a289-61397a4943a2 None None] MFA Rules not processed for user `ab4bd50b03f047c997dcdfd3b55ff53c`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:13.142905 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4926ba7a-153c-4edb-a289-61397a4943a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:13.204402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4deecc8-2645-432a-a608-ee79fe8724ed admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:13.206461 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f4deecc8-2645-432a-a608-ee79fe8724ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:13.213691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 914/1836] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:13.261399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926ba7a-153c-4edb-a289-61397a4943a2 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:13.263650 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4926ba7a-153c-4edb-a289-61397a4943a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:13.290147 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4deecc8-2645-432a-a608-ee79fe8724ed admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:13.295021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb10a1-5945-454f-bc07-5f9b2611077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:13.295926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb10a1-5945-454f-bc07-5f9b2611077e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:13.296211 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb10a1-5945-454f-bc07-5f9b2611077e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:13.296487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb10a1-5945-454f-bc07-5f9b2611077e admin admin] PATH_INFO: `/v3/users/0d675d0380834275b04a7272aa0c1ad8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:13.297883 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb10a1-5945-454f-bc07-5f9b2611077e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d675d0380834275b04a7272aa0c1ad8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:13.299906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb10a1-5945-454f-bc07-5f9b2611077e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:13.330179 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926ba7a-153c-4edb-a289-61397a4943a2 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:13.343072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7147f84-2484-4766-a1c7-3a423de3df7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:13.344061 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7147f84-2484-4766-a1c7-3a423de3df7c service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:13.344345 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7147f84-2484-4766-a1c7-3a423de3df7c service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:13.346596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7147f84-2484-4766-a1c7-3a423de3df7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:13.486131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7147f84-2484-4766-a1c7-3a423de3df7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:13.487909 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7147f84-2484-4766-a1c7-3a423de3df7c service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:13.499288 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 915/1837] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:13.499919 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-fdfb10a1-5945-454f-bc07-5f9b2611077e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d675d0380834275b04a7272aa0c1ad8'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:13.651164 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-fdfb10a1-5945-454f-bc07-5f9b2611077e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d675d0380834275b04a7272aa0c1ad8'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:13.669307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-fdfb10a1-5945-454f-bc07-5f9b2611077e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d675d0380834275b04a7272aa0c1ad8'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:13.670399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-fdfb10a1-5945-454f-bc07-5f9b2611077e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d675d0380834275b04a7272aa0c1ad8'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:13.674409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:13.678959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-fdfb10a1-5945-454f-bc07-5f9b2611077e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d675d0380834275b04a7272aa0c1ad8'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:13.687585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 923/1838] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:13 2022] DELETE /identity/v3/users/0d675d0380834275b04a7272aa0c1ad8 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:13.692074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d47c2-989c-48bd-a334-162ae4de3eb8 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:13.692367 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d47c2-989c-48bd-a334-162ae4de3eb8 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:13.692706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d47c2-989c-48bd-a334-162ae4de3eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:13.713387 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-842d47c2-989c-48bd-a334-162ae4de3eb8 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:13.714678 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-842d47c2-989c-48bd-a334-162ae4de3eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:13.843406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 916/1839] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:13.858485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb10a1-5945-454f-bc07-5f9b2611077e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:13.864428 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-fdfb10a1-5945-454f-bc07-5f9b2611077e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:13.979464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb10a1-5945-454f-bc07-5f9b2611077e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:13.979464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bd1c5-8579-44ab-812b-4a8f64c09c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:13.979464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bd1c5-8579-44ab-812b-4a8f64c09c62 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:13.979464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bd1c5-8579-44ab-812b-4a8f64c09c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:13.980369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bd1c5-8579-44ab-812b-4a8f64c09c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:13.980369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bd1c5-8579-44ab-812b-4a8f64c09c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:13.980369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bd1c5-8579-44ab-812b-4a8f64c09c62 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:13.980369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 924/1840] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:15.336035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d47c2-989c-48bd-a334-162ae4de3eb8 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:15.338037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-842d47c2-989c-48bd-a334-162ae4de3eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:15.359221 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d47c2-989c-48bd-a334-162ae4de3eb8 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:15.374939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:15.375826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:15.376054 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:15.385667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] PATH_INFO: `/v3/projects/4b9375015e9e48728dcb963e03e0b054` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:15.385667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9375015e9e48728dcb963e03e0b054)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:15.387260 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:15.670984 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9375015e9e48728dcb963e03e0b054', 'request_id': 'req-e2965483-75b8-47a7-b7b0-8823b6bca9f8'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:15.748523 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9375015e9e48728dcb963e03e0b054', 'request_id': 'req-e2965483-75b8-47a7-b7b0-8823b6bca9f8'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:15.755411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9375015e9e48728dcb963e03e0b054', 'request_id': 'req-e2965483-75b8-47a7-b7b0-8823b6bca9f8'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:15.767065 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] The token cache is being invalidate because project 4b9375015e9e48728dcb963e03e0b054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:15.767354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:15.768035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:15.769583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 917/1841] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:15 2022] DELETE /identity/v3/projects/4b9375015e9e48728dcb963e03e0b054 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:15.773680 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bd1c5-8579-44ab-812b-4a8f64c09c62 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:15.784142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bd1c5-8579-44ab-812b-4a8f64c09c62 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:15.842388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f817d-0771-4ce6-9753-b4f7ee54c1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:15.843529 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f817d-0771-4ce6-9753-b4f7ee54c1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:15.843658 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f817d-0771-4ce6-9753-b4f7ee54c1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:15.843849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f817d-0771-4ce6-9753-b4f7ee54c1f9 admin admin] PATH_INFO: `/v3/users/57887928075a4e1a8952755f90712dac` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:15.845101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f817d-0771-4ce6-9753-b4f7ee54c1f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57887928075a4e1a8952755f90712dac)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:15.847031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f817d-0771-4ce6-9753-b4f7ee54c1f9 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:16.030504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b09f817d-0771-4ce6-9753-b4f7ee54c1f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57887928075a4e1a8952755f90712dac'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:16.108067 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b09f817d-0771-4ce6-9753-b4f7ee54c1f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57887928075a4e1a8952755f90712dac'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:16.121220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b09f817d-0771-4ce6-9753-b4f7ee54c1f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57887928075a4e1a8952755f90712dac'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:16.121894 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b09f817d-0771-4ce6-9753-b4f7ee54c1f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57887928075a4e1a8952755f90712dac'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:16.129157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b09f817d-0771-4ce6-9753-b4f7ee54c1f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57887928075a4e1a8952755f90712dac'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:16.135332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 925/1842] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:15 2022] DELETE /identity/v3/users/57887928075a4e1a8952755f90712dac => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:16.650083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:16.651585 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:16.664803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2965483-75b8-47a7-b7b0-8823b6bca9f8 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:16.721110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e7302-f056-49d6-b89b-61707e2423a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:16.722107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e7302-f056-49d6-b89b-61707e2423a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:16.722372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e7302-f056-49d6-b89b-61707e2423a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:16.722633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e7302-f056-49d6-b89b-61707e2423a9 admin admin] PATH_INFO: `/v3/projects/07593cd458cd46f8b62f74642adb5797` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:16.724005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e7302-f056-49d6-b89b-61707e2423a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07593cd458cd46f8b62f74642adb5797)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:16.726087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e7302-f056-49d6-b89b-61707e2423a9 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:16.814425 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:16.831862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3d5e7302-f056-49d6-b89b-61707e2423a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07593cd458cd46f8b62f74642adb5797', 'request_id': 'req-3d5e7302-f056-49d6-b89b-61707e2423a9'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:16.900026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3d5e7302-f056-49d6-b89b-61707e2423a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07593cd458cd46f8b62f74642adb5797', 'request_id': 'req-3d5e7302-f056-49d6-b89b-61707e2423a9'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:16.907120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3d5e7302-f056-49d6-b89b-61707e2423a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07593cd458cd46f8b62f74642adb5797', 'request_id': 'req-3d5e7302-f056-49d6-b89b-61707e2423a9'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:16.917223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3d5e7302-f056-49d6-b89b-61707e2423a9 admin admin] The token cache is being invalidate because project 07593cd458cd46f8b62f74642adb5797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:16.917513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3d5e7302-f056-49d6-b89b-61707e2423a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:16.918147 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3d5e7302-f056-49d6-b89b-61707e2423a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:16.919743 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 918/1843] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:16 2022] DELETE /identity/v3/projects/07593cd458cd46f8b62f74642adb5797 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:16.924744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093300e8-374a-48a4-ae46-845224f0d99e None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:16.925117 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093300e8-374a-48a4-ae46-845224f0d99e None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:16.925565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093300e8-374a-48a4-ae46-845224f0d99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:16.943992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-093300e8-374a-48a4-ae46-845224f0d99e None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:16.945193 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-093300e8-374a-48a4-ae46-845224f0d99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:17.015207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02cecf-75d0-4142-97ec-3b0eb724ba43 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:17.015372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02cecf-75d0-4142-97ec-3b0eb724ba43 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:17.015705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02cecf-75d0-4142-97ec-3b0eb724ba43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:17.017837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 926/1844] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:17.042267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-6f02cecf-75d0-4142-97ec-3b0eb724ba43 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:17.044786 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6f02cecf-75d0-4142-97ec-3b0eb724ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:17.063584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093300e8-374a-48a4-ae46-845224f0d99e None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:17.079900 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 919/1845] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:17.080198 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093300e8-374a-48a4-ae46-845224f0d99e None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:17.086151 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530683d8-08a7-459c-a3d2-49d6df945474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:17.087037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530683d8-08a7-459c-a3d2-49d6df945474 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:17.087320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530683d8-08a7-459c-a3d2-49d6df945474 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:17.088216 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530683d8-08a7-459c-a3d2-49d6df945474 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:17.089239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530683d8-08a7-459c-a3d2-49d6df945474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:17.089553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530683d8-08a7-459c-a3d2-49d6df945474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:17.091271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530683d8-08a7-459c-a3d2-49d6df945474 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:17.103690 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 927/1846] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:17.108833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02cecf-75d0-4142-97ec-3b0eb724ba43 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:17.118842 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02cecf-75d0-4142-97ec-3b0eb724ba43 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:17.126592 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf551a-8e9f-4099-9eac-fc0dadfccb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:17.127584 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf551a-8e9f-4099-9eac-fc0dadfccb2a admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:17.127781 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf551a-8e9f-4099-9eac-fc0dadfccb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:17.128039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf551a-8e9f-4099-9eac-fc0dadfccb2a admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:17.128952 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf551a-8e9f-4099-9eac-fc0dadfccb2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:17.132634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf551a-8e9f-4099-9eac-fc0dadfccb2a admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:17.235801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 920/1847] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:17 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:17.239950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530683d8-08a7-459c-a3d2-49d6df945474 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:17.250365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530683d8-08a7-459c-a3d2-49d6df945474 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:17.308508 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7db26e-253d-4de3-b8b3-706514621bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:17.309184 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db26e-253d-4de3-b8b3-706514621bab admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:17.309490 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db26e-253d-4de3-b8b3-706514621bab admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:17.310361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db26e-253d-4de3-b8b3-706514621bab admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:17.311057 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7db26e-253d-4de3-b8b3-706514621bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:17.313033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7db26e-253d-4de3-b8b3-706514621bab admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:17.403118 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 928/1848] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:17 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:17.404807 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf551a-8e9f-4099-9eac-fc0dadfccb2a admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:17.414981 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf551a-8e9f-4099-9eac-fc0dadfccb2a admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:17.420339 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e2a9a-c5b5-44d1-a5bb-df2daed19431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:17.420994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e2a9a-c5b5-44d1-a5bb-df2daed19431 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:17.421280 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e2a9a-c5b5-44d1-a5bb-df2daed19431 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:17.421561 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e2a9a-c5b5-44d1-a5bb-df2daed19431 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:17.422298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e2a9a-c5b5-44d1-a5bb-df2daed19431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:17.423936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e2a9a-c5b5-44d1-a5bb-df2daed19431 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:17.434237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 921/1849] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:17.438364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7db26e-253d-4de3-b8b3-706514621bab admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:17.448173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7db26e-253d-4de3-b8b3-706514621bab admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:17.452870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed6d10-7557-41d6-92af-0cd1d373467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:17.454826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed6d10-7557-41d6-92af-0cd1d373467a admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:17.454826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed6d10-7557-41d6-92af-0cd1d373467a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:17.454826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed6d10-7557-41d6-92af-0cd1d373467a admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:17.454826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed6d10-7557-41d6-92af-0cd1d373467a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:17.456419 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed6d10-7557-41d6-92af-0cd1d373467a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:17.469354 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 929/1850] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:17.471266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e2a9a-c5b5-44d1-a5bb-df2daed19431 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:17.482612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e2a9a-c5b5-44d1-a5bb-df2daed19431 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:17.489357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a83db-2163-4b35-8f62-d1520cb9c089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:17.490288 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a83db-2163-4b35-8f62-d1520cb9c089 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:17.490544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a83db-2163-4b35-8f62-d1520cb9c089 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:17.490830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a83db-2163-4b35-8f62-d1520cb9c089 admin admin] PATH_INFO: `/v3/projects/bc8eca9e7d0647c59bfbf9a2e5e1bc7f/users/d444ca2302d24b22bbb680696fbf4b28/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:17.506537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a83db-2163-4b35-8f62-d1520cb9c089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc8eca9e7d0647c59bfbf9a2e5e1bc7f, user_id=d444ca2302d24b22bbb680696fbf4b28, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:17.509655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a83db-2163-4b35-8f62-d1520cb9c089 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:17.662951 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 922/1851] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:17 2022] PUT /identity/v3/projects/bc8eca9e7d0647c59bfbf9a2e5e1bc7f/users/d444ca2302d24b22bbb680696fbf4b28/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:17.667482 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537e41c-6fac-41df-abfa-3686681fe422 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:17.667834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537e41c-6fac-41df-abfa-3686681fe422 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:17.668173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537e41c-6fac-41df-abfa-3686681fe422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:17.695381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-3537e41c-6fac-41df-abfa-3686681fe422 None None] MFA Rules not processed for user `d444ca2302d24b22bbb680696fbf4b28`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:17.696731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3537e41c-6fac-41df-abfa-3686681fe422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:17.765325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 930/1852] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:17.769624 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a83db-2163-4b35-8f62-d1520cb9c089 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:17.824688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537e41c-6fac-41df-abfa-3686681fe422 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:17.826733 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3537e41c-6fac-41df-abfa-3686681fe422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:17.831229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a83db-2163-4b35-8f62-d1520cb9c089 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:17.836106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d31be-65d6-4159-92b5-9d22da11df6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:17.836737 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d31be-65d6-4159-92b5-9d22da11df6b admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:17.837031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d31be-65d6-4159-92b5-9d22da11df6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:17.837312 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d31be-65d6-4159-92b5-9d22da11df6b admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:17.838013 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d31be-65d6-4159-92b5-9d22da11df6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:17.839958 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d31be-65d6-4159-92b5-9d22da11df6b admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:17.884284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537e41c-6fac-41df-abfa-3686681fe422 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:17.888411 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95898ef-f132-435d-861f-c6d18e2af5d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:17.889065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95898ef-f132-435d-861f-c6d18e2af5d5 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:17.889353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95898ef-f132-435d-861f-c6d18e2af5d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:17.889633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95898ef-f132-435d-861f-c6d18e2af5d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:17.891397 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d95898ef-f132-435d-861f-c6d18e2af5d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:17.944145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 923/1853] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:17 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:17.948815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d31be-65d6-4159-92b5-9d22da11df6b admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:17.957927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95898ef-f132-435d-861f-c6d18e2af5d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:17.959844 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95898ef-f132-435d-861f-c6d18e2af5d5 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:17.972296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 931/1854] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:18.021487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d31be-65d6-4159-92b5-9d22da11df6b admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:18.026462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74940f75-23f7-4aee-bee2-b3252d5f4cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:18.027136 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74940f75-23f7-4aee-bee2-b3252d5f4cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:18.027478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74940f75-23f7-4aee-bee2-b3252d5f4cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:18.027754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74940f75-23f7-4aee-bee2-b3252d5f4cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:18.028504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74940f75-23f7-4aee-bee2-b3252d5f4cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:18.030551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74940f75-23f7-4aee-bee2-b3252d5f4cc6 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:18.109767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 924/1855] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:17 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:18.111134 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95898ef-f132-435d-861f-c6d18e2af5d5 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:18.130558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95898ef-f132-435d-861f-c6d18e2af5d5 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:18.137891 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2130a-28ae-4079-8ad7-521718ac3d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:18.137891 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2130a-28ae-4079-8ad7-521718ac3d1e admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:18.137891 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2130a-28ae-4079-8ad7-521718ac3d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:18.137891 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2130a-28ae-4079-8ad7-521718ac3d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:18.138269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2130a-28ae-4079-8ad7-521718ac3d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:18.138269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2130a-28ae-4079-8ad7-521718ac3d1e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:18.151489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 932/1856] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:18.155512 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74940f75-23f7-4aee-bee2-b3252d5f4cc6 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:18.165578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74940f75-23f7-4aee-bee2-b3252d5f4cc6 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:18.171566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7563f5-1045-4913-848a-0e31b8ef32fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:18.172329 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7563f5-1045-4913-848a-0e31b8ef32fb admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:18.172619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7563f5-1045-4913-848a-0e31b8ef32fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:18.172895 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7563f5-1045-4913-848a-0e31b8ef32fb admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:18.173627 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7563f5-1045-4913-848a-0e31b8ef32fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:18.175246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7563f5-1045-4913-848a-0e31b8ef32fb admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:18.185733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 925/1857] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:18.189908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2130a-28ae-4079-8ad7-521718ac3d1e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:18.199844 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2130a-28ae-4079-8ad7-521718ac3d1e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:18.204475 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fbcce-05f4-40a8-9486-7f231dd3beaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:18.205346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fbcce-05f4-40a8-9486-7f231dd3beaf admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:18.205625 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fbcce-05f4-40a8-9486-7f231dd3beaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:18.205896 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fbcce-05f4-40a8-9486-7f231dd3beaf admin admin] PATH_INFO: `/v3/projects/851add985b8341658f33a488303d892e/users/284e21493c4f4c7fa8c1ef916e0acd51/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:18.222008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fbcce-05f4-40a8-9486-7f231dd3beaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=851add985b8341658f33a488303d892e, user_id=284e21493c4f4c7fa8c1ef916e0acd51, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:18.225007 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fbcce-05f4-40a8-9486-7f231dd3beaf admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:18.310074 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 933/1858] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:18 2022] PUT /identity/v3/projects/851add985b8341658f33a488303d892e/users/284e21493c4f4c7fa8c1ef916e0acd51/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:18.322120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741ac7-b46d-4d37-9935-fe7700fcf908 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:18.322918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741ac7-b46d-4d37-9935-fe7700fcf908 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:18.323301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741ac7-b46d-4d37-9935-fe7700fcf908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:18.357712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-4e741ac7-b46d-4d37-9935-fe7700fcf908 None None] MFA Rules not processed for user `284e21493c4f4c7fa8c1ef916e0acd51`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:18.359581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4e741ac7-b46d-4d37-9935-fe7700fcf908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:18.434303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 926/1859] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:18.439064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fbcce-05f4-40a8-9486-7f231dd3beaf admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:18.511088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fbcce-05f4-40a8-9486-7f231dd3beaf admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:18.516841 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51a462-a1f4-4fc3-a3d6-eadec2b864b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:18.517502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51a462-a1f4-4fc3-a3d6-eadec2b864b4 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:18.517781 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51a462-a1f4-4fc3-a3d6-eadec2b864b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:18.518100 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51a462-a1f4-4fc3-a3d6-eadec2b864b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:18.518881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51a462-a1f4-4fc3-a3d6-eadec2b864b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:18.521068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51a462-a1f4-4fc3-a3d6-eadec2b864b4 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:18.645189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 934/1860] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:18 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:18.649579 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e741ac7-b46d-4d37-9935-fe7700fcf908 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:18.664451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e741ac7-b46d-4d37-9935-fe7700fcf908 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:18.733083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec16715-267a-44be-845b-5e5bf7ba3283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:18.734190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec16715-267a-44be-845b-5e5bf7ba3283 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:18.734679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec16715-267a-44be-845b-5e5bf7ba3283 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:18.734966 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec16715-267a-44be-845b-5e5bf7ba3283 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:18.737245 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec16715-267a-44be-845b-5e5bf7ba3283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:18.739407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec16715-267a-44be-845b-5e5bf7ba3283 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:18.855308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 927/1861] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:18 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:18.856428 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51a462-a1f4-4fc3-a3d6-eadec2b864b4 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:18.867445 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec16715-267a-44be-845b-5e5bf7ba3283 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:18.868797 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51a462-a1f4-4fc3-a3d6-eadec2b864b4 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:18.869992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0ec16715-267a-44be-845b-5e5bf7ba3283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:18.874402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d786ee-45b1-4adc-90f0-9c0b6ed408ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:18.875081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d786ee-45b1-4adc-90f0-9c0b6ed408ea admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:18.876707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d786ee-45b1-4adc-90f0-9c0b6ed408ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:18.876707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d786ee-45b1-4adc-90f0-9c0b6ed408ea admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:18.876707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d786ee-45b1-4adc-90f0-9c0b6ed408ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:18.878365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d786ee-45b1-4adc-90f0-9c0b6ed408ea admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:18.884052 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec16715-267a-44be-845b-5e5bf7ba3283 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:18.890102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723801d-d7e3-4aea-99a8-fa5f31853280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:18.891277 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723801d-d7e3-4aea-99a8-fa5f31853280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:18.891774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723801d-d7e3-4aea-99a8-fa5f31853280 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:18.892126 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723801d-d7e3-4aea-99a8-fa5f31853280 admin admin] PATH_INFO: `/v3/users/a551a6d493be43d58bc96ffce973c616` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:18.893444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723801d-d7e3-4aea-99a8-fa5f31853280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a551a6d493be43d58bc96ffce973c616)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:18.894641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 935/1862] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:18.896074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723801d-d7e3-4aea-99a8-fa5f31853280 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:18.896471 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d786ee-45b1-4adc-90f0-9c0b6ed408ea admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:18.906768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d786ee-45b1-4adc-90f0-9c0b6ed408ea admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:18.912885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7074bf8-483e-4c61-8d93-9ac09d618795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:18.913954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074bf8-483e-4c61-8d93-9ac09d618795 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:18.914235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074bf8-483e-4c61-8d93-9ac09d618795 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:18.914526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074bf8-483e-4c61-8d93-9ac09d618795 admin admin] PATH_INFO: `/v3/projects/a852acc2631541ae9791a743046dda28/users/824bee04d4a94f4d9317eca6552a3564/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:18.931254 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7074bf8-483e-4c61-8d93-9ac09d618795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a852acc2631541ae9791a743046dda28, user_id=824bee04d4a94f4d9317eca6552a3564, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:18.934199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7074bf8-483e-4c61-8d93-9ac09d618795 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:19.011395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:19.038301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 936/1863] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:18 2022] PUT /identity/v3/projects/a852acc2631541ae9791a743046dda28/users/824bee04d4a94f4d9317eca6552a3564/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:19.042235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7074bf8-483e-4c61-8d93-9ac09d618795 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:19.113273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a723801d-d7e3-4aea-99a8-fa5f31853280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a551a6d493be43d58bc96ffce973c616'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:19.126335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7074bf8-483e-4c61-8d93-9ac09d618795 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:19.136596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a723801d-d7e3-4aea-99a8-fa5f31853280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a551a6d493be43d58bc96ffce973c616'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:19.138181 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dd512-282b-4e93-8eca-26ed17bf00da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:19.138879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd512-282b-4e93-8eca-26ed17bf00da admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:19.139158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd512-282b-4e93-8eca-26ed17bf00da admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:19.139430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd512-282b-4e93-8eca-26ed17bf00da admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:19.140193 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dd512-282b-4e93-8eca-26ed17bf00da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:19.142203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dd512-282b-4e93-8eca-26ed17bf00da admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:19.160575 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 937/1864] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:19.160912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a723801d-d7e3-4aea-99a8-fa5f31853280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a551a6d493be43d58bc96ffce973c616'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:19.165042 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a723801d-d7e3-4aea-99a8-fa5f31853280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a551a6d493be43d58bc96ffce973c616'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:19.168334 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dd512-282b-4e93-8eca-26ed17bf00da admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:19.170958 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b37dd512-282b-4e93-8eca-26ed17bf00da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:19.186096 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dd512-282b-4e93-8eca-26ed17bf00da admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:19.190502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e1124-01d3-4170-8db8-056a908d96ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:19.191426 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e1124-01d3-4170-8db8-056a908d96ec admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:19.191735 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e1124-01d3-4170-8db8-056a908d96ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:19.192013 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e1124-01d3-4170-8db8-056a908d96ec admin admin] PATH_INFO: `/v3/projects/a852acc2631541ae9791a743046dda28/users/824bee04d4a94f4d9317eca6552a3564/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:19.194315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e1124-01d3-4170-8db8-056a908d96ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a852acc2631541ae9791a743046dda28, user_id=824bee04d4a94f4d9317eca6552a3564, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:19.197138 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e1124-01d3-4170-8db8-056a908d96ec admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:19.212512 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 938/1865] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:19 2022] PUT /identity/v3/projects/a852acc2631541ae9791a743046dda28/users/824bee04d4a94f4d9317eca6552a3564/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:19.225441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9c148-cde3-40b7-9cb1-a010a08d0ae2 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:19.225939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9c148-cde3-40b7-9cb1-a010a08d0ae2 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:19.226785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9c148-cde3-40b7-9cb1-a010a08d0ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:19.259916 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-58a9c148-cde3-40b7-9cb1-a010a08d0ae2 None None] MFA Rules not processed for user `824bee04d4a94f4d9317eca6552a3564`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:19.261143 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-58a9c148-cde3-40b7-9cb1-a010a08d0ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:19.267740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a723801d-d7e3-4aea-99a8-fa5f31853280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a551a6d493be43d58bc96ffce973c616'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:19.276823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 928/1866] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:18 2022] DELETE /identity/v3/users/a551a6d493be43d58bc96ffce973c616 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:19.281341 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1b1c0-08de-4d79-aea1-cf5e4ffd4e42 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:19.281631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1b1c0-08de-4d79-aea1-cf5e4ffd4e42 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:19.281914 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1b1c0-08de-4d79-aea1-cf5e4ffd4e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:19.300481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-83a1b1c0-08de-4d79-aea1-cf5e4ffd4e42 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:19.301681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-83a1b1c0-08de-4d79-aea1-cf5e4ffd4e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:19.344128 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 939/1867] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:19.357133 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9c148-cde3-40b7-9cb1-a010a08d0ae2 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:19.358880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-58a9c148-cde3-40b7-9cb1-a010a08d0ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:19.364742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 929/1868] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:19.375158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1b1c0-08de-4d79-aea1-cf5e4ffd4e42 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:19.377343 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-83a1b1c0-08de-4d79-aea1-cf5e4ffd4e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:19.423715 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9c148-cde3-40b7-9cb1-a010a08d0ae2 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:19.441073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1b1c0-08de-4d79-aea1-cf5e4ffd4e42 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:19.445693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30519362-9353-4ce9-972a-177e5c409b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:19.446515 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30519362-9353-4ce9-972a-177e5c409b33 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:19.446809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30519362-9353-4ce9-972a-177e5c409b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:19.447083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30519362-9353-4ce9-972a-177e5c409b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:19.457359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30519362-9353-4ce9-972a-177e5c409b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:19.461502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30519362-9353-4ce9-972a-177e5c409b33 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:19.470970 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 930/1869] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:19.471848 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30519362-9353-4ce9-972a-177e5c409b33 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:19.473152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-30519362-9353-4ce9-972a-177e5c409b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:19.487035 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2b229-241d-42ff-add3-ae640dc47dff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:19.488260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2b229-241d-42ff-add3-ae640dc47dff service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:19.488749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2b229-241d-42ff-add3-ae640dc47dff service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:19.489233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2b229-241d-42ff-add3-ae640dc47dff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:19.519391 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:19.532352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30519362-9353-4ce9-972a-177e5c409b33 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:19.537476 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d3a41-9fe9-46a7-8fef-71676345860d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:19.538272 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3a41-9fe9-46a7-8fef-71676345860d service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:19.538645 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3a41-9fe9-46a7-8fef-71676345860d service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:19.538992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3a41-9fe9-46a7-8fef-71676345860d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:19.540972 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ac4d3a41-9fe9-46a7-8fef-71676345860d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:19.565528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2b229-241d-42ff-add3-ae640dc47dff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:19.567890 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2b229-241d-42ff-add3-ae640dc47dff service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:19.579607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 940/1870] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:19.608316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d3a41-9fe9-46a7-8fef-71676345860d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:19.609759 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d3a41-9fe9-46a7-8fef-71676345860d service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:19.618996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 931/1871] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:19.691428 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2b229-241d-42ff-add3-ae640dc47dff service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:19.699946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2b229-241d-42ff-add3-ae640dc47dff service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:19.704400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ece80d-967b-40f1-806c-298efc37ffe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:19.705048 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ece80d-967b-40f1-806c-298efc37ffe5 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:19.705335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ece80d-967b-40f1-806c-298efc37ffe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:19.705617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ece80d-967b-40f1-806c-298efc37ffe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:19.707586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-12ece80d-967b-40f1-806c-298efc37ffe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:19.773872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ece80d-967b-40f1-806c-298efc37ffe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:19.775321 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ece80d-967b-40f1-806c-298efc37ffe5 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:19.785054 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 941/1872] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:20.049479 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d3a41-9fe9-46a7-8fef-71676345860d service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:20.053085 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ac4d3a41-9fe9-46a7-8fef-71676345860d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:20.074804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d3a41-9fe9-46a7-8fef-71676345860d service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:20.088364 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:20.089295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:20.089681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:20.089965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] PATH_INFO: `/v3/projects/b0413126bbcb49ce92bc66084fe4c0c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:20.092287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0413126bbcb49ce92bc66084fe4c0c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:20.094410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:20.216239 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0413126bbcb49ce92bc66084fe4c0c8', 'request_id': 'req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.293127 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0413126bbcb49ce92bc66084fe4c0c8', 'request_id': 'req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.301106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0413126bbcb49ce92bc66084fe4c0c8', 'request_id': 'req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.312105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] The token cache is being invalidate because project b0413126bbcb49ce92bc66084fe4c0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:20.312491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.313215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.314860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 932/1873] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:20 2022] DELETE /identity/v3/projects/b0413126bbcb49ce92bc66084fe4c0c8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:20.318842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ece80d-967b-40f1-806c-298efc37ffe5 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:20.329830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ece80d-967b-40f1-806c-298efc37ffe5 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:20.386699 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6397de-2698-407e-8c42-f2cafbf0a185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:20.388176 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6397de-2698-407e-8c42-f2cafbf0a185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:20.388459 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6397de-2698-407e-8c42-f2cafbf0a185 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:20.388732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6397de-2698-407e-8c42-f2cafbf0a185 admin admin] PATH_INFO: `/v3/users/114be40c271846a290af77197153dba6` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:20.389922 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6397de-2698-407e-8c42-f2cafbf0a185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=114be40c271846a290af77197153dba6)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:20.391981 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6397de-2698-407e-8c42-f2cafbf0a185 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:20.649677 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6f6397de-2698-407e-8c42-f2cafbf0a185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '114be40c271846a290af77197153dba6'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.736305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6f6397de-2698-407e-8c42-f2cafbf0a185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '114be40c271846a290af77197153dba6'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.750895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6f6397de-2698-407e-8c42-f2cafbf0a185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '114be40c271846a290af77197153dba6'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.751961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6f6397de-2698-407e-8c42-f2cafbf0a185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '114be40c271846a290af77197153dba6'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.759970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6f6397de-2698-407e-8c42-f2cafbf0a185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '114be40c271846a290af77197153dba6'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.770902 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 942/1874] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:20 2022] DELETE /identity/v3/users/114be40c271846a290af77197153dba6 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:21.054124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:21.249740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:21.251262 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:21.286798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e2a71-fd2a-4b06-b59f-e26adcb1a7f2 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:21.380136 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01441de-6dfe-4193-9c2a-3911bd4d7c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:21.381058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01441de-6dfe-4193-9c2a-3911bd4d7c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:21.381617 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01441de-6dfe-4193-9c2a-3911bd4d7c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:21.381901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01441de-6dfe-4193-9c2a-3911bd4d7c52 admin admin] PATH_INFO: `/v3/projects/7327dd11d4fd4a1fa02672a901e3f763` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:21.383180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01441de-6dfe-4193-9c2a-3911bd4d7c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7327dd11d4fd4a1fa02672a901e3f763)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:21.385159 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01441de-6dfe-4193-9c2a-3911bd4d7c52 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:21.522292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c01441de-6dfe-4193-9c2a-3911bd4d7c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7327dd11d4fd4a1fa02672a901e3f763', 'request_id': 'req-c01441de-6dfe-4193-9c2a-3911bd4d7c52'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:21.551370 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:21.614114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c01441de-6dfe-4193-9c2a-3911bd4d7c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7327dd11d4fd4a1fa02672a901e3f763', 'request_id': 'req-c01441de-6dfe-4193-9c2a-3911bd4d7c52'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:21.621316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c01441de-6dfe-4193-9c2a-3911bd4d7c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7327dd11d4fd4a1fa02672a901e3f763', 'request_id': 'req-c01441de-6dfe-4193-9c2a-3911bd4d7c52'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:21.634235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c01441de-6dfe-4193-9c2a-3911bd4d7c52 admin admin] The token cache is being invalidate because project 7327dd11d4fd4a1fa02672a901e3f763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:21.634532 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c01441de-6dfe-4193-9c2a-3911bd4d7c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:21.635257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c01441de-6dfe-4193-9c2a-3911bd4d7c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:21.636923 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 933/1875] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:21 2022] DELETE /identity/v3/projects/7327dd11d4fd4a1fa02672a901e3f763 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:21.642602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d3fdd-a2c0-4e66-9927-5f41f04d40fc None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:21.643263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d3fdd-a2c0-4e66-9927-5f41f04d40fc None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:21.643263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d3fdd-a2c0-4e66-9927-5f41f04d40fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:21.663416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-a40d3fdd-a2c0-4e66-9927-5f41f04d40fc None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:21.669019 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a40d3fdd-a2c0-4e66-9927-5f41f04d40fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:21.724927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 943/1876] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:21.732790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf44e8c-1e4d-4f61-95cc-563c74d23600 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:21.733113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf44e8c-1e4d-4f61-95cc-563c74d23600 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:21.733399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf44e8c-1e4d-4f61-95cc-563c74d23600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:21.751766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-7cf44e8c-1e4d-4f61-95cc-563c74d23600 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:21.752978 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7cf44e8c-1e4d-4f61-95cc-563c74d23600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:21.761332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 934/1877] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:21.765986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d3fdd-a2c0-4e66-9927-5f41f04d40fc None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:21.775549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d3fdd-a2c0-4e66-9927-5f41f04d40fc None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:21.781054 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ed43f-5ded-441c-b649-6f15aa765c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:21.781722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ed43f-5ded-441c-b649-6f15aa765c70 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:21.783708 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ed43f-5ded-441c-b649-6f15aa765c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:21.783708 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ed43f-5ded-441c-b649-6f15aa765c70 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:21.783708 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ed43f-5ded-441c-b649-6f15aa765c70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:21.783708 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ed43f-5ded-441c-b649-6f15aa765c70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:21.784944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ed43f-5ded-441c-b649-6f15aa765c70 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:21.796773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 944/1878] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:21.801310 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf44e8c-1e4d-4f61-95cc-563c74d23600 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:21.811058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf44e8c-1e4d-4f61-95cc-563c74d23600 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:21.817261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713de80-37fb-4c79-afdf-0f880bc8d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:21.817928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713de80-37fb-4c79-afdf-0f880bc8d5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:21.818212 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713de80-37fb-4c79-afdf-0f880bc8d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:21.818492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713de80-37fb-4c79-afdf-0f880bc8d5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:21.819181 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713de80-37fb-4c79-afdf-0f880bc8d5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:21.821155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713de80-37fb-4c79-afdf-0f880bc8d5a1 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:21.901248 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1c9f1-e0c2-4b6e-88f6-2304f206b9f4 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:21.901778 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1c9f1-e0c2-4b6e-88f6-2304f206b9f4 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:21.902306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1c9f1-e0c2-4b6e-88f6-2304f206b9f4 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:21.903927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 945/1879] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 2 13:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:57:21.910510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf617a6-e501-4b90-9af3-bc3a3c8f41e0 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:21.910992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf617a6-e501-4b90-9af3-bc3a3c8f41e0 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:21.911428 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf617a6-e501-4b90-9af3-bc3a3c8f41e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:21.935987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-8cf617a6-e501-4b90-9af3-bc3a3c8f41e0 None None] MFA Rules not processed for user `b9971f2bf0f2400b90168f6032a0e226`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:21.940329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8cf617a6-e501-4b90-9af3-bc3a3c8f41e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:21.971687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 935/1880] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:21 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:21.974477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713de80-37fb-4c79-afdf-0f880bc8d5a1 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:22.064772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 946/1881] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 2 13:57:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:22.084646 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf617a6-e501-4b90-9af3-bc3a3c8f41e0 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:22.086372 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8cf617a6-e501-4b90-9af3-bc3a3c8f41e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:22.104770 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf617a6-e501-4b90-9af3-bc3a3c8f41e0 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:22.105402 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713de80-37fb-4c79-afdf-0f880bc8d5a1 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:22.110934 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172913c-c58c-45a2-aaf5-0fb3350bc47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:22.111834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172913c-c58c-45a2-aaf5-0fb3350bc47e admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:22.112060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172913c-c58c-45a2-aaf5-0fb3350bc47e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:22.112278 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172913c-c58c-45a2-aaf5-0fb3350bc47e admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:22.112978 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172913c-c58c-45a2-aaf5-0fb3350bc47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:22.114920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172913c-c58c-45a2-aaf5-0fb3350bc47e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:22.173145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c022d-41f9-4326-bff2-5e57256f0115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:22.173805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c022d-41f9-4326-bff2-5e57256f0115 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:22.174088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c022d-41f9-4326-bff2-5e57256f0115 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:22.174370 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c022d-41f9-4326-bff2-5e57256f0115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:22.183283 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c022d-41f9-4326-bff2-5e57256f0115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:22.194325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c022d-41f9-4326-bff2-5e57256f0115 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:22.195747 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 947/1882] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:22.253564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 936/1883] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:21 2022] POST /identity/v3/users => generated 285 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:22.253840 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c022d-41f9-4326-bff2-5e57256f0115 service nova] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:22.265360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c022d-41f9-4326-bff2-5e57256f0115 service nova] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:22.270192 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc75b8-c9e1-45b2-924e-62ee75788726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:22.270897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc75b8-c9e1-45b2-924e-62ee75788726 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:22.271183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc75b8-c9e1-45b2-924e-62ee75788726 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:22.271494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc75b8-c9e1-45b2-924e-62ee75788726 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:22.272224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc75b8-c9e1-45b2-924e-62ee75788726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:22.273919 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc75b8-c9e1-45b2-924e-62ee75788726 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:22.284256 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 948/1884] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:22.288318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172913c-c58c-45a2-aaf5-0fb3350bc47e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:22.300496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172913c-c58c-45a2-aaf5-0fb3350bc47e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:22.306904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e285211-6e6f-44e3-ae0e-04cdaa55776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:22.307706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e285211-6e6f-44e3-ae0e-04cdaa55776c admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:22.308184 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e285211-6e6f-44e3-ae0e-04cdaa55776c admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:22.308467 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e285211-6e6f-44e3-ae0e-04cdaa55776c admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:22.309250 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e285211-6e6f-44e3-ae0e-04cdaa55776c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:22.314877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e285211-6e6f-44e3-ae0e-04cdaa55776c admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:22.322254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 937/1885] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:22.327195 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc75b8-c9e1-45b2-924e-62ee75788726 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:22.336776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc75b8-c9e1-45b2-924e-62ee75788726 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:22.341443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20afaff-d713-4922-bea4-4ca85a2d052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:22.342328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20afaff-d713-4922-bea4-4ca85a2d052f admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:22.342663 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20afaff-d713-4922-bea4-4ca85a2d052f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:22.345307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20afaff-d713-4922-bea4-4ca85a2d052f admin admin] PATH_INFO: `/v3/projects/3931dc8d71514c2aa1f2d74f65ed6fbb/users/b3ff4e6802784451b509db52219c1063/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:22.357494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20afaff-d713-4922-bea4-4ca85a2d052f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3931dc8d71514c2aa1f2d74f65ed6fbb, user_id=b3ff4e6802784451b509db52219c1063, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:22.360706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20afaff-d713-4922-bea4-4ca85a2d052f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:22.494207 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 949/1886] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:22 2022] PUT /identity/v3/projects/3931dc8d71514c2aa1f2d74f65ed6fbb/users/b3ff4e6802784451b509db52219c1063/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:22.506163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3382480-e293-4229-95a6-0ec713117746 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:22.506611 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3382480-e293-4229-95a6-0ec713117746 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:22.506808 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3382480-e293-4229-95a6-0ec713117746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:22.533538 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-d3382480-e293-4229-95a6-0ec713117746 None None] MFA Rules not processed for user `b3ff4e6802784451b509db52219c1063`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:22.534740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d3382480-e293-4229-95a6-0ec713117746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:22.626050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 938/1887] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:22.637201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20afaff-d713-4922-bea4-4ca85a2d052f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:22.704168 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20afaff-d713-4922-bea4-4ca85a2d052f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:22.709094 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49503a53-7b42-43a2-8243-68a4a8a4f530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:22.709759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49503a53-7b42-43a2-8243-68a4a8a4f530 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:22.710045 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49503a53-7b42-43a2-8243-68a4a8a4f530 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:22.710324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49503a53-7b42-43a2-8243-68a4a8a4f530 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:22.711054 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49503a53-7b42-43a2-8243-68a4a8a4f530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:22.713283 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49503a53-7b42-43a2-8243-68a4a8a4f530 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:22.823619 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 950/1888] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:22 2022] POST /identity/v3/projects => generated 369 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:22.827431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3382480-e293-4229-95a6-0ec713117746 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:22.837934 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3382480-e293-4229-95a6-0ec713117746 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:22.893439 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb77fa-05fe-410c-97d2-e90b93ba93cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:22.894097 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb77fa-05fe-410c-97d2-e90b93ba93cd admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:22.894382 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb77fa-05fe-410c-97d2-e90b93ba93cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:22.894654 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb77fa-05fe-410c-97d2-e90b93ba93cd admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:22.895326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb77fa-05fe-410c-97d2-e90b93ba93cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:22.897271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb77fa-05fe-410c-97d2-e90b93ba93cd admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:22.968904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 939/1889] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:22 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:22.972981 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49503a53-7b42-43a2-8243-68a4a8a4f530 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:22.983780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49503a53-7b42-43a2-8243-68a4a8a4f530 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:22.988432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedb0ca-a5b7-4b9a-805d-fc2c0e13755b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:22.989094 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedb0ca-a5b7-4b9a-805d-fc2c0e13755b admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:22.989379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedb0ca-a5b7-4b9a-805d-fc2c0e13755b admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:22.994051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedb0ca-a5b7-4b9a-805d-fc2c0e13755b admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:22.994051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedb0ca-a5b7-4b9a-805d-fc2c0e13755b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:22.994051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedb0ca-a5b7-4b9a-805d-fc2c0e13755b admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:23.003464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 951/1890] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:23.007802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb77fa-05fe-410c-97d2-e90b93ba93cd admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:23.017618 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb77fa-05fe-410c-97d2-e90b93ba93cd admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:23.024568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069463d5-502d-49b8-9727-21731d4d21b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:23.024568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069463d5-502d-49b8-9727-21731d4d21b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:23.024568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069463d5-502d-49b8-9727-21731d4d21b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:23.024568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069463d5-502d-49b8-9727-21731d4d21b3 admin admin] PATH_INFO: `/v3/projects/d6c43003e86a411aa872ffd4017ba34e/users/10be2bae6437449a8352a42be836db5c/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:23.040196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069463d5-502d-49b8-9727-21731d4d21b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c43003e86a411aa872ffd4017ba34e, user_id=10be2bae6437449a8352a42be836db5c, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:23.043143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069463d5-502d-49b8-9727-21731d4d21b3 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:23.124797 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 940/1891] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:23 2022] PUT /identity/v3/projects/d6c43003e86a411aa872ffd4017ba34e/users/10be2bae6437449a8352a42be836db5c/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:23.128514 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedb0ca-a5b7-4b9a-805d-fc2c0e13755b admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:23.150838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedb0ca-a5b7-4b9a-805d-fc2c0e13755b admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:23.230523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152676e-c8a3-49a8-b83e-2a67c2544643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:23.231053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152676e-c8a3-49a8-b83e-2a67c2544643 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:23.231420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152676e-c8a3-49a8-b83e-2a67c2544643 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:23.231734 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152676e-c8a3-49a8-b83e-2a67c2544643 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:23.232451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152676e-c8a3-49a8-b83e-2a67c2544643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:23.234375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152676e-c8a3-49a8-b83e-2a67c2544643 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:23.244434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 952/1892] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:23.248418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069463d5-502d-49b8-9727-21731d4d21b3 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:23.259003 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069463d5-502d-49b8-9727-21731d4d21b3 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:23.263710 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb339e9-b0ca-4dfb-a99e-c0a4b97b1532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:23.265128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb339e9-b0ca-4dfb-a99e-c0a4b97b1532 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:23.265410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb339e9-b0ca-4dfb-a99e-c0a4b97b1532 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:23.271153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb339e9-b0ca-4dfb-a99e-c0a4b97b1532 admin admin] PATH_INFO: `/v3/projects/d6c43003e86a411aa872ffd4017ba34e/users/10be2bae6437449a8352a42be836db5c/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:23.271153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb339e9-b0ca-4dfb-a99e-c0a4b97b1532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c43003e86a411aa872ffd4017ba34e, user_id=10be2bae6437449a8352a42be836db5c, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:23.271153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb339e9-b0ca-4dfb-a99e-c0a4b97b1532 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:23.281632 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 941/1893] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:23 2022] PUT /identity/v3/projects/d6c43003e86a411aa872ffd4017ba34e/users/10be2bae6437449a8352a42be836db5c/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:23.291671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013862be-f44c-4255-a78b-9af3ce8ae723 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:23.292018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013862be-f44c-4255-a78b-9af3ce8ae723 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:23.292300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013862be-f44c-4255-a78b-9af3ce8ae723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:23.318103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-013862be-f44c-4255-a78b-9af3ce8ae723 None None] MFA Rules not processed for user `10be2bae6437449a8352a42be836db5c`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:23.319276 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-013862be-f44c-4255-a78b-9af3ce8ae723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:23.325760 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:23.391415 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 953/1894] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:23 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:23.435487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb339e9-b0ca-4dfb-a99e-c0a4b97b1532 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:23.440775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-cdb339e9-b0ca-4dfb-a99e-c0a4b97b1532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:23.506996 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb339e9-b0ca-4dfb-a99e-c0a4b97b1532 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:23.511974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b33ab-3206-498e-9233-4bf547cf151d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:23.512577 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b33ab-3206-498e-9233-4bf547cf151d service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:23.512857 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b33ab-3206-498e-9233-4bf547cf151d service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:23.513303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b33ab-3206-498e-9233-4bf547cf151d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:23.523017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b33ab-3206-498e-9233-4bf547cf151d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:23.524672 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b33ab-3206-498e-9233-4bf547cf151d service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:23.536025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 942/1895] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:23 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:24.022195 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:24.052941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013862be-f44c-4255-a78b-9af3ce8ae723 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:24.065792 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013862be-f44c-4255-a78b-9af3ce8ae723 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:24.074953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19113f-00ce-4c9f-ad92-d87b6f06ade0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:24.075922 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19113f-00ce-4c9f-ad92-d87b6f06ade0 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:24.076359 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19113f-00ce-4c9f-ad92-d87b6f06ade0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:24.077450 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19113f-00ce-4c9f-ad92-d87b6f06ade0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:24.165468 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19113f-00ce-4c9f-ad92-d87b6f06ade0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:24.167155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19113f-00ce-4c9f-ad92-d87b6f06ade0 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:24.190543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 954/1896] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:24.693628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:25.026611 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b33ab-3206-498e-9233-4bf547cf151d service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:25.036534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a45b33ab-3206-498e-9233-4bf547cf151d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:25.094275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:25.128391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b33ab-3206-498e-9233-4bf547cf151d service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:25.133949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9b46a-d940-434e-b47b-8e1a4cdd1295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:25.134832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9b46a-d940-434e-b47b-8e1a4cdd1295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:25.135134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9b46a-d940-434e-b47b-8e1a4cdd1295 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:25.135415 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9b46a-d940-434e-b47b-8e1a4cdd1295 admin admin] PATH_INFO: `/v3/users/44c2a1329aec48a483cd405b3753c52c` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:25.137141 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9b46a-d940-434e-b47b-8e1a4cdd1295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c2a1329aec48a483cd405b3753c52c)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:25.140342 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9b46a-d940-434e-b47b-8e1a4cdd1295 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:25.176170 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19113f-00ce-4c9f-ad92-d87b6f06ade0 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:25.177719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1e19113f-00ce-4c9f-ad92-d87b6f06ade0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:25.201361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19113f-00ce-4c9f-ad92-d87b6f06ade0 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:25.206704 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2b405-ca4b-4483-b6c2-afb5995ec984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:25.207700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2b405-ca4b-4483-b6c2-afb5995ec984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:25.207986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2b405-ca4b-4483-b6c2-afb5995ec984 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:25.208259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2b405-ca4b-4483-b6c2-afb5995ec984 admin admin] PATH_INFO: `/v3/users/aaf1b68198714afa9e30dbb5486f0288` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:25.209455 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2b405-ca4b-4483-b6c2-afb5995ec984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf1b68198714afa9e30dbb5486f0288)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:25.211387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2b405-ca4b-4483-b6c2-afb5995ec984 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:25.440604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f9b9b46a-d940-434e-b47b-8e1a4cdd1295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c2a1329aec48a483cd405b3753c52c'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:25.456440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f9b9b46a-d940-434e-b47b-8e1a4cdd1295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c2a1329aec48a483cd405b3753c52c'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:25.464605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f9b9b46a-d940-434e-b47b-8e1a4cdd1295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c2a1329aec48a483cd405b3753c52c'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:25.465391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f9b9b46a-d940-434e-b47b-8e1a4cdd1295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c2a1329aec48a483cd405b3753c52c'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:25.540695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-69f2b405-ca4b-4483-b6c2-afb5995ec984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf1b68198714afa9e30dbb5486f0288'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:25.753295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f9b9b46a-d940-434e-b47b-8e1a4cdd1295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c2a1329aec48a483cd405b3753c52c'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:25.761872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 943/1897] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:25 2022] DELETE /identity/v3/users/44c2a1329aec48a483cd405b3753c52c => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:25.765599 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec6214-ad5b-49a3-aaf7-c4ed006fef94 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:25.765887 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec6214-ad5b-49a3-aaf7-c4ed006fef94 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:25.766170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec6214-ad5b-49a3-aaf7-c4ed006fef94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:25.784138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-c8ec6214-ad5b-49a3-aaf7-c4ed006fef94 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:25.785381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c8ec6214-ad5b-49a3-aaf7-c4ed006fef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:25.843431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 944/1898] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:25.852935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec6214-ad5b-49a3-aaf7-c4ed006fef94 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:25.854225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c8ec6214-ad5b-49a3-aaf7-c4ed006fef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:25.894030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-69f2b405-ca4b-4483-b6c2-afb5995ec984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf1b68198714afa9e30dbb5486f0288'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:25.906783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-69f2b405-ca4b-4483-b6c2-afb5995ec984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf1b68198714afa9e30dbb5486f0288'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:25.907558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-69f2b405-ca4b-4483-b6c2-afb5995ec984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf1b68198714afa9e30dbb5486f0288'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:25.911311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec6214-ad5b-49a3-aaf7-c4ed006fef94 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:25.914919 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-69f2b405-ca4b-4483-b6c2-afb5995ec984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf1b68198714afa9e30dbb5486f0288'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:25.917544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722729f1-c960-43e2-81a4-8ad3859bec72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:25.918303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722729f1-c960-43e2-81a4-8ad3859bec72 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:25.918663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722729f1-c960-43e2-81a4-8ad3859bec72 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:25.919067 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722729f1-c960-43e2-81a4-8ad3859bec72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:25.921620 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-722729f1-c960-43e2-81a4-8ad3859bec72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:25.922097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 955/1899] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:25 2022] DELETE /identity/v3/users/aaf1b68198714afa9e30dbb5486f0288 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:25.926610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e48ab-719d-4f18-954d-1994981174ea None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:25.927032 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e48ab-719d-4f18-954d-1994981174ea None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:25.927405 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e48ab-719d-4f18-954d-1994981174ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:25.935842 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722729f1-c960-43e2-81a4-8ad3859bec72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:25.938172 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722729f1-c960-43e2-81a4-8ad3859bec72 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:25.946503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-6d8e48ab-719d-4f18-954d-1994981174ea None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:25.948968 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 945/1900] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:25.949252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6d8e48ab-719d-4f18-954d-1994981174ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:26.023777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 956/1901] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:26.038380 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722729f1-c960-43e2-81a4-8ad3859bec72 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:26.039925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-722729f1-c960-43e2-81a4-8ad3859bec72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:26.055323 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722729f1-c960-43e2-81a4-8ad3859bec72 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:26.106369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91da6a-de54-48c7-a51c-890b0d7cc960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:26.107032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91da6a-de54-48c7-a51c-890b0d7cc960 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:26.107317 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91da6a-de54-48c7-a51c-890b0d7cc960 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:26.107630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91da6a-de54-48c7-a51c-890b0d7cc960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:26.118082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91da6a-de54-48c7-a51c-890b0d7cc960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:26.120193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91da6a-de54-48c7-a51c-890b0d7cc960 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:26.140094 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 946/1902] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:26.791563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e48ab-719d-4f18-954d-1994981174ea None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:26.792681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6d8e48ab-719d-4f18-954d-1994981174ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:26.805585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e48ab-719d-4f18-954d-1994981174ea None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:26.811314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:26.813625 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:26.815304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:26.815897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:26.816285 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] PATH_INFO: `/v3/projects/f5ea289f9aeb443c9c1160118f95715f` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:26.819080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ea289f9aeb443c9c1160118f95715f)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:26.821514 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:26.898638 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91da6a-de54-48c7-a51c-890b0d7cc960 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:26.901020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8e91da6a-de54-48c7-a51c-890b0d7cc960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:26.925422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91da6a-de54-48c7-a51c-890b0d7cc960 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:26.953763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ea289f9aeb443c9c1160118f95715f', 'request_id': 'req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.004572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:27.005454 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:27.005741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:27.006377 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] PATH_INFO: `/v3/projects/8261acfb655a48ce8d8a82e861df057d` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:27.007950 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8261acfb655a48ce8d8a82e861df057d)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:27.009454 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:27.047247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ea289f9aeb443c9c1160118f95715f', 'request_id': 'req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.053824 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ea289f9aeb443c9c1160118f95715f', 'request_id': 'req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.064512 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] The token cache is being invalidate because project f5ea289f9aeb443c9c1160118f95715f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:27.064802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.065438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.066985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 957/1903] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:26 2022] DELETE /identity/v3/projects/f5ea289f9aeb443c9c1160118f95715f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:27.070711 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:27.072001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:27.084698 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c55ea-39d7-4ebc-a79a-0f8e5248081c admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:27.089277 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84b9f6-5ee5-48d6-a599-cd79a6c9710f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:27.090120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84b9f6-5ee5-48d6-a599-cd79a6c9710f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:27.090399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84b9f6-5ee5-48d6-a599-cd79a6c9710f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:27.090689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84b9f6-5ee5-48d6-a599-cd79a6c9710f admin admin] PATH_INFO: `/v3/users/ab4bd50b03f047c997dcdfd3b55ff53c` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:27.091912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84b9f6-5ee5-48d6-a599-cd79a6c9710f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4bd50b03f047c997dcdfd3b55ff53c)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:27.093856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84b9f6-5ee5-48d6-a599-cd79a6c9710f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:27.138907 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8261acfb655a48ce8d8a82e861df057d', 'request_id': 'req-f3f4c288-d09c-4198-ade4-dd2dcd82e350'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.144783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:27.223038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8261acfb655a48ce8d8a82e861df057d', 'request_id': 'req-f3f4c288-d09c-4198-ade4-dd2dcd82e350'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.230866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8261acfb655a48ce8d8a82e861df057d', 'request_id': 'req-f3f4c288-d09c-4198-ade4-dd2dcd82e350'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.243113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] The token cache is being invalidate because project 8261acfb655a48ce8d8a82e861df057d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:27.243408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.244111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.245778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 947/1904] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:26 2022] DELETE /identity/v3/projects/8261acfb655a48ce8d8a82e861df057d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:27.250324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:27.251942 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:27.323307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4c288-d09c-4198-ade4-dd2dcd82e350 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:27.335789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9ac0d-753e-44d3-955f-884f6c661592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:27.337194 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9ac0d-753e-44d3-955f-884f6c661592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:27.337814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9ac0d-753e-44d3-955f-884f6c661592 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:27.338250 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9ac0d-753e-44d3-955f-884f6c661592 admin admin] PATH_INFO: `/v3/users/7368aea3f037465eae844cd858071b23` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:27.339868 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9ac0d-753e-44d3-955f-884f6c661592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7368aea3f037465eae844cd858071b23)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:27.342021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9ac0d-753e-44d3-955f-884f6c661592 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:27.348973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0c84b9f6-5ee5-48d6-a599-cd79a6c9710f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4bd50b03f047c997dcdfd3b55ff53c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.432947 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0c84b9f6-5ee5-48d6-a599-cd79a6c9710f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4bd50b03f047c997dcdfd3b55ff53c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.445798 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0c84b9f6-5ee5-48d6-a599-cd79a6c9710f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4bd50b03f047c997dcdfd3b55ff53c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.446440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0c84b9f6-5ee5-48d6-a599-cd79a6c9710f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4bd50b03f047c997dcdfd3b55ff53c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.453091 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0c84b9f6-5ee5-48d6-a599-cd79a6c9710f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4bd50b03f047c997dcdfd3b55ff53c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.459232 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 958/1905] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:27 2022] DELETE /identity/v3/users/ab4bd50b03f047c997dcdfd3b55ff53c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:27.593640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b6b9ac0d-753e-44d3-955f-884f6c661592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7368aea3f037465eae844cd858071b23'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.605261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b6b9ac0d-753e-44d3-955f-884f6c661592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7368aea3f037465eae844cd858071b23'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.612108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b6b9ac0d-753e-44d3-955f-884f6c661592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7368aea3f037465eae844cd858071b23'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.612813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b6b9ac0d-753e-44d3-955f-884f6c661592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7368aea3f037465eae844cd858071b23'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.633229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84b9f6-5ee5-48d6-a599-cd79a6c9710f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:27.634653 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-0c84b9f6-5ee5-48d6-a599-cd79a6c9710f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:27.699042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84b9f6-5ee5-48d6-a599-cd79a6c9710f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:27.703498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b6b9ac0d-753e-44d3-955f-884f6c661592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7368aea3f037465eae844cd858071b23'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.707089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98bc38-f376-40a3-9103-5d7d149dafda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:27.707089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98bc38-f376-40a3-9103-5d7d149dafda admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:27.707089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98bc38-f376-40a3-9103-5d7d149dafda admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:27.707089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98bc38-f376-40a3-9103-5d7d149dafda admin admin] PATH_INFO: `/v3/users/d444ca2302d24b22bbb680696fbf4b28` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:27.707515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98bc38-f376-40a3-9103-5d7d149dafda admin admin] RBAC: Authorizing `identity:delete_user(user_id=d444ca2302d24b22bbb680696fbf4b28)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:27.709790 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98bc38-f376-40a3-9103-5d7d149dafda admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:27.712003 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 948/1906] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:27 2022] DELETE /identity/v3/users/7368aea3f037465eae844cd858071b23 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:27.965648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-cf98bc38-f376-40a3-9103-5d7d149dafda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd444ca2302d24b22bbb680696fbf4b28'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:27.987427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9ac0d-753e-44d3-955f-884f6c661592 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:27.990003 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-b6b9ac0d-753e-44d3-955f-884f6c661592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:28.067779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-cf98bc38-f376-40a3-9103-5d7d149dafda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd444ca2302d24b22bbb680696fbf4b28'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:28.088534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-cf98bc38-f376-40a3-9103-5d7d149dafda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd444ca2302d24b22bbb680696fbf4b28'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:28.089863 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-cf98bc38-f376-40a3-9103-5d7d149dafda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd444ca2302d24b22bbb680696fbf4b28'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:28.099942 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-cf98bc38-f376-40a3-9103-5d7d149dafda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd444ca2302d24b22bbb680696fbf4b28'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:28.109290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 959/1907] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:27 2022] DELETE /identity/v3/users/d444ca2302d24b22bbb680696fbf4b28 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:28.115325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c3ffd-5ef7-4faa-bff2-e791139f0595 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:28.116520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c3ffd-5ef7-4faa-bff2-e791139f0595 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:28.116861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c3ffd-5ef7-4faa-bff2-e791139f0595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:28.129851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9ac0d-753e-44d3-955f-884f6c661592 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:28.158914 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:28.166275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-c97c3ffd-5ef7-4faa-bff2-e791139f0595 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:28.174405 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c97c3ffd-5ef7-4faa-bff2-e791139f0595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:28.199915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe79501-ddc9-4350-a08a-8241f404d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:28.200666 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe79501-ddc9-4350-a08a-8241f404d745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:28.201095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe79501-ddc9-4350-a08a-8241f404d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:28.202263 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe79501-ddc9-4350-a08a-8241f404d745 admin admin] PATH_INFO: `/v3/projects/e0e280023ab344cba0d629e366560477` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:28.203640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe79501-ddc9-4350-a08a-8241f404d745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e280023ab344cba0d629e366560477)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:28.205931 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe79501-ddc9-4350-a08a-8241f404d745 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:28.262684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 960/1908] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:28.295846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c3ffd-5ef7-4faa-bff2-e791139f0595 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:28.295846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c97c3ffd-5ef7-4faa-bff2-e791139f0595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:28.321127 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2fe79501-ddc9-4350-a08a-8241f404d745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e280023ab344cba0d629e366560477', 'request_id': 'req-2fe79501-ddc9-4350-a08a-8241f404d745'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:28.374237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c3ffd-5ef7-4faa-bff2-e791139f0595 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:28.407813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2fe79501-ddc9-4350-a08a-8241f404d745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e280023ab344cba0d629e366560477', 'request_id': 'req-2fe79501-ddc9-4350-a08a-8241f404d745'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:28.414596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2fe79501-ddc9-4350-a08a-8241f404d745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e280023ab344cba0d629e366560477', 'request_id': 'req-2fe79501-ddc9-4350-a08a-8241f404d745'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:28.425471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2fe79501-ddc9-4350-a08a-8241f404d745 admin admin] The token cache is being invalidate because project e0e280023ab344cba0d629e366560477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:28.425760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2fe79501-ddc9-4350-a08a-8241f404d745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:28.426278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf4b7b-b591-42fc-aaad-0871358bc0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:28.426423 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2fe79501-ddc9-4350-a08a-8241f404d745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:28.426933 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf4b7b-b591-42fc-aaad-0871358bc0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:28.427216 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf4b7b-b591-42fc-aaad-0871358bc0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:28.427524 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf4b7b-b591-42fc-aaad-0871358bc0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:28.428025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 949/1909] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:27 2022] DELETE /identity/v3/projects/e0e280023ab344cba0d629e366560477 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:28.432555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8ecf4b7b-b591-42fc-aaad-0871358bc0a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:28.432729 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341fbee-40ea-4dc1-9ccf-31bd71eb4af0 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:28.433023 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341fbee-40ea-4dc1-9ccf-31bd71eb4af0 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:28.433308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341fbee-40ea-4dc1-9ccf-31bd71eb4af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:28.453989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-5341fbee-40ea-4dc1-9ccf-31bd71eb4af0 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:28.455257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5341fbee-40ea-4dc1-9ccf-31bd71eb4af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:28.471687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:28.504243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf4b7b-b591-42fc-aaad-0871358bc0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:28.504243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf4b7b-b591-42fc-aaad-0871358bc0a9 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:28.520319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 961/1910] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:28.521199 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf4b7b-b591-42fc-aaad-0871358bc0a9 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:28.522478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8ecf4b7b-b591-42fc-aaad-0871358bc0a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:28.536943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf4b7b-b591-42fc-aaad-0871358bc0a9 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:28.547989 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:28.549308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:28.549694 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:28.550127 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] PATH_INFO: `/v3/projects/ac4fdcb5c89a48a1a36ac8ad6d24c878` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:28.551631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4fdcb5c89a48a1a36ac8ad6d24c878)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:28.553897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:28.573278 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 950/1911] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:28.574747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcf402-0a10-4817-ad0a-58bde30ebd31 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:28.575037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcf402-0a10-4817-ad0a-58bde30ebd31 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:28.575309 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcf402-0a10-4817-ad0a-58bde30ebd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:28.596953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-ccfcf402-0a10-4817-ad0a-58bde30ebd31 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:28.598155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ccfcf402-0a10-4817-ad0a-58bde30ebd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:28.606301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 951/1912] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:28.610526 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcf402-0a10-4817-ad0a-58bde30ebd31 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:28.619684 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcf402-0a10-4817-ad0a-58bde30ebd31 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:28.624988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb8de1-9c47-4ead-ad84-435b2fd9c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:28.625732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb8de1-9c47-4ead-ad84-435b2fd9c98a admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:28.626020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb8de1-9c47-4ead-ad84-435b2fd9c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:28.626297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb8de1-9c47-4ead-ad84-435b2fd9c98a admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:28.627460 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb8de1-9c47-4ead-ad84-435b2fd9c98a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:28.627460 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb8de1-9c47-4ead-ad84-435b2fd9c98a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:28.635953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb8de1-9c47-4ead-ad84-435b2fd9c98a admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:28.647071 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 952/1913] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:57:28.648525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb8de1-9c47-4ead-ad84-435b2fd9c98a admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:28.663687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb8de1-9c47-4ead-ad84-435b2fd9c98a admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:28.682171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4fdcb5c89a48a1a36ac8ad6d24c878', 'request_id': 'req-037a01ba-4df4-4bb8-bb72-25252aad9d9c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:28.725443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a6fab-354b-4c77-beec-4be44398b502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:28.726132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a6fab-354b-4c77-beec-4be44398b502 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:28.726415 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a6fab-354b-4c77-beec-4be44398b502 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:28.726690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a6fab-354b-4c77-beec-4be44398b502 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:28.727377 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a6fab-354b-4c77-beec-4be44398b502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:28.729316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a6fab-354b-4c77-beec-4be44398b502 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:28.784970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4fdcb5c89a48a1a36ac8ad6d24c878', 'request_id': 'req-037a01ba-4df4-4bb8-bb72-25252aad9d9c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:28.792564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4fdcb5c89a48a1a36ac8ad6d24c878', 'request_id': 'req-037a01ba-4df4-4bb8-bb72-25252aad9d9c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:28.804036 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] The token cache is being invalidate because project ac4fdcb5c89a48a1a36ac8ad6d24c878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:28.804329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:28.805048 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:28.806906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 962/1914] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:28 2022] DELETE /identity/v3/projects/ac4fdcb5c89a48a1a36ac8ad6d24c878 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:28.811262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:28.812732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:28.825724 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a01ba-4df4-4bb8-bb72-25252aad9d9c admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:28.831126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ec940-c351-476f-a62a-7c18a5218693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:28.832077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ec940-c351-476f-a62a-7c18a5218693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:28.832360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ec940-c351-476f-a62a-7c18a5218693 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:28.832658 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ec940-c351-476f-a62a-7c18a5218693 admin admin] PATH_INFO: `/v3/users/76eb1d8d307d46d99831094765abdeaf` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:28.833895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ec940-c351-476f-a62a-7c18a5218693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76eb1d8d307d46d99831094765abdeaf)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:28.835886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ec940-c351-476f-a62a-7c18a5218693 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:28.863321 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 953/1915] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:28 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:28.867384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a6fab-354b-4c77-beec-4be44398b502 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:28.869249 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-bf9a6fab-354b-4c77-beec-4be44398b502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:28.944245 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a6fab-354b-4c77-beec-4be44398b502 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:28.949622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf73d0-5790-4d59-8090-3c9e6591ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:28.950319 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf73d0-5790-4d59-8090-3c9e6591ebdf admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:28.950604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf73d0-5790-4d59-8090-3c9e6591ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:28.950985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf73d0-5790-4d59-8090-3c9e6591ebdf admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:28.951732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf73d0-5790-4d59-8090-3c9e6591ebdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:28.953855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf73d0-5790-4d59-8090-3c9e6591ebdf admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:29.051328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-468ec940-c351-476f-a62a-7c18a5218693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76eb1d8d307d46d99831094765abdeaf'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:29.087740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 954/1916] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:28 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:29.091761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf73d0-5790-4d59-8090-3c9e6591ebdf admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:29.108764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf73d0-5790-4d59-8090-3c9e6591ebdf admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:29.114962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52db9c5-8f7f-4077-b520-36e7bea74ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:29.115782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52db9c5-8f7f-4077-b520-36e7bea74ffa admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:29.116170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52db9c5-8f7f-4077-b520-36e7bea74ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:29.116548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52db9c5-8f7f-4077-b520-36e7bea74ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:29.118060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52db9c5-8f7f-4077-b520-36e7bea74ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:29.119229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52db9c5-8f7f-4077-b520-36e7bea74ffa admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:29.132989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 955/1917] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:29.137127 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52db9c5-8f7f-4077-b520-36e7bea74ffa admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:29.147836 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52db9c5-8f7f-4077-b520-36e7bea74ffa admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:29.149986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-468ec940-c351-476f-a62a-7c18a5218693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76eb1d8d307d46d99831094765abdeaf'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:29.153130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42512e95-42df-4351-8709-144debb4ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:29.153912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42512e95-42df-4351-8709-144debb4ba10 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:29.154257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42512e95-42df-4351-8709-144debb4ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:29.154596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42512e95-42df-4351-8709-144debb4ba10 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:29.156594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42512e95-42df-4351-8709-144debb4ba10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:29.157185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42512e95-42df-4351-8709-144debb4ba10 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:29.163845 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-468ec940-c351-476f-a62a-7c18a5218693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76eb1d8d307d46d99831094765abdeaf'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:29.164671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-468ec940-c351-476f-a62a-7c18a5218693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76eb1d8d307d46d99831094765abdeaf'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:29.171634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 956/1918] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:29.172416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-468ec940-c351-476f-a62a-7c18a5218693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76eb1d8d307d46d99831094765abdeaf'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:29.173294 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42512e95-42df-4351-8709-144debb4ba10 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:29.174967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-42512e95-42df-4351-8709-144debb4ba10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:29.178645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 963/1919] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:28 2022] DELETE /identity/v3/users/76eb1d8d307d46d99831094765abdeaf => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:29.189114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42512e95-42df-4351-8709-144debb4ba10 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:29.217594 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ec940-c351-476f-a62a-7c18a5218693 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:29.220152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-468ec940-c351-476f-a62a-7c18a5218693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:29.277816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5690662-9e17-4018-9f55-cf6d8fca10d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:29.279081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5690662-9e17-4018-9f55-cf6d8fca10d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:29.282131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5690662-9e17-4018-9f55-cf6d8fca10d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:29.282476 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5690662-9e17-4018-9f55-cf6d8fca10d7 admin admin] PATH_INFO: `/v3/projects/f3aed740fe4b45e6b22a5e94d31d3164/users/deaa4b41deda4b1d951765fd10ecf2a7/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:29.305257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5690662-9e17-4018-9f55-cf6d8fca10d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3aed740fe4b45e6b22a5e94d31d3164, user_id=deaa4b41deda4b1d951765fd10ecf2a7, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:29.309567 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5690662-9e17-4018-9f55-cf6d8fca10d7 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:29.317925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ec940-c351-476f-a62a-7c18a5218693 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:29.323027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:29.327601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:29.327601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:29.327601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] PATH_INFO: `/v3/projects/bc8eca9e7d0647c59bfbf9a2e5e1bc7f` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:29.327601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc8eca9e7d0647c59bfbf9a2e5e1bc7f)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:29.328130 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:29.450091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 957/1920] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:29 2022] PUT /identity/v3/projects/f3aed740fe4b45e6b22a5e94d31d3164/users/deaa4b41deda4b1d951765fd10ecf2a7/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:29.463232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eefd1b-477e-4fec-8964-eed5f108b85d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:29.463598 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eefd1b-477e-4fec-8964-eed5f108b85d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:29.464036 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eefd1b-477e-4fec-8964-eed5f108b85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:29.488662 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc8eca9e7d0647c59bfbf9a2e5e1bc7f', 'request_id': 'req-d51f37b5-0d84-4a30-9cc4-1a3324a85880'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:29.496745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-77eefd1b-477e-4fec-8964-eed5f108b85d None None] MFA Rules not processed for user `deaa4b41deda4b1d951765fd10ecf2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:29.498118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-77eefd1b-477e-4fec-8964-eed5f108b85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:29.577077 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 958/1921] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:29.590340 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eefd1b-477e-4fec-8964-eed5f108b85d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:29.592668 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-77eefd1b-477e-4fec-8964-eed5f108b85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:29.610511 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:29.641692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc8eca9e7d0647c59bfbf9a2e5e1bc7f', 'request_id': 'req-d51f37b5-0d84-4a30-9cc4-1a3324a85880'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:29.657502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc8eca9e7d0647c59bfbf9a2e5e1bc7f', 'request_id': 'req-d51f37b5-0d84-4a30-9cc4-1a3324a85880'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:29.666564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eefd1b-477e-4fec-8964-eed5f108b85d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:29.671620 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1eaf4e-c00a-4975-a482-2d7650d7df4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:29.672036 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eaf4e-c00a-4975-a482-2d7650d7df4f service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:29.672323 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eaf4e-c00a-4975-a482-2d7650d7df4f service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:29.672994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eaf4e-c00a-4975-a482-2d7650d7df4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:29.683149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] The token cache is being invalidate because project bc8eca9e7d0647c59bfbf9a2e5e1bc7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:29.683426 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:29.685958 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:29.687969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 964/1922] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:29 2022] DELETE /identity/v3/projects/bc8eca9e7d0647c59bfbf9a2e5e1bc7f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:29.691180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1eaf4e-c00a-4975-a482-2d7650d7df4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:29.694027 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1eaf4e-c00a-4975-a482-2d7650d7df4f service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:29.702852 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:29.703160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 959/1923] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:29.705369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:29.772092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f37b5-0d84-4a30-9cc4-1a3324a85880 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:29.777022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12eb72-cf22-4281-8de3-428363e0ac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:29.777920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12eb72-cf22-4281-8de3-428363e0ac5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:29.778205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12eb72-cf22-4281-8de3-428363e0ac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:29.778489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12eb72-cf22-4281-8de3-428363e0ac5a admin admin] PATH_INFO: `/v3/users/284e21493c4f4c7fa8c1ef916e0acd51` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:29.780457 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12eb72-cf22-4281-8de3-428363e0ac5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=284e21493c4f4c7fa8c1ef916e0acd51)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:29.782392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12eb72-cf22-4281-8de3-428363e0ac5a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:29.837272 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1eaf4e-c00a-4975-a482-2d7650d7df4f service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:29.838747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ed1eaf4e-c00a-4975-a482-2d7650d7df4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:29.855025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1eaf4e-c00a-4975-a482-2d7650d7df4f service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:29.859883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:29.860877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:29.861234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:29.861518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] PATH_INFO: `/v3/projects/4a7dd873cd1348a9b3e554634d9da962` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:29.862763 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a7dd873cd1348a9b3e554634d9da962)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:29.864737 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:29.965462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:30.029902 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a7dd873cd1348a9b3e554634d9da962', 'request_id': 'req-657584c1-09a6-4953-b898-242bf5101b27'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.030138 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0a12eb72-cf22-4281-8de3-428363e0ac5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284e21493c4f4c7fa8c1ef916e0acd51'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.118442 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a7dd873cd1348a9b3e554634d9da962', 'request_id': 'req-657584c1-09a6-4953-b898-242bf5101b27'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.125380 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a7dd873cd1348a9b3e554634d9da962', 'request_id': 'req-657584c1-09a6-4953-b898-242bf5101b27'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.136248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] The token cache is being invalidate because project 4a7dd873cd1348a9b3e554634d9da962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:30.136547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.137207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.138741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 960/1924] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:29 2022] DELETE /identity/v3/projects/4a7dd873cd1348a9b3e554634d9da962 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:30.140193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:30.141614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:30.204308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0a12eb72-cf22-4281-8de3-428363e0ac5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284e21493c4f4c7fa8c1ef916e0acd51'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.224135 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657584c1-09a6-4953-b898-242bf5101b27 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:30.224756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0a12eb72-cf22-4281-8de3-428363e0ac5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284e21493c4f4c7fa8c1ef916e0acd51'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.225560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0a12eb72-cf22-4281-8de3-428363e0ac5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284e21493c4f4c7fa8c1ef916e0acd51'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.229410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac880ba-a96e-4c86-883b-8a27e466125a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:30.230361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac880ba-a96e-4c86-883b-8a27e466125a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:30.231374 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac880ba-a96e-4c86-883b-8a27e466125a admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:30.231374 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac880ba-a96e-4c86-883b-8a27e466125a admin admin] PATH_INFO: `/v3/users/b3ff4e6802784451b509db52219c1063` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:30.233228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac880ba-a96e-4c86-883b-8a27e466125a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ff4e6802784451b509db52219c1063)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:30.233721 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0a12eb72-cf22-4281-8de3-428363e0ac5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284e21493c4f4c7fa8c1ef916e0acd51'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.235375 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac880ba-a96e-4c86-883b-8a27e466125a admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:30.240107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 965/1925] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:29 2022] DELETE /identity/v3/users/284e21493c4f4c7fa8c1ef916e0acd51 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:30.241861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf022d-d028-4599-abfb-be2294433592 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:30.241861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf022d-d028-4599-abfb-be2294433592 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:30.241861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf022d-d028-4599-abfb-be2294433592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:30.261117 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-72bf022d-d028-4599-abfb-be2294433592 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:30.262831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-72bf022d-d028-4599-abfb-be2294433592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:30.329455 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 966/1926] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:30.337525 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791243a-271e-4c8f-909b-a15491c99612 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:30.337745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791243a-271e-4c8f-909b-a15491c99612 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:30.338016 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791243a-271e-4c8f-909b-a15491c99612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:30.356446 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-2791243a-271e-4c8f-909b-a15491c99612 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:30.358222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2791243a-271e-4c8f-909b-a15491c99612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:30.366094 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 967/1927] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:30.370108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791243a-271e-4c8f-909b-a15491c99612 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:30.379161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791243a-271e-4c8f-909b-a15491c99612 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:30.384030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a74e84-578c-4242-9902-a24284020946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:30.384678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a74e84-578c-4242-9902-a24284020946 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:30.384962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a74e84-578c-4242-9902-a24284020946 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:30.385237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a74e84-578c-4242-9902-a24284020946 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:30.385957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a74e84-578c-4242-9902-a24284020946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:30.386264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a74e84-578c-4242-9902-a24284020946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:30.387924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a74e84-578c-4242-9902-a24284020946 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:30.399374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 968/1928] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:57:30.403444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a74e84-578c-4242-9902-a24284020946 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:30.414169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a74e84-578c-4242-9902-a24284020946 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:30.419061 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d4f04-cb1d-46ff-abda-2880d2561082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:30.419731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d4f04-cb1d-46ff-abda-2880d2561082 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:30.420643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d4f04-cb1d-46ff-abda-2880d2561082 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:30.420954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d4f04-cb1d-46ff-abda-2880d2561082 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:30.421624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d4f04-cb1d-46ff-abda-2880d2561082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:30.423567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d4f04-cb1d-46ff-abda-2880d2561082 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:30.551717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-aac880ba-a96e-4c86-883b-8a27e466125a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ff4e6802784451b509db52219c1063'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.566225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-aac880ba-a96e-4c86-883b-8a27e466125a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ff4e6802784451b509db52219c1063'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.573333 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-aac880ba-a96e-4c86-883b-8a27e466125a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ff4e6802784451b509db52219c1063'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.574066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-aac880ba-a96e-4c86-883b-8a27e466125a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ff4e6802784451b509db52219c1063'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.620433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 969/1929] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:30 2022] POST /identity/v3/projects => generated 393 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:30.621460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d4f04-cb1d-46ff-abda-2880d2561082 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:30.623220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8c4d4f04-cb1d-46ff-abda-2880d2561082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:30.690343 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d4f04-cb1d-46ff-abda-2880d2561082 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:30.694799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412b9c2-224d-4ad3-a13f-1188b07287af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:30.695501 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412b9c2-224d-4ad3-a13f-1188b07287af admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:30.695796 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412b9c2-224d-4ad3-a13f-1188b07287af admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:30.696152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412b9c2-224d-4ad3-a13f-1188b07287af admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:30.696756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412b9c2-224d-4ad3-a13f-1188b07287af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:30.698448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-aac880ba-a96e-4c86-883b-8a27e466125a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ff4e6802784451b509db52219c1063'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.698697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412b9c2-224d-4ad3-a13f-1188b07287af admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:30.709342 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 961/1930] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:30 2022] DELETE /identity/v3/users/b3ff4e6802784451b509db52219c1063 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:30.710950 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89e33c-b22d-4201-993c-028f08aa2891 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:30.711315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89e33c-b22d-4201-993c-028f08aa2891 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:30.711727 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89e33c-b22d-4201-993c-028f08aa2891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:30.734446 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-3d89e33c-b22d-4201-993c-028f08aa2891 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:30.735785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3d89e33c-b22d-4201-993c-028f08aa2891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:30.800323 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 962/1931] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:30.801403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89e33c-b22d-4201-993c-028f08aa2891 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:30.807759 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3d89e33c-b22d-4201-993c-028f08aa2891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:30.819853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 970/1932] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:30 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:30.819853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412b9c2-224d-4ad3-a13f-1188b07287af admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:30.821784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c412b9c2-224d-4ad3-a13f-1188b07287af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:30.827708 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89e33c-b22d-4201-993c-028f08aa2891 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:30.837051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:30.838063 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:30.838564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:30.838717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] PATH_INFO: `/v3/projects/851add985b8341658f33a488303d892e` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:30.840079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=851add985b8341658f33a488303d892e)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:30.842114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:30.888163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412b9c2-224d-4ad3-a13f-1188b07287af admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:30.938665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad247b-c460-422c-bb71-02cf57da31a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:30.939651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad247b-c460-422c-bb71-02cf57da31a1 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:30.939941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad247b-c460-422c-bb71-02cf57da31a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:30.947819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad247b-c460-422c-bb71-02cf57da31a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:30.949737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad247b-c460-422c-bb71-02cf57da31a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:30.951233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad247b-c460-422c-bb71-02cf57da31a1 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:30.960762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 971/1933] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:30.961539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad247b-c460-422c-bb71-02cf57da31a1 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:30.971341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad247b-c460-422c-bb71-02cf57da31a1 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:30.976780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf16e61-ad85-45f2-ad99-7cbae3db715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:30.977725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf16e61-ad85-45f2-ad99-7cbae3db715f admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:30.978021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf16e61-ad85-45f2-ad99-7cbae3db715f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:30.978301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf16e61-ad85-45f2-ad99-7cbae3db715f admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:30.979025 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf16e61-ad85-45f2-ad99-7cbae3db715f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:30.980688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf16e61-ad85-45f2-ad99-7cbae3db715f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:30.988759 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '851add985b8341658f33a488303d892e', 'request_id': 'req-c0dcf5bf-1838-425f-a4e1-e3b67593e077'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:30.994416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 972/1934] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:30.995465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf16e61-ad85-45f2-ad99-7cbae3db715f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:31.005125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf16e61-ad85-45f2-ad99-7cbae3db715f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:31.062772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038f804-ee6e-4168-93db-4cee07ee17ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:31.063468 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038f804-ee6e-4168-93db-4cee07ee17ff admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:31.063763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038f804-ee6e-4168-93db-4cee07ee17ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:31.064063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038f804-ee6e-4168-93db-4cee07ee17ff admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:31.064790 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038f804-ee6e-4168-93db-4cee07ee17ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:31.066393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038f804-ee6e-4168-93db-4cee07ee17ff admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:31.076132 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 973/1935] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:31.078213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '851add985b8341658f33a488303d892e', 'request_id': 'req-c0dcf5bf-1838-425f-a4e1-e3b67593e077'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:31.080186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038f804-ee6e-4168-93db-4cee07ee17ff admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:31.085188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '851add985b8341658f33a488303d892e', 'request_id': 'req-c0dcf5bf-1838-425f-a4e1-e3b67593e077'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:31.090162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038f804-ee6e-4168-93db-4cee07ee17ff admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:31.095867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ebc7a-6db6-45d2-aa20-bbeec701ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:31.096727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ebc7a-6db6-45d2-aa20-bbeec701ec56 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:31.097013 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ebc7a-6db6-45d2-aa20-bbeec701ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:31.097296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ebc7a-6db6-45d2-aa20-bbeec701ec56 admin admin] PATH_INFO: `/v3/projects/54ff1f8855f54b58888320b605e9ca67/users/bd12e3001ed646c1a24e2a14d93a45e6/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:31.097818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] The token cache is being invalidate because project 851add985b8341658f33a488303d892e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:31.098113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:31.098999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:31.100580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 963/1936] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:30 2022] DELETE /identity/v3/projects/851add985b8341658f33a488303d892e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:31.104655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:31.109874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:31.118213 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ebc7a-6db6-45d2-aa20-bbeec701ec56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ff1f8855f54b58888320b605e9ca67, user_id=bd12e3001ed646c1a24e2a14d93a45e6, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:31.121524 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ebc7a-6db6-45d2-aa20-bbeec701ec56 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:31.124629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcf5bf-1838-425f-a4e1-e3b67593e077 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:31.130074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e110c-d111-4f69-8642-69aadc1a3762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:31.131238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e110c-d111-4f69-8642-69aadc1a3762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:31.131548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e110c-d111-4f69-8642-69aadc1a3762 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:31.131831 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e110c-d111-4f69-8642-69aadc1a3762 admin admin] PATH_INFO: `/v3/users/824bee04d4a94f4d9317eca6552a3564` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:31.133044 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e110c-d111-4f69-8642-69aadc1a3762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=824bee04d4a94f4d9317eca6552a3564)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:31.134963 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e110c-d111-4f69-8642-69aadc1a3762 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:31.224495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 974/1937] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:31 2022] PUT /identity/v3/projects/54ff1f8855f54b58888320b605e9ca67/users/bd12e3001ed646c1a24e2a14d93a45e6/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:31.247331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e88f5-52fc-4de3-a932-87383eb94c5b None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:31.247714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e88f5-52fc-4de3-a932-87383eb94c5b None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:31.248191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e88f5-52fc-4de3-a932-87383eb94c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:31.296429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-5c6e88f5-52fc-4de3-a932-87383eb94c5b None None] MFA Rules not processed for user `bd12e3001ed646c1a24e2a14d93a45e6`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:31.297637 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-5c6e88f5-52fc-4de3-a932-87383eb94c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:31.383657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 975/1938] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:31.383917 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bc2e110c-d111-4f69-8642-69aadc1a3762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '824bee04d4a94f4d9317eca6552a3564'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:31.388096 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e88f5-52fc-4de3-a932-87383eb94c5b None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:31.390189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-5c6e88f5-52fc-4de3-a932-87383eb94c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:31.398656 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bc2e110c-d111-4f69-8642-69aadc1a3762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '824bee04d4a94f4d9317eca6552a3564'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:31.407068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bc2e110c-d111-4f69-8642-69aadc1a3762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '824bee04d4a94f4d9317eca6552a3564'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:31.407866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bc2e110c-d111-4f69-8642-69aadc1a3762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '824bee04d4a94f4d9317eca6552a3564'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:31.467563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e88f5-52fc-4de3-a932-87383eb94c5b None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:31.467563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38d1b-e977-4ab2-ab0c-9c3a08e1df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:31.467563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38d1b-e977-4ab2-ab0c-9c3a08e1df27 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:31.467563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38d1b-e977-4ab2-ab0c-9c3a08e1df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:31.467953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38d1b-e977-4ab2-ab0c-9c3a08e1df27 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:31.467953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38d1b-e977-4ab2-ab0c-9c3a08e1df27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:31.467953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38d1b-e977-4ab2-ab0c-9c3a08e1df27 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:31.523799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bc2e110c-d111-4f69-8642-69aadc1a3762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '824bee04d4a94f4d9317eca6552a3564'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:31.531108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 964/1939] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:31 2022] DELETE /identity/v3/users/824bee04d4a94f4d9317eca6552a3564 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:31.534898 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e110c-d111-4f69-8642-69aadc1a3762 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:31.536285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-bc2e110c-d111-4f69-8642-69aadc1a3762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:31.561783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 976/1940] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:31 2022] POST /identity/v3/projects => generated 391 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:31.565964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38d1b-e977-4ab2-ab0c-9c3a08e1df27 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:31.567500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-70d38d1b-e977-4ab2-ab0c-9c3a08e1df27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:31.617178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e110c-d111-4f69-8642-69aadc1a3762 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:31.646436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38d1b-e977-4ab2-ab0c-9c3a08e1df27 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:31.651772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78367b49-5cb6-42f1-8357-5232b2cc2f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:31.652657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367b49-5cb6-42f1-8357-5232b2cc2f4a admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:31.652993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367b49-5cb6-42f1-8357-5232b2cc2f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:31.653271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367b49-5cb6-42f1-8357-5232b2cc2f4a admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:31.653957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78367b49-5cb6-42f1-8357-5232b2cc2f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:31.656041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78367b49-5cb6-42f1-8357-5232b2cc2f4a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:31.684655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:31.686061 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:31.686370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:31.686649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] PATH_INFO: `/v3/projects/3931dc8d71514c2aa1f2d74f65ed6fbb` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:31.687895 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3931dc8d71514c2aa1f2d74f65ed6fbb)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:31.689863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:31.739395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 977/1941] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:31 2022] POST /identity/v3/users => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:31.743713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78367b49-5cb6-42f1-8357-5232b2cc2f4a admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:31.745395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-78367b49-5cb6-42f1-8357-5232b2cc2f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:31.758542 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78367b49-5cb6-42f1-8357-5232b2cc2f4a admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:31.764147 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6afd04-5571-4426-ace1-cd24a9308913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:31.765095 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6afd04-5571-4426-ace1-cd24a9308913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:31.765388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6afd04-5571-4426-ace1-cd24a9308913 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:31.765689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6afd04-5571-4426-ace1-cd24a9308913 admin admin] PATH_INFO: `/v3/users/d3b40e517a9b43d897ddf6496bdbe448` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:31.767050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6afd04-5571-4426-ace1-cd24a9308913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b40e517a9b43d897ddf6496bdbe448)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:31.778821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6afd04-5571-4426-ace1-cd24a9308913 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:31.853420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3931dc8d71514c2aa1f2d74f65ed6fbb', 'request_id': 'req-425c74d2-eb89-4fd8-9681-8a92439891a2'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:31.960124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:31.971198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3931dc8d71514c2aa1f2d74f65ed6fbb', 'request_id': 'req-425c74d2-eb89-4fd8-9681-8a92439891a2'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:31.979681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3931dc8d71514c2aa1f2d74f65ed6fbb', 'request_id': 'req-425c74d2-eb89-4fd8-9681-8a92439891a2'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:31.992006 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] The token cache is being invalidate because project 3931dc8d71514c2aa1f2d74f65ed6fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:31.992306 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:31.992985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:31.995894 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 965/1942] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:31 2022] DELETE /identity/v3/projects/3931dc8d71514c2aa1f2d74f65ed6fbb => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:31.996661 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:31.998676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:32.066035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c74d2-eb89-4fd8-9681-8a92439891a2 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:32.072005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019be5d-b992-4dfd-a691-7923a81c4f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:32.072691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019be5d-b992-4dfd-a691-7923a81c4f5c admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:32.072978 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019be5d-b992-4dfd-a691-7923a81c4f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:32.073832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019be5d-b992-4dfd-a691-7923a81c4f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:32.074037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019be5d-b992-4dfd-a691-7923a81c4f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:32.075735 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019be5d-b992-4dfd-a691-7923a81c4f5c admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:32.087365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 966/1943] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:32.087365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019be5d-b992-4dfd-a691-7923a81c4f5c admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:32.087365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2019be5d-b992-4dfd-a691-7923a81c4f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:32.091755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-4a6afd04-5571-4426-ace1-cd24a9308913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b40e517a9b43d897ddf6496bdbe448'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.103389 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019be5d-b992-4dfd-a691-7923a81c4f5c admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:32.108519 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:32.109458 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:32.109753 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:32.110031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] PATH_INFO: `/v3/projects/a852acc2631541ae9791a743046dda28` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:32.111216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a852acc2631541ae9791a743046dda28)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:32.113287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:32.189855 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-4a6afd04-5571-4426-ace1-cd24a9308913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b40e517a9b43d897ddf6496bdbe448'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.203678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-4a6afd04-5571-4426-ace1-cd24a9308913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b40e517a9b43d897ddf6496bdbe448'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.204698 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-4a6afd04-5571-4426-ace1-cd24a9308913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b40e517a9b43d897ddf6496bdbe448'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.211322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-4a6afd04-5571-4426-ace1-cd24a9308913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b40e517a9b43d897ddf6496bdbe448'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.217900 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 978/1944] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:31 2022] DELETE /identity/v3/users/d3b40e517a9b43d897ddf6496bdbe448 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:32.218774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6afd04-5571-4426-ace1-cd24a9308913 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:32.220479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4a6afd04-5571-4426-ace1-cd24a9308913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:32.240739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a852acc2631541ae9791a743046dda28', 'request_id': 'req-6e5c4441-1c92-4d63-8486-6ae5c73800cc'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.277301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:32.289879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6afd04-5571-4426-ace1-cd24a9308913 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:32.338215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a852acc2631541ae9791a743046dda28', 'request_id': 'req-6e5c4441-1c92-4d63-8486-6ae5c73800cc'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.345373 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a852acc2631541ae9791a743046dda28', 'request_id': 'req-6e5c4441-1c92-4d63-8486-6ae5c73800cc'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.346041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0351b33-87d4-499c-b62c-ca2df58ff434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:32.346929 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0351b33-87d4-499c-b62c-ca2df58ff434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:32.347220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0351b33-87d4-499c-b62c-ca2df58ff434 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:32.347524 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0351b33-87d4-499c-b62c-ca2df58ff434 admin admin] PATH_INFO: `/v3/users/10be2bae6437449a8352a42be836db5c` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:32.348742 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0351b33-87d4-499c-b62c-ca2df58ff434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10be2bae6437449a8352a42be836db5c)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:32.350724 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0351b33-87d4-499c-b62c-ca2df58ff434 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:32.356201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] The token cache is being invalidate because project a852acc2631541ae9791a743046dda28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:32.356612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.357298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.358859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 967/1945] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:32 2022] DELETE /identity/v3/projects/a852acc2631541ae9791a743046dda28 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:32.359672 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:32.364589 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:32.378917 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c4441-1c92-4d63-8486-6ae5c73800cc admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:32.383817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db3de3-d618-4ca9-a44f-894f02691f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:32.384685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db3de3-d618-4ca9-a44f-894f02691f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:32.384971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db3de3-d618-4ca9-a44f-894f02691f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:32.385248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db3de3-d618-4ca9-a44f-894f02691f80 admin admin] PATH_INFO: `/v3/projects/985490d7fc1f4a1680e43dbb1e95718e/users/1896eda172d14fbc97c850e5b802122e/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:32.400138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db3de3-d618-4ca9-a44f-894f02691f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985490d7fc1f4a1680e43dbb1e95718e, user_id=1896eda172d14fbc97c850e5b802122e, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:32.402802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db3de3-d618-4ca9-a44f-894f02691f80 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:32.550213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 968/1946] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:32 2022] PUT /identity/v3/projects/985490d7fc1f4a1680e43dbb1e95718e/users/1896eda172d14fbc97c850e5b802122e/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:32.551710 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3a2cb-ca27-4b70-89be-7191300555d7 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:32.552065 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3a2cb-ca27-4b70-89be-7191300555d7 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:32.552350 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3a2cb-ca27-4b70-89be-7191300555d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:32.570417 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-4ff3a2cb-ca27-4b70-89be-7191300555d7 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:32.571797 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4ff3a2cb-ca27-4b70-89be-7191300555d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:32.604227 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f0351b33-87d4-499c-b62c-ca2df58ff434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10be2bae6437449a8352a42be836db5c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.638145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 969/1947] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:32.640432 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e4dfb-c29e-4469-bc1d-319389bba21d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:32.640844 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e4dfb-c29e-4469-bc1d-319389bba21d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:32.641194 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e4dfb-c29e-4469-bc1d-319389bba21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:32.661003 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-966e4dfb-c29e-4469-bc1d-319389bba21d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:32.662208 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-966e4dfb-c29e-4469-bc1d-319389bba21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:32.671578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 970/1948] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:32.678429 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e4dfb-c29e-4469-bc1d-319389bba21d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:32.688722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e4dfb-c29e-4469-bc1d-319389bba21d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:32.693445 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c949e-6fa0-44e7-8a35-acb6dbabc0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:32.694107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c949e-6fa0-44e7-8a35-acb6dbabc0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:32.694391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c949e-6fa0-44e7-8a35-acb6dbabc0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:32.694667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c949e-6fa0-44e7-8a35-acb6dbabc0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:32.695395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c949e-6fa0-44e7-8a35-acb6dbabc0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:32.697060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c949e-6fa0-44e7-8a35-acb6dbabc0b3 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:32.707881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 971/1949] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:32.712635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f0351b33-87d4-499c-b62c-ca2df58ff434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10be2bae6437449a8352a42be836db5c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.712966 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c949e-6fa0-44e7-8a35-acb6dbabc0b3 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:32.714554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3c6c949e-6fa0-44e7-8a35-acb6dbabc0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:32.733518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f0351b33-87d4-499c-b62c-ca2df58ff434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10be2bae6437449a8352a42be836db5c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.733707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f0351b33-87d4-499c-b62c-ca2df58ff434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10be2bae6437449a8352a42be836db5c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.741629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f0351b33-87d4-499c-b62c-ca2df58ff434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10be2bae6437449a8352a42be836db5c'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:32.750212 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 979/1950] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:32 2022] DELETE /identity/v3/users/10be2bae6437449a8352a42be836db5c => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:32.751572 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac06fb-dcfd-496e-8323-445b6995d671 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:32.751867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac06fb-dcfd-496e-8323-445b6995d671 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:32.752190 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac06fb-dcfd-496e-8323-445b6995d671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:32.773182 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-a2ac06fb-dcfd-496e-8323-445b6995d671 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:32.774391 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a2ac06fb-dcfd-496e-8323-445b6995d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:32.777317 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c949e-6fa0-44e7-8a35-acb6dbabc0b3 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:32.838222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b85e42-615b-4e38-b626-264981b21613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:32.839667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b85e42-615b-4e38-b626-264981b21613 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:32.839667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b85e42-615b-4e38-b626-264981b21613 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:32.839667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b85e42-615b-4e38-b626-264981b21613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:32.841388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-33b85e42-615b-4e38-b626-264981b21613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:32.844322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 980/1951] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:32.848489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac06fb-dcfd-496e-8323-445b6995d671 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:32.850000 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a2ac06fb-dcfd-496e-8323-445b6995d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:32.854107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b85e42-615b-4e38-b626-264981b21613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:32.855593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b85e42-615b-4e38-b626-264981b21613 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:32.862446 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac06fb-dcfd-496e-8323-445b6995d671 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:32.865963 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 972/1952] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:32.866840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b85e42-615b-4e38-b626-264981b21613 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:32.868010 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18823a24-65e2-4f3d-b3f6-556daaa11a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:32.869002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18823a24-65e2-4f3d-b3f6-556daaa11a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:32.869398 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18823a24-65e2-4f3d-b3f6-556daaa11a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:32.869772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18823a24-65e2-4f3d-b3f6-556daaa11a68 admin admin] PATH_INFO: `/v3/projects/985490d7fc1f4a1680e43dbb1e95718e/users/1896eda172d14fbc97c850e5b802122e/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:32.872252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18823a24-65e2-4f3d-b3f6-556daaa11a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985490d7fc1f4a1680e43dbb1e95718e, user_id=1896eda172d14fbc97c850e5b802122e, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:32.875993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18823a24-65e2-4f3d-b3f6-556daaa11a68 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:32.876504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b85e42-615b-4e38-b626-264981b21613 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:32.881517 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadaebc-0c18-45a5-be9e-b3f43d27917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:32.882164 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadaebc-0c18-45a5-be9e-b3f43d27917e admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:32.882448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadaebc-0c18-45a5-be9e-b3f43d27917e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:32.882732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadaebc-0c18-45a5-be9e-b3f43d27917e admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:32.883443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadaebc-0c18-45a5-be9e-b3f43d27917e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:32.883778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadaebc-0c18-45a5-be9e-b3f43d27917e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:32.885356 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadaebc-0c18-45a5-be9e-b3f43d27917e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:32.888738 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 981/1953] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:32 2022] PUT /identity/v3/projects/985490d7fc1f4a1680e43dbb1e95718e/users/1896eda172d14fbc97c850e5b802122e/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:32.900701 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 973/1954] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:32.900882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f60e3-7a0a-470d-a42a-8f5e4fe2eef2 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:32.900882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f60e3-7a0a-470d-a42a-8f5e4fe2eef2 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:32.900882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f60e3-7a0a-470d-a42a-8f5e4fe2eef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:32.901689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadaebc-0c18-45a5-be9e-b3f43d27917e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:32.911726 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadaebc-0c18-45a5-be9e-b3f43d27917e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:32.930281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-a63f60e3-7a0a-470d-a42a-8f5e4fe2eef2 None None] MFA Rules not processed for user `1896eda172d14fbc97c850e5b802122e`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:32.931507 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a63f60e3-7a0a-470d-a42a-8f5e4fe2eef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:32.988874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fa245-9aa4-46dc-92d1-c83d84320557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:32.989687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fa245-9aa4-46dc-92d1-c83d84320557 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:32.989979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fa245-9aa4-46dc-92d1-c83d84320557 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:32.990257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fa245-9aa4-46dc-92d1-c83d84320557 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:32.991128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fa245-9aa4-46dc-92d1-c83d84320557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:32.993408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fa245-9aa4-46dc-92d1-c83d84320557 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:33.024572 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 982/1955] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:33.038441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f60e3-7a0a-470d-a42a-8f5e4fe2eef2 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:33.043608 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a63f60e3-7a0a-470d-a42a-8f5e4fe2eef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:33.129636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 974/1956] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:32 2022] POST /identity/v3/projects => generated 359 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:33.132845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fa245-9aa4-46dc-92d1-c83d84320557 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:33.185544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f60e3-7a0a-470d-a42a-8f5e4fe2eef2 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:33.230434 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fa245-9aa4-46dc-92d1-c83d84320557 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:33.236992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b5da8-d6f2-49de-b4a4-fb904af118cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:33.237693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b5da8-d6f2-49de-b4a4-fb904af118cb admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:33.238096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b5da8-d6f2-49de-b4a4-fb904af118cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:33.238397 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b5da8-d6f2-49de-b4a4-fb904af118cb admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:33.239099 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b5da8-d6f2-49de-b4a4-fb904af118cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:33.242254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b5da8-d6f2-49de-b4a4-fb904af118cb admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:33.253592 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85978847-d7c1-4713-9b54-701e73fd47f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:33.254718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85978847-d7c1-4713-9b54-701e73fd47f6 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:33.255217 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85978847-d7c1-4713-9b54-701e73fd47f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:33.256080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85978847-d7c1-4713-9b54-701e73fd47f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:33.346231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85978847-d7c1-4713-9b54-701e73fd47f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:33.348211 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85978847-d7c1-4713-9b54-701e73fd47f6 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:33.352741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 975/1957] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:33 2022] POST /identity/v3/users => generated 280 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:33.354172 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b5da8-d6f2-49de-b4a4-fb904af118cb admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:33.361477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7e5b5da8-d6f2-49de-b4a4-fb904af118cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:33.363631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 983/1958] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:33.364818 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85978847-d7c1-4713-9b54-701e73fd47f6 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:33.393088 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b5da8-d6f2-49de-b4a4-fb904af118cb admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:33.396215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85978847-d7c1-4713-9b54-701e73fd47f6 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:33.403830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b04a6-a004-4ecf-9d69-0fbb18baf480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:33.405177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b04a6-a004-4ecf-9d69-0fbb18baf480 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:33.405177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b04a6-a004-4ecf-9d69-0fbb18baf480 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:33.405177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b04a6-a004-4ecf-9d69-0fbb18baf480 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:33.406124 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b04a6-a004-4ecf-9d69-0fbb18baf480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:33.407932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b04a6-a004-4ecf-9d69-0fbb18baf480 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:33.423848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 984/1959] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:33.425665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b04a6-a004-4ecf-9d69-0fbb18baf480 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:33.432452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c93b04a6-a004-4ecf-9d69-0fbb18baf480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:33.439295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:33.440368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:33.441360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:33.441657 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] PATH_INFO: `/v3/projects/d6c43003e86a411aa872ffd4017ba34e` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:33.443917 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c43003e86a411aa872ffd4017ba34e)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:33.444858 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:33.452756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b04a6-a004-4ecf-9d69-0fbb18baf480 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:33.459370 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:33.460444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:33.460903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:33.461327 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] PATH_INFO: `/v3/projects/7455ce2663824098ad7d21e6c26d11fc` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:33.462555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:33.462704 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=7455ce2663824098ad7d21e6c26d11fc)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:33.464672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:33.576672 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c43003e86a411aa872ffd4017ba34e', 'request_id': 'req-6920ac9f-63f6-4f67-baa1-7f5de36413f3'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:33.618321 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7455ce2663824098ad7d21e6c26d11fc', 'request_id': 'req-71ed149a-358e-40ee-855e-58888a08d6df'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:33.721000 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c43003e86a411aa872ffd4017ba34e', 'request_id': 'req-6920ac9f-63f6-4f67-baa1-7f5de36413f3'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:33.727770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c43003e86a411aa872ffd4017ba34e', 'request_id': 'req-6920ac9f-63f6-4f67-baa1-7f5de36413f3'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:33.738296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] The token cache is being invalidate because project d6c43003e86a411aa872ffd4017ba34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:33.738586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:33.739267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:33.740894 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 976/1960] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:33 2022] DELETE /identity/v3/projects/d6c43003e86a411aa872ffd4017ba34e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:33.741663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:33.742965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:33.806807 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7455ce2663824098ad7d21e6c26d11fc', 'request_id': 'req-71ed149a-358e-40ee-855e-58888a08d6df'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:33.808286 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920ac9f-63f6-4f67-baa1-7f5de36413f3 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:33.814223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7455ce2663824098ad7d21e6c26d11fc', 'request_id': 'req-71ed149a-358e-40ee-855e-58888a08d6df'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:33.825211 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] The token cache is being invalidate because project 7455ce2663824098ad7d21e6c26d11fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:33.825382 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:33.826618 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:33.828282 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 985/1961] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:33 2022] DELETE /identity/v3/projects/7455ce2663824098ad7d21e6c26d11fc => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:33.829701 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:33.831344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:33.843995 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:33.871813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459f552-2442-4998-ac27-3bcde97eb402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:33.873547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459f552-2442-4998-ac27-3bcde97eb402 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:33.873547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459f552-2442-4998-ac27-3bcde97eb402 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:33.873722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459f552-2442-4998-ac27-3bcde97eb402 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:33.874410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459f552-2442-4998-ac27-3bcde97eb402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:33.876157 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459f552-2442-4998-ac27-3bcde97eb402 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:33.886230 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 977/1962] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:33.887717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5095a3-04b7-4ccc-84a6-4e6a3895d7fe None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:33.888320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5095a3-04b7-4ccc-84a6-4e6a3895d7fe None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:33.888476 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5095a3-04b7-4ccc-84a6-4e6a3895d7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:33.898413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed149a-358e-40ee-855e-58888a08d6df admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:33.902076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e7dd6-94cd-4e9f-a2e9-5b8e1d72bf28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:33.905439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e7dd6-94cd-4e9f-a2e9-5b8e1d72bf28 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:33.905439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e7dd6-94cd-4e9f-a2e9-5b8e1d72bf28 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:33.905439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e7dd6-94cd-4e9f-a2e9-5b8e1d72bf28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:33.905838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e92e7dd6-94cd-4e9f-a2e9-5b8e1d72bf28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:33.906547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-6a5095a3-04b7-4ccc-84a6-4e6a3895d7fe None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:33.907726 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6a5095a3-04b7-4ccc-84a6-4e6a3895d7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:33.915484 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 978/1963] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:33.916434 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5095a3-04b7-4ccc-84a6-4e6a3895d7fe None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:33.917646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6a5095a3-04b7-4ccc-84a6-4e6a3895d7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:33.929453 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5095a3-04b7-4ccc-84a6-4e6a3895d7fe None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:33.934068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a589d21-291e-450c-96ca-1bb82fed2eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:33.934925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a589d21-291e-450c-96ca-1bb82fed2eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:33.935226 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a589d21-291e-450c-96ca-1bb82fed2eff admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:33.935527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a589d21-291e-450c-96ca-1bb82fed2eff admin admin] PATH_INFO: `/v3/users/d7d268f180684e149fe2a270b4b8b89c` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:33.936719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a589d21-291e-450c-96ca-1bb82fed2eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d268f180684e149fe2a270b4b8b89c)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:33.938628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a589d21-291e-450c-96ca-1bb82fed2eff admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:33.968910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e7dd6-94cd-4e9f-a2e9-5b8e1d72bf28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:33.970357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e7dd6-94cd-4e9f-a2e9-5b8e1d72bf28 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:33.979169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 986/1964] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:33.979962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e7dd6-94cd-4e9f-a2e9-5b8e1d72bf28 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:33.981354 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e92e7dd6-94cd-4e9f-a2e9-5b8e1d72bf28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:33.995325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e7dd6-94cd-4e9f-a2e9-5b8e1d72bf28 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:33.999993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d21706-5b46-408e-afdd-77027ced5aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:34.001040 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21706-5b46-408e-afdd-77027ced5aef admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:34.004847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21706-5b46-408e-afdd-77027ced5aef admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:34.004847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21706-5b46-408e-afdd-77027ced5aef admin admin] PATH_INFO: `/v3/projects/5e5031d12d2f44a198d72529c342e2a8/users/6cd693278eee4ed3986d59094743b9ec/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:34.016648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d21706-5b46-408e-afdd-77027ced5aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5031d12d2f44a198d72529c342e2a8, user_id=6cd693278eee4ed3986d59094743b9ec, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:34.019285 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d21706-5b46-408e-afdd-77027ced5aef admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:34.113135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 987/1965] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:33 2022] PUT /identity/v3/projects/5e5031d12d2f44a198d72529c342e2a8/users/6cd693278eee4ed3986d59094743b9ec/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:34.114817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ce10-70f4-4232-b8fd-32bf31b12335 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:34.115178 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ce10-70f4-4232-b8fd-32bf31b12335 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:34.115504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ce10-70f4-4232-b8fd-32bf31b12335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:34.133384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-b750ce10-70f4-4232-b8fd-32bf31b12335 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:34.134585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b750ce10-70f4-4232-b8fd-32bf31b12335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:34.194021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 988/1966] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:34.195336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5e07e-7a4b-4342-8795-be69a268b221 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:34.195655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5e07e-7a4b-4342-8795-be69a268b221 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:34.196226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5e07e-7a4b-4342-8795-be69a268b221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:34.210099 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2a589d21-291e-450c-96ca-1bb82fed2eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d268f180684e149fe2a270b4b8b89c'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:34.229935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2a589d21-291e-450c-96ca-1bb82fed2eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d268f180684e149fe2a270b4b8b89c'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:34.230182 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-f8e5e07e-7a4b-4342-8795-be69a268b221 None None] MFA Rules not processed for user `6cd693278eee4ed3986d59094743b9ec`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:34.232311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f8e5e07e-7a4b-4342-8795-be69a268b221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:34.237421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2a589d21-291e-450c-96ca-1bb82fed2eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d268f180684e149fe2a270b4b8b89c'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:34.238013 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2a589d21-291e-450c-96ca-1bb82fed2eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d268f180684e149fe2a270b4b8b89c'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:34.313217 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 989/1967] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:34 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:34.313919 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5e07e-7a4b-4342-8795-be69a268b221 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:34.315214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f8e5e07e-7a4b-4342-8795-be69a268b221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:34.329526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5e07e-7a4b-4342-8795-be69a268b221 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:34.334534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5f86e-da5b-4234-b63d-c332f8011863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:34.335263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5f86e-da5b-4234-b63d-c332f8011863 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:34.335481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5f86e-da5b-4234-b63d-c332f8011863 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:34.335772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5f86e-da5b-4234-b63d-c332f8011863 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:34.336612 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5f86e-da5b-4234-b63d-c332f8011863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:34.337090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5f86e-da5b-4234-b63d-c332f8011863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:34.338673 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5f86e-da5b-4234-b63d-c332f8011863 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:34.347390 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2a589d21-291e-450c-96ca-1bb82fed2eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d268f180684e149fe2a270b4b8b89c'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:34.358987 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 979/1968] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:33 2022] DELETE /identity/v3/users/d7d268f180684e149fe2a270b4b8b89c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:34.363535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a589d21-291e-450c-96ca-1bb82fed2eff admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:34.365373 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2a589d21-291e-450c-96ca-1bb82fed2eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:34.371336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 990/1969] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:34.372422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5f86e-da5b-4234-b63d-c332f8011863 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:34.383571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5f86e-da5b-4234-b63d-c332f8011863 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:34.438255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a589d21-291e-450c-96ca-1bb82fed2eff admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:34.443413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13345427-f273-4c43-ae2b-e79e6d1db67d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:34.444197 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13345427-f273-4c43-ae2b-e79e6d1db67d service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:34.444491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13345427-f273-4c43-ae2b-e79e6d1db67d service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:34.444769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13345427-f273-4c43-ae2b-e79e6d1db67d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:34.461348 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aee42-473a-454d-8814-28cc4aaa1da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:34.462014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aee42-473a-454d-8814-28cc4aaa1da4 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:34.462437 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aee42-473a-454d-8814-28cc4aaa1da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:34.462677 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aee42-473a-454d-8814-28cc4aaa1da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:34.463371 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479aee42-473a-454d-8814-28cc4aaa1da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:34.465335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479aee42-473a-454d-8814-28cc4aaa1da4 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:34.519376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13345427-f273-4c43-ae2b-e79e6d1db67d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:34.520882 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13345427-f273-4c43-ae2b-e79e6d1db67d service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:34.530498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 980/1970] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:34 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:34.544355 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13345427-f273-4c43-ae2b-e79e6d1db67d service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:34.545890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-13345427-f273-4c43-ae2b-e79e6d1db67d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:34.559301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13345427-f273-4c43-ae2b-e79e6d1db67d service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:34.564415 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142bafe-c390-408c-9a2e-4dfe21df5ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:34.565283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142bafe-c390-408c-9a2e-4dfe21df5ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:34.565567 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142bafe-c390-408c-9a2e-4dfe21df5ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:34.565846 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142bafe-c390-408c-9a2e-4dfe21df5ab7 admin admin] PATH_INFO: `/v3/users/6cd693278eee4ed3986d59094743b9ec` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:34.567060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142bafe-c390-408c-9a2e-4dfe21df5ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd693278eee4ed3986d59094743b9ec)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:34.569176 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142bafe-c390-408c-9a2e-4dfe21df5ab7 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:34.643395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 991/1971] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:34 2022] POST /identity/v3/projects => generated 363 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:34.648029 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aee42-473a-454d-8814-28cc4aaa1da4 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:34.714162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aee42-473a-454d-8814-28cc4aaa1da4 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:34.719988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f2a88-f85a-4850-8d86-a1b26032a348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:34.720672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f2a88-f85a-4850-8d86-a1b26032a348 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:34.720960 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f2a88-f85a-4850-8d86-a1b26032a348 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:34.721365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f2a88-f85a-4850-8d86-a1b26032a348 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:34.722061 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f2a88-f85a-4850-8d86-a1b26032a348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:34.724039 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f2a88-f85a-4850-8d86-a1b26032a348 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:34.831349 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 992/1972] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:34 2022] POST /identity/v3/users => generated 282 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:34.838313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f2a88-f85a-4850-8d86-a1b26032a348 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:34.841450 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1142bafe-c390-408c-9a2e-4dfe21df5ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd693278eee4ed3986d59094743b9ec'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:34.848701 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f2a88-f85a-4850-8d86-a1b26032a348 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:34.853990 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1655f-c19d-45ef-ad6c-05022080124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:34.855008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1655f-c19d-45ef-ad6c-05022080124a admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:34.855088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1655f-c19d-45ef-ad6c-05022080124a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:34.855713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1655f-c19d-45ef-ad6c-05022080124a admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:34.856202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1142bafe-c390-408c-9a2e-4dfe21df5ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd693278eee4ed3986d59094743b9ec'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:34.856367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1655f-c19d-45ef-ad6c-05022080124a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:34.858348 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1655f-c19d-45ef-ad6c-05022080124a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:34.863313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1142bafe-c390-408c-9a2e-4dfe21df5ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd693278eee4ed3986d59094743b9ec'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:34.864099 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1142bafe-c390-408c-9a2e-4dfe21df5ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd693278eee4ed3986d59094743b9ec'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:34.869779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 993/1973] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:34.874949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1655f-c19d-45ef-ad6c-05022080124a admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:34.875940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b7d1655f-c19d-45ef-ad6c-05022080124a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:34.900731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1655f-c19d-45ef-ad6c-05022080124a admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:34.905669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879e74d-a6b2-4b05-9b0a-3bc2b0f1d4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:34.906367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879e74d-a6b2-4b05-9b0a-3bc2b0f1d4ff admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:34.906653 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879e74d-a6b2-4b05-9b0a-3bc2b0f1d4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:34.906939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879e74d-a6b2-4b05-9b0a-3bc2b0f1d4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:34.907712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879e74d-a6b2-4b05-9b0a-3bc2b0f1d4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:34.909347 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879e74d-a6b2-4b05-9b0a-3bc2b0f1d4ff admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:34.920777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 994/1974] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:34.924907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879e74d-a6b2-4b05-9b0a-3bc2b0f1d4ff admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:34.934929 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879e74d-a6b2-4b05-9b0a-3bc2b0f1d4ff admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:34.940505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368b801-ca95-4a2f-bdae-8300a56a990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:34.941448 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b801-ca95-4a2f-bdae-8300a56a990a admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:34.941887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b801-ca95-4a2f-bdae-8300a56a990a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:34.942171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b801-ca95-4a2f-bdae-8300a56a990a admin admin] PATH_INFO: `/v3/projects/974f6ff9746a48fa99da1b4705fa9616/users/9026a0b51c254fca8d82e371cb85b9f7/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:34.960436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368b801-ca95-4a2f-bdae-8300a56a990a admin admin] RBAC: Authorizing `identity:create_grant(project_id=974f6ff9746a48fa99da1b4705fa9616, user_id=9026a0b51c254fca8d82e371cb85b9f7, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:34.961832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1142bafe-c390-408c-9a2e-4dfe21df5ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd693278eee4ed3986d59094743b9ec'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:34.963080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368b801-ca95-4a2f-bdae-8300a56a990a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:34.969021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 981/1975] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:34 2022] DELETE /identity/v3/users/6cd693278eee4ed3986d59094743b9ec => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:34.969962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142bafe-c390-408c-9a2e-4dfe21df5ab7 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:34.972365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1142bafe-c390-408c-9a2e-4dfe21df5ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:35.056392 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142bafe-c390-408c-9a2e-4dfe21df5ab7 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:35.063745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:35.064891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:35.065776 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:35.065776 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] PATH_INFO: `/v3/projects/5edd1cff85e14e24b9f75be146464bfa` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:35.067973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5edd1cff85e14e24b9f75be146464bfa)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:35.070336 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:35.098245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 995/1976] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:34 2022] PUT /identity/v3/projects/974f6ff9746a48fa99da1b4705fa9616/users/9026a0b51c254fca8d82e371cb85b9f7/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:35.099290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ab8ba-5a70-4a9e-90b2-0c51915a8250 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:35.100318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ab8ba-5a70-4a9e-90b2-0c51915a8250 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:35.100705 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ab8ba-5a70-4a9e-90b2-0c51915a8250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:35.122716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-8b6ab8ba-5a70-4a9e-90b2-0c51915a8250 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:35.124277 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8b6ab8ba-5a70-4a9e-90b2-0c51915a8250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:35.192310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 996/1977] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:35.193665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed875847-ffee-460f-aaff-3db38ebd8f3c None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:35.194059 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed875847-ffee-460f-aaff-3db38ebd8f3c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:35.194485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed875847-ffee-460f-aaff-3db38ebd8f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:35.225744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ed875847-ffee-460f-aaff-3db38ebd8f3c None None] MFA Rules not processed for user `9026a0b51c254fca8d82e371cb85b9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:35.227239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ed875847-ffee-460f-aaff-3db38ebd8f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:35.229612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5edd1cff85e14e24b9f75be146464bfa', 'request_id': 'req-4b91f621-d241-46d6-9b64-32f76eb9c5bb'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:35.297134 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 997/1978] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:35.298911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed875847-ffee-460f-aaff-3db38ebd8f3c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:35.302725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ed875847-ffee-460f-aaff-3db38ebd8f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:35.306856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5edd1cff85e14e24b9f75be146464bfa', 'request_id': 'req-4b91f621-d241-46d6-9b64-32f76eb9c5bb'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:35.315268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5edd1cff85e14e24b9f75be146464bfa', 'request_id': 'req-4b91f621-d241-46d6-9b64-32f76eb9c5bb'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:35.327328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] The token cache is being invalidate because project 5edd1cff85e14e24b9f75be146464bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:35.327645 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:35.328328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:35.330250 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 982/1979] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:34 2022] DELETE /identity/v3/projects/5edd1cff85e14e24b9f75be146464bfa => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:35.331071 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:35.334329 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:35.361279 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed875847-ffee-460f-aaff-3db38ebd8f3c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:35.365026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76895ff-d6fd-4468-ac7e-c9d7481ce6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:35.365717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76895ff-d6fd-4468-ac7e-c9d7481ce6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:35.366007 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76895ff-d6fd-4468-ac7e-c9d7481ce6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:35.366288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76895ff-d6fd-4468-ac7e-c9d7481ce6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:35.368169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c76895ff-d6fd-4468-ac7e-c9d7481ce6e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:35.402167 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91f621-d241-46d6-9b64-32f76eb9c5bb admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:35.407384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319530f-e909-4a3a-a7be-e119c8a280cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:35.408144 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319530f-e909-4a3a-a7be-e119c8a280cb admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:35.408428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319530f-e909-4a3a-a7be-e119c8a280cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:35.408702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319530f-e909-4a3a-a7be-e119c8a280cb admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:35.409395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319530f-e909-4a3a-a7be-e119c8a280cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:35.411351 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319530f-e909-4a3a-a7be-e119c8a280cb admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:35.433871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76895ff-d6fd-4468-ac7e-c9d7481ce6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:35.435339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76895ff-d6fd-4468-ac7e-c9d7481ce6e6 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:35.445010 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 998/1980] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:35.446083 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc358-f134-4d75-a883-8fed38982463 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:35.446373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc358-f134-4d75-a883-8fed38982463 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:35.446652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc358-f134-4d75-a883-8fed38982463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:35.464710 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-f83bc358-f134-4d75-a883-8fed38982463 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:35.465942 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f83bc358-f134-4d75-a883-8fed38982463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:35.474575 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 999/1981] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:35.482003 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2de4b-f9e5-4e35-8e5d-7eb9b21d5187 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:35.482846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2de4b-f9e5-4e35-8e5d-7eb9b21d5187 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:35.483385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2de4b-f9e5-4e35-8e5d-7eb9b21d5187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:35.501314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-90a2de4b-f9e5-4e35-8e5d-7eb9b21d5187 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:35.502515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-90a2de4b-f9e5-4e35-8e5d-7eb9b21d5187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:35.511091 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1000/1982] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:35.515145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2de4b-f9e5-4e35-8e5d-7eb9b21d5187 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:35.524361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2de4b-f9e5-4e35-8e5d-7eb9b21d5187 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:35.529791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306b79a-8b0a-4746-9dc8-05bd2914b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:35.530481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306b79a-8b0a-4746-9dc8-05bd2914b5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:35.538003 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306b79a-8b0a-4746-9dc8-05bd2914b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:35.538003 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306b79a-8b0a-4746-9dc8-05bd2914b5a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:35.538003 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306b79a-8b0a-4746-9dc8-05bd2914b5a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:35.538003 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306b79a-8b0a-4746-9dc8-05bd2914b5a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:35.538003 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306b79a-8b0a-4746-9dc8-05bd2914b5a1 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:35.541493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 983/1983] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:35 2022] POST /identity/v3/projects => generated 365 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:35.546086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319530f-e909-4a3a-a7be-e119c8a280cb admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:35.548949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1001/1984] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:57:35.553233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306b79a-8b0a-4746-9dc8-05bd2914b5a1 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:35.563250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306b79a-8b0a-4746-9dc8-05bd2914b5a1 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:35.588412 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:35.622951 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319530f-e909-4a3a-a7be-e119c8a280cb admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:35.629165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08543274-f10d-4afb-b6f0-b09187cd214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:35.629849 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08543274-f10d-4afb-b6f0-b09187cd214b admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:35.630750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08543274-f10d-4afb-b6f0-b09187cd214b admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:35.631035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08543274-f10d-4afb-b6f0-b09187cd214b admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:35.632083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08543274-f10d-4afb-b6f0-b09187cd214b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:35.634589 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08543274-f10d-4afb-b6f0-b09187cd214b admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:35.647612 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63718c1-562a-4d97-bb56-688e6060764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:35.648374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63718c1-562a-4d97-bb56-688e6060764f admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:35.648666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63718c1-562a-4d97-bb56-688e6060764f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:35.648950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63718c1-562a-4d97-bb56-688e6060764f admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:35.649903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63718c1-562a-4d97-bb56-688e6060764f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:35.652122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63718c1-562a-4d97-bb56-688e6060764f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:35.724734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 984/1985] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:35 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:35.729992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08543274-f10d-4afb-b6f0-b09187cd214b admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:35.740406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08543274-f10d-4afb-b6f0-b09187cd214b admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:35.747938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39b53a-74e2-483c-864a-5af9d5c383d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:35.748605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39b53a-74e2-483c-864a-5af9d5c383d9 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:35.748962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39b53a-74e2-483c-864a-5af9d5c383d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:35.749690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39b53a-74e2-483c-864a-5af9d5c383d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:35.750155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39b53a-74e2-483c-864a-5af9d5c383d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:35.752141 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39b53a-74e2-483c-864a-5af9d5c383d9 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:35.757840 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1002/1986] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:35 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:35.764760 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63718c1-562a-4d97-bb56-688e6060764f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:35.768145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 985/1987] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:35.777228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39b53a-74e2-483c-864a-5af9d5c383d9 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:35.789948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39b53a-74e2-483c-864a-5af9d5c383d9 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:35.858346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953e0cd-40b8-4bac-9430-b6cec27aeee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:35.859255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e0cd-40b8-4bac-9430-b6cec27aeee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:35.859568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e0cd-40b8-4bac-9430-b6cec27aeee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:35.859850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e0cd-40b8-4bac-9430-b6cec27aeee3 admin admin] PATH_INFO: `/v3/projects/6d50f3a12a9b4d4f95c09d9ca21e2899/users/b379e260b21f4bd1ae8b1c6a2f32911e/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:35.870975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63718c1-562a-4d97-bb56-688e6060764f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:35.876648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453367-7b7f-4945-a708-3d337e468712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:35.877385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453367-7b7f-4945-a708-3d337e468712 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:35.877780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453367-7b7f-4945-a708-3d337e468712 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:35.878159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453367-7b7f-4945-a708-3d337e468712 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:35.879020 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad453367-7b7f-4945-a708-3d337e468712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:35.881447 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad453367-7b7f-4945-a708-3d337e468712 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:35.899480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953e0cd-40b8-4bac-9430-b6cec27aeee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d50f3a12a9b4d4f95c09d9ca21e2899, user_id=b379e260b21f4bd1ae8b1c6a2f32911e, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:35.902859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953e0cd-40b8-4bac-9430-b6cec27aeee3 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:35.979355 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1003/1988] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:35 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:35.983486 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453367-7b7f-4945-a708-3d337e468712 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:35.992992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453367-7b7f-4945-a708-3d337e468712 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:35.998039 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425c60e-b44b-49ab-a450-9e49c2244015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:35.998737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425c60e-b44b-49ab-a450-9e49c2244015 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:35.999020 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425c60e-b44b-49ab-a450-9e49c2244015 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:35.999419 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425c60e-b44b-49ab-a450-9e49c2244015 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.000179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425c60e-b44b-49ab-a450-9e49c2244015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:36.001912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425c60e-b44b-49ab-a450-9e49c2244015 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:36.012634 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1004/1989] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:36.016912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425c60e-b44b-49ab-a450-9e49c2244015 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:36.026555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425c60e-b44b-49ab-a450-9e49c2244015 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:36.031705 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2faaa-fa11-4ac9-a86f-904685c5c6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:36.032337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2faaa-fa11-4ac9-a86f-904685c5c6aa admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.032618 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2faaa-fa11-4ac9-a86f-904685c5c6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.033468 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2faaa-fa11-4ac9-a86f-904685c5c6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.033651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2faaa-fa11-4ac9-a86f-904685c5c6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:36.035218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2faaa-fa11-4ac9-a86f-904685c5c6aa admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:36.044769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1005/1990] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:36.048591 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2faaa-fa11-4ac9-a86f-904685c5c6aa admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:36.057446 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2faaa-fa11-4ac9-a86f-904685c5c6aa admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:36.062554 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078b176-2eae-46d4-85fc-6b3e0f2122d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:36.063389 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078b176-2eae-46d4-85fc-6b3e0f2122d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.063699 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078b176-2eae-46d4-85fc-6b3e0f2122d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.063970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078b176-2eae-46d4-85fc-6b3e0f2122d1 admin admin] PATH_INFO: `/v3/projects/f63120f62bda47d190ed6bcdec155caa/users/a9f6a623aa3845bb800a466f965a3b5d/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.068129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:36.076824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 986/1991] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:35 2022] PUT /identity/v3/projects/6d50f3a12a9b4d4f95c09d9ca21e2899/users/b379e260b21f4bd1ae8b1c6a2f32911e/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:36.081335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953e0cd-40b8-4bac-9430-b6cec27aeee3 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:36.096497 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078b176-2eae-46d4-85fc-6b3e0f2122d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63120f62bda47d190ed6bcdec155caa, user_id=a9f6a623aa3845bb800a466f965a3b5d, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:36.099299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078b176-2eae-46d4-85fc-6b3e0f2122d1 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:36.175257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953e0cd-40b8-4bac-9430-b6cec27aeee3 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:36.180162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84539729-dee6-4fe2-abdb-b60d562edfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:36.180830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84539729-dee6-4fe2-abdb-b60d562edfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.181114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84539729-dee6-4fe2-abdb-b60d562edfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.181453 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84539729-dee6-4fe2-abdb-b60d562edfe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.182190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84539729-dee6-4fe2-abdb-b60d562edfe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:36.183826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84539729-dee6-4fe2-abdb-b60d562edfe2 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:36.194702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 987/1992] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:36.195573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84539729-dee6-4fe2-abdb-b60d562edfe2 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:36.198786 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-84539729-dee6-4fe2-abdb-b60d562edfe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:36.211634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84539729-dee6-4fe2-abdb-b60d562edfe2 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:36.216549 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:36.217491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.217772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.218067 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] PATH_INFO: `/v3/projects/5e5031d12d2f44a198d72529c342e2a8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.219273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5031d12d2f44a198d72529c342e2a8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:36.221199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:36.258912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1006/1993] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:36 2022] PUT /identity/v3/projects/f63120f62bda47d190ed6bcdec155caa/users/a9f6a623aa3845bb800a466f965a3b5d/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:36.259783 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078b176-2eae-46d4-85fc-6b3e0f2122d1 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:36.334558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078b176-2eae-46d4-85fc-6b3e0f2122d1 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:36.339689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dac1ba-3c69-4f46-bbbf-d58a05841963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:36.340582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dac1ba-3c69-4f46-bbbf-d58a05841963 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.340863 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dac1ba-3c69-4f46-bbbf-d58a05841963 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.341162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dac1ba-3c69-4f46-bbbf-d58a05841963 admin admin] PATH_INFO: `/v3/projects/6d50f3a12a9b4d4f95c09d9ca21e2899/users/b379e260b21f4bd1ae8b1c6a2f32911e/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.343297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dac1ba-3c69-4f46-bbbf-d58a05841963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d50f3a12a9b4d4f95c09d9ca21e2899, user_id=b379e260b21f4bd1ae8b1c6a2f32911e, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:36.346012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dac1ba-3c69-4f46-bbbf-d58a05841963 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:36.356423 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1007/1994] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:36 2022] PUT /identity/v3/projects/6d50f3a12a9b4d4f95c09d9ca21e2899/users/b379e260b21f4bd1ae8b1c6a2f32911e/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:36.365518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eea02f-1f82-422c-96e2-9f25a8c8de3c None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.368314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eea02f-1f82-422c-96e2-9f25a8c8de3c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.368314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eea02f-1f82-422c-96e2-9f25a8c8de3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.377856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5031d12d2f44a198d72529c342e2a8', 'request_id': 'req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:36.396310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-37eea02f-1f82-422c-96e2-9f25a8c8de3c None None] MFA Rules not processed for user `a9f6a623aa3845bb800a466f965a3b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:36.397606 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-37eea02f-1f82-422c-96e2-9f25a8c8de3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:36.463841 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1008/1995] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:36.465142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd333f-b104-43cd-90ef-37d86225aed8 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.468521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd333f-b104-43cd-90ef-37d86225aed8 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.468521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd333f-b104-43cd-90ef-37d86225aed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.491946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-44dd333f-b104-43cd-90ef-37d86225aed8 None None] MFA Rules not processed for user `b379e260b21f4bd1ae8b1c6a2f32911e`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:36.493149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-44dd333f-b104-43cd-90ef-37d86225aed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:36.494257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5031d12d2f44a198d72529c342e2a8', 'request_id': 'req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:36.502032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5031d12d2f44a198d72529c342e2a8', 'request_id': 'req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:36.515366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] The token cache is being invalidate because project 5e5031d12d2f44a198d72529c342e2a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:36.515765 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:36.516536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:36.521635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 988/1996] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:36 2022] DELETE /identity/v3/projects/5e5031d12d2f44a198d72529c342e2a8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:36.521635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:36.521635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:36.567767 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1009/1997] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:36.569170 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dab804-8899-4678-8e85-04d70d4c1db8 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.569479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dab804-8899-4678-8e85-04d70d4c1db8 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.569746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dab804-8899-4678-8e85-04d70d4c1db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.595123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccaaf4-d0e4-4c30-b2df-b6b46197863c admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:36.601448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e2756-da4e-4eb9-b82e-090c267cde26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:36.602220 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e2756-da4e-4eb9-b82e-090c267cde26 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.602619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e2756-da4e-4eb9-b82e-090c267cde26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.603101 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e2756-da4e-4eb9-b82e-090c267cde26 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.603905 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-00dab804-8899-4678-8e85-04d70d4c1db8 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:36.604096 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e2756-da4e-4eb9-b82e-090c267cde26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:36.605993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-00dab804-8899-4678-8e85-04d70d4c1db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:36.606217 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e2756-da4e-4eb9-b82e-090c267cde26 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:36.617820 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1010/1998] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:36.618818 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dab804-8899-4678-8e85-04d70d4c1db8 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:36.620429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-00dab804-8899-4678-8e85-04d70d4c1db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:36.680688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dab804-8899-4678-8e85-04d70d4c1db8 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:36.684546 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b32229-e9e4-4a2a-803c-abb1970f84bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:36.687317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b32229-e9e4-4a2a-803c-abb1970f84bb service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.687317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b32229-e9e4-4a2a-803c-abb1970f84bb service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.687317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b32229-e9e4-4a2a-803c-abb1970f84bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.695189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b32229-e9e4-4a2a-803c-abb1970f84bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:36.696642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b32229-e9e4-4a2a-803c-abb1970f84bb service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:36.705981 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1011/1999] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:36.707152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e869a-6321-4e0f-b1ae-af3fef143d6b None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.707435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e869a-6321-4e0f-b1ae-af3fef143d6b None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.707735 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e869a-6321-4e0f-b1ae-af3fef143d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.725107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-949e869a-6321-4e0f-b1ae-af3fef143d6b None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:36.726286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-949e869a-6321-4e0f-b1ae-af3fef143d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:36.734962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1012/2000] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:36.739059 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e869a-6321-4e0f-b1ae-af3fef143d6b None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:36.748235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e869a-6321-4e0f-b1ae-af3fef143d6b None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:36.752836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfae78-7adc-48bd-a2b8-845f0615763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:36.753466 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfae78-7adc-48bd-a2b8-845f0615763a admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.753745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfae78-7adc-48bd-a2b8-845f0615763a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.754023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfae78-7adc-48bd-a2b8-845f0615763a admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.757618 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 989/2001] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:36 2022] POST /identity/v3/projects => generated 363 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:36.757741 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfae78-7adc-48bd-a2b8-845f0615763a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:36.757741 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfae78-7adc-48bd-a2b8-845f0615763a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:36.757741 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfae78-7adc-48bd-a2b8-845f0615763a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:36.758569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e2756-da4e-4eb9-b82e-090c267cde26 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:36.768921 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1013/2002] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:57:36.773135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfae78-7adc-48bd-a2b8-845f0615763a admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:36.784008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfae78-7adc-48bd-a2b8-845f0615763a admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:36.825270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e2756-da4e-4eb9-b82e-090c267cde26 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:36.830498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5c49a-de01-42e1-b6e3-7c23ee755c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:36.831246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5c49a-de01-42e1-b6e3-7c23ee755c43 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.831785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5c49a-de01-42e1-b6e3-7c23ee755c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.832166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5c49a-de01-42e1-b6e3-7c23ee755c43 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.832960 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5c49a-de01-42e1-b6e3-7c23ee755c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:36.836675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5c49a-de01-42e1-b6e3-7c23ee755c43 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:36.850988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c52c5c-0955-41a0-acb2-1b763bb36fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:36.851880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c52c5c-0955-41a0-acb2-1b763bb36fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.852164 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c52c5c-0955-41a0-acb2-1b763bb36fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.852470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c52c5c-0955-41a0-acb2-1b763bb36fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.853344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c52c5c-0955-41a0-acb2-1b763bb36fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:36.855412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c52c5c-0955-41a0-acb2-1b763bb36fa1 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:36.900940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 990/2003] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:36 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:36.905198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5c49a-de01-42e1-b6e3-7c23ee755c43 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:36.914615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5c49a-de01-42e1-b6e3-7c23ee755c43 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:36.919267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4deed-e8e1-4ab4-86d6-5035e9d1ff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:36.920494 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4deed-e8e1-4ab4-86d6-5035e9d1ff48 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.920777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4deed-e8e1-4ab4-86d6-5035e9d1ff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.921055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4deed-e8e1-4ab4-86d6-5035e9d1ff48 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.921769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4deed-e8e1-4ab4-86d6-5035e9d1ff48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:36.923353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4deed-e8e1-4ab4-86d6-5035e9d1ff48 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:36.932935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 991/2004] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:36.936764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4deed-e8e1-4ab4-86d6-5035e9d1ff48 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:36.946598 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4deed-e8e1-4ab4-86d6-5035e9d1ff48 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:36.951460 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e98c2-a74a-4c14-8cb4-43d0abc76c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:36.952497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e98c2-a74a-4c14-8cb4-43d0abc76c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:36.952811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e98c2-a74a-4c14-8cb4-43d0abc76c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:36.953089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e98c2-a74a-4c14-8cb4-43d0abc76c60 admin admin] PATH_INFO: `/v3/projects/112e3c4633634dd4aeaece81fd2eb4f6/users/32891121360d48c9a17cf857ba0ffdee/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:36.970513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1014/2005] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:36 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:36.972236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e98c2-a74a-4c14-8cb4-43d0abc76c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112e3c4633634dd4aeaece81fd2eb4f6, user_id=32891121360d48c9a17cf857ba0ffdee, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:36.974724 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c52c5c-0955-41a0-acb2-1b763bb36fa1 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:36.975142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e98c2-a74a-4c14-8cb4-43d0abc76c60 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:37.041546 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c52c5c-0955-41a0-acb2-1b763bb36fa1 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:37.047503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794d012-bb9a-4b2b-bf57-cf6b5cabe306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:37.048178 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794d012-bb9a-4b2b-bf57-cf6b5cabe306 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:37.048462 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794d012-bb9a-4b2b-bf57-cf6b5cabe306 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:37.048739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794d012-bb9a-4b2b-bf57-cf6b5cabe306 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:37.050090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794d012-bb9a-4b2b-bf57-cf6b5cabe306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:37.052034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794d012-bb9a-4b2b-bf57-cf6b5cabe306 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:37.072803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 992/2006] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:36 2022] PUT /identity/v3/projects/112e3c4633634dd4aeaece81fd2eb4f6/users/32891121360d48c9a17cf857ba0ffdee/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:37.073642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e98c2-a74a-4c14-8cb4-43d0abc76c60 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:37.081018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8c8e98c2-a74a-4c14-8cb4-43d0abc76c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:37.136296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e98c2-a74a-4c14-8cb4-43d0abc76c60 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:37.140426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5c82a-6136-404e-8641-63fde30e8f36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:37.141167 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5c82a-6136-404e-8641-63fde30e8f36 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:37.141529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5c82a-6136-404e-8641-63fde30e8f36 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:37.141864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5c82a-6136-404e-8641-63fde30e8f36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:37.142667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1015/2007] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:36 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:37.143695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794d012-bb9a-4b2b-bf57-cf6b5cabe306 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:37.150056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-57e5c82a-6136-404e-8641-63fde30e8f36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:37.156583 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794d012-bb9a-4b2b-bf57-cf6b5cabe306 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:37.218989 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749f8af-7693-4cf2-b3c4-9e6365eba8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:37.219779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749f8af-7693-4cf2-b3c4-9e6365eba8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:37.219906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5c82a-6136-404e-8641-63fde30e8f36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:37.220469 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749f8af-7693-4cf2-b3c4-9e6365eba8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:37.220804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749f8af-7693-4cf2-b3c4-9e6365eba8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:37.221438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5c82a-6136-404e-8641-63fde30e8f36 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:37.221720 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749f8af-7693-4cf2-b3c4-9e6365eba8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:37.224261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749f8af-7693-4cf2-b3c4-9e6365eba8d8 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:37.240152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1016/2008] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:37.241214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749f8af-7693-4cf2-b3c4-9e6365eba8d8 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:37.258607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 993/2009] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:37.259531 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5c82a-6136-404e-8641-63fde30e8f36 service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:37.261034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749f8af-7693-4cf2-b3c4-9e6365eba8d8 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:37.267290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1369e-371f-4340-a9db-a839226980eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:37.274453 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1369e-371f-4340-a9db-a839226980eb admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:37.274786 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1369e-371f-4340-a9db-a839226980eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:37.275070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1369e-371f-4340-a9db-a839226980eb admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:37.275928 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1369e-371f-4340-a9db-a839226980eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:37.277653 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1369e-371f-4340-a9db-a839226980eb admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:37.296975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1017/2010] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:37.297920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1369e-371f-4340-a9db-a839226980eb admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:37.306381 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5c82a-6136-404e-8641-63fde30e8f36 service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:37.311744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1369e-371f-4340-a9db-a839226980eb admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:37.318870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6272d-258d-48f3-b94c-b00b51d184cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:37.319606 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6272d-258d-48f3-b94c-b00b51d184cc admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:37.319909 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341ceb2-3cab-46a3-88b8-949c4d5baa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:37.320034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6272d-258d-48f3-b94c-b00b51d184cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:37.320204 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6272d-258d-48f3-b94c-b00b51d184cc admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:37.320831 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341ceb2-3cab-46a3-88b8-949c4d5baa0e admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:37.320956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6272d-258d-48f3-b94c-b00b51d184cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:37.323376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341ceb2-3cab-46a3-88b8-949c4d5baa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:37.323527 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6272d-258d-48f3-b94c-b00b51d184cc admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:37.323625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341ceb2-3cab-46a3-88b8-949c4d5baa0e admin admin] PATH_INFO: `/v3/projects/112e3c4633634dd4aeaece81fd2eb4f6/users/32891121360d48c9a17cf857ba0ffdee/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:37.346400 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341ceb2-3cab-46a3-88b8-949c4d5baa0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=112e3c4633634dd4aeaece81fd2eb4f6, user_id=32891121360d48c9a17cf857ba0ffdee, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:37.347219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1018/2011] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:37.350421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6272d-258d-48f3-b94c-b00b51d184cc admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:37.354752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341ceb2-3cab-46a3-88b8-949c4d5baa0e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:37.361337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6272d-258d-48f3-b94c-b00b51d184cc admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:37.367638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1743cff-3baf-480c-a3b5-a241fc2691c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:37.369695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743cff-3baf-480c-a3b5-a241fc2691c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:37.369695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743cff-3baf-480c-a3b5-a241fc2691c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:37.369895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743cff-3baf-480c-a3b5-a241fc2691c7 admin admin] PATH_INFO: `/v3/projects/c62ed18530404c009d105064e25f6bba/users/232e7593ef8f457389be4f6fb53f6068/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:37.384824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 994/2012] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:37 2022] PUT /identity/v3/projects/112e3c4633634dd4aeaece81fd2eb4f6/users/32891121360d48c9a17cf857ba0ffdee/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:37.391854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1743cff-3baf-480c-a3b5-a241fc2691c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62ed18530404c009d105064e25f6bba, user_id=232e7593ef8f457389be4f6fb53f6068, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:37.395595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1743cff-3baf-480c-a3b5-a241fc2691c7 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:37.403139 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12550162-9b9d-48f4-a783-de5ecb1d2496 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:37.403358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12550162-9b9d-48f4-a783-de5ecb1d2496 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:37.403644 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12550162-9b9d-48f4-a783-de5ecb1d2496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:37.482605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1019/2013] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:37 2022] PUT /identity/v3/projects/c62ed18530404c009d105064e25f6bba/users/232e7593ef8f457389be4f6fb53f6068/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:37.483135 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-12550162-9b9d-48f4-a783-de5ecb1d2496 None None] MFA Rules not processed for user `32891121360d48c9a17cf857ba0ffdee`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:37.484309 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-12550162-9b9d-48f4-a783-de5ecb1d2496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:37.484808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398069a-176a-4729-a7fe-2e96cdeeffef None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:37.485103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398069a-176a-4729-a7fe-2e96cdeeffef None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:37.485383 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398069a-176a-4729-a7fe-2e96cdeeffef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:37.536447 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-2398069a-176a-4729-a7fe-2e96cdeeffef None None] MFA Rules not processed for user `232e7593ef8f457389be4f6fb53f6068`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:37.537752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2398069a-176a-4729-a7fe-2e96cdeeffef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:37.587498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 995/2014] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:37.611844 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1020/2015] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:37.616419 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12550162-9b9d-48f4-a783-de5ecb1d2496 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:37.680396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12550162-9b9d-48f4-a783-de5ecb1d2496 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:37.688323 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dac825-91e4-4bb5-8c84-1e8695bf407c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:37.689144 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dac825-91e4-4bb5-8c84-1e8695bf407c admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:37.689311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dac825-91e4-4bb5-8c84-1e8695bf407c admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:37.689631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dac825-91e4-4bb5-8c84-1e8695bf407c admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:37.690334 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dac825-91e4-4bb5-8c84-1e8695bf407c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:37.692414 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dac825-91e4-4bb5-8c84-1e8695bf407c admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:37.841972 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 996/2016] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:37 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:37.844853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398069a-176a-4729-a7fe-2e96cdeeffef None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:37.855584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398069a-176a-4729-a7fe-2e96cdeeffef None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:37.910121 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef45c9f-06b8-4ea7-9eeb-93b2480abfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:37.910719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef45c9f-06b8-4ea7-9eeb-93b2480abfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:37.911005 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef45c9f-06b8-4ea7-9eeb-93b2480abfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:37.911281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef45c9f-06b8-4ea7-9eeb-93b2480abfa6 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:37.911999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef45c9f-06b8-4ea7-9eeb-93b2480abfa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:37.913919 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef45c9f-06b8-4ea7-9eeb-93b2480abfa6 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:38.039171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1021/2017] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:37 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:38.042460 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dac825-91e4-4bb5-8c84-1e8695bf407c admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:38.052754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dac825-91e4-4bb5-8c84-1e8695bf407c admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:38.057341 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230ce76-e259-454e-aa10-1e4f2bc8d467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:38.057997 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230ce76-e259-454e-aa10-1e4f2bc8d467 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:38.058280 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230ce76-e259-454e-aa10-1e4f2bc8d467 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:38.058556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230ce76-e259-454e-aa10-1e4f2bc8d467 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:38.059303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230ce76-e259-454e-aa10-1e4f2bc8d467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:38.061001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230ce76-e259-454e-aa10-1e4f2bc8d467 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:38.064871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:38.074227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 997/2018] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:38.079690 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef45c9f-06b8-4ea7-9eeb-93b2480abfa6 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:38.091883 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef45c9f-06b8-4ea7-9eeb-93b2480abfa6 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:38.096600 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be10f-353d-4432-801d-ac17f91decfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:38.097265 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be10f-353d-4432-801d-ac17f91decfd admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:38.097547 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be10f-353d-4432-801d-ac17f91decfd admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:38.097824 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be10f-353d-4432-801d-ac17f91decfd admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:38.098567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547be10f-353d-4432-801d-ac17f91decfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:38.100231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547be10f-353d-4432-801d-ac17f91decfd admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:38.110613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1022/2019] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:38.121233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230ce76-e259-454e-aa10-1e4f2bc8d467 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:38.130995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230ce76-e259-454e-aa10-1e4f2bc8d467 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:38.136725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683bc0c-f779-489c-a3de-4a988ae9f768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:38.137804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683bc0c-f779-489c-a3de-4a988ae9f768 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:38.138805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683bc0c-f779-489c-a3de-4a988ae9f768 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:38.140341 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683bc0c-f779-489c-a3de-4a988ae9f768 admin admin] PATH_INFO: `/v3/projects/2f808073f738410f954a1c7f0f6d8f83/users/a890a411563e4df5987a54581ca6734b/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:38.158269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683bc0c-f779-489c-a3de-4a988ae9f768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f808073f738410f954a1c7f0f6d8f83, user_id=a890a411563e4df5987a54581ca6734b, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:38.165260 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683bc0c-f779-489c-a3de-4a988ae9f768 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:38.232046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be10f-353d-4432-801d-ac17f91decfd admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:38.288316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 998/2020] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:38 2022] PUT /identity/v3/projects/2f808073f738410f954a1c7f0f6d8f83/users/a890a411563e4df5987a54581ca6734b/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:38.290676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795052c3-4061-4f15-b8c8-d0b3a4ac4b26 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:38.290676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795052c3-4061-4f15-b8c8-d0b3a4ac4b26 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:38.291607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795052c3-4061-4f15-b8c8-d0b3a4ac4b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:38.294676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be10f-353d-4432-801d-ac17f91decfd admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:38.320357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-795052c3-4061-4f15-b8c8-d0b3a4ac4b26 None None] MFA Rules not processed for user `a890a411563e4df5987a54581ca6734b`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:38.321926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-795052c3-4061-4f15-b8c8-d0b3a4ac4b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:38.351091 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04104f-3de3-4aea-bd9a-320d6309a8ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:38.351091 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04104f-3de3-4aea-bd9a-320d6309a8ee service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:38.351091 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04104f-3de3-4aea-bd9a-320d6309a8ee service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:38.351091 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04104f-3de3-4aea-bd9a-320d6309a8ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:38.422495 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 999/2021] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:38.425218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04104f-3de3-4aea-bd9a-320d6309a8ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:38.426672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04104f-3de3-4aea-bd9a-320d6309a8ee service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:38.426908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795052c3-4061-4f15-b8c8-d0b3a4ac4b26 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:38.437594 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1023/2022] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:38 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:38.487861 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795052c3-4061-4f15-b8c8-d0b3a4ac4b26 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:38.492487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0add1d-5ca4-4156-9735-e4243b35e728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:38.493148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0add1d-5ca4-4156-9735-e4243b35e728 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:38.493428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0add1d-5ca4-4156-9735-e4243b35e728 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:38.493717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0add1d-5ca4-4156-9735-e4243b35e728 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:38.494385 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0add1d-5ca4-4156-9735-e4243b35e728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:38.496379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0add1d-5ca4-4156-9735-e4243b35e728 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:38.546643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:38.607573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1000/2023] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:38 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:38.617034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04104f-3de3-4aea-bd9a-320d6309a8ee service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:38.637978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04104f-3de3-4aea-bd9a-320d6309a8ee service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:38.710399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f715c-93ad-489d-bea8-e40cc2f73df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:38.711099 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f715c-93ad-489d-bea8-e40cc2f73df5 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:38.711387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f715c-93ad-489d-bea8-e40cc2f73df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:38.711709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f715c-93ad-489d-bea8-e40cc2f73df5 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:38.712570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f715c-93ad-489d-bea8-e40cc2f73df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:38.714611 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f715c-93ad-489d-bea8-e40cc2f73df5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:38.781970 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0add1d-5ca4-4156-9735-e4243b35e728 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:38.846732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0add1d-5ca4-4156-9735-e4243b35e728 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:38.851911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acfdbf-f9db-4b6f-8fb1-273de6d6f1e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:38.852579 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acfdbf-f9db-4b6f-8fb1-273de6d6f1e3 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:38.852913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acfdbf-f9db-4b6f-8fb1-273de6d6f1e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:38.853193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acfdbf-f9db-4b6f-8fb1-273de6d6f1e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:38.855263 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-60acfdbf-f9db-4b6f-8fb1-273de6d6f1e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:38.869014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1024/2024] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:38 2022] POST /identity/v3/users => generated 299 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:38.873938 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f715c-93ad-489d-bea8-e40cc2f73df5 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:38.886659 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f715c-93ad-489d-bea8-e40cc2f73df5 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:38.893751 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d576b-36d3-4e06-8466-65454f575250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:38.898126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d576b-36d3-4e06-8466-65454f575250 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:38.898126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d576b-36d3-4e06-8466-65454f575250 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:38.898126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d576b-36d3-4e06-8466-65454f575250 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:38.898126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d576b-36d3-4e06-8466-65454f575250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:38.901037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d576b-36d3-4e06-8466-65454f575250 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:38.932206 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1025/2025] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:38.938200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d576b-36d3-4e06-8466-65454f575250 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:38.941654 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acfdbf-f9db-4b6f-8fb1-273de6d6f1e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:38.943163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acfdbf-f9db-4b6f-8fb1-273de6d6f1e3 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:38.948992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d576b-36d3-4e06-8466-65454f575250 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:38.956962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1001/2026] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:38.972422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3942cef-3180-45ee-ae2b-ddcb5d036443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:38.975081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3942cef-3180-45ee-ae2b-ddcb5d036443 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:38.975341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3942cef-3180-45ee-ae2b-ddcb5d036443 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:38.975677 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3942cef-3180-45ee-ae2b-ddcb5d036443 admin admin] PATH_INFO: `/v3/projects/ae483b4b5aab456ea5841242c3f893c2/users/8c19371c3077443ebdcd8322fd2233b5/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:39.013269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3942cef-3180-45ee-ae2b-ddcb5d036443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae483b4b5aab456ea5841242c3f893c2, user_id=8c19371c3077443ebdcd8322fd2233b5, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:39.016196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3942cef-3180-45ee-ae2b-ddcb5d036443 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:39.124079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1026/2027] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:38 2022] PUT /identity/v3/projects/ae483b4b5aab456ea5841242c3f893c2/users/8c19371c3077443ebdcd8322fd2233b5/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:39.128360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acfdbf-f9db-4b6f-8fb1-273de6d6f1e3 service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:39.141137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acfdbf-f9db-4b6f-8fb1-273de6d6f1e3 service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:39.198512 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a38f7e-e95d-41fb-9c1b-62780dd3ae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:39.199196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38f7e-e95d-41fb-9c1b-62780dd3ae4b admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:39.199497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38f7e-e95d-41fb-9c1b-62780dd3ae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:39.199779 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38f7e-e95d-41fb-9c1b-62780dd3ae4b admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:39.200568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a38f7e-e95d-41fb-9c1b-62780dd3ae4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:39.202693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a38f7e-e95d-41fb-9c1b-62780dd3ae4b admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:39.212880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1002/2028] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:39.216796 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3942cef-3180-45ee-ae2b-ddcb5d036443 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:39.227358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3942cef-3180-45ee-ae2b-ddcb5d036443 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:39.232102 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b6e94-1bac-4269-957c-daa8e5673324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:39.232975 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b6e94-1bac-4269-957c-daa8e5673324 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:39.233299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b6e94-1bac-4269-957c-daa8e5673324 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:39.233632 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b6e94-1bac-4269-957c-daa8e5673324 admin admin] PATH_INFO: `/v3/projects/ae483b4b5aab456ea5841242c3f893c2/users/8c19371c3077443ebdcd8322fd2233b5/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:39.235571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b6e94-1bac-4269-957c-daa8e5673324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae483b4b5aab456ea5841242c3f893c2, user_id=8c19371c3077443ebdcd8322fd2233b5, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:39.238181 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b6e94-1bac-4269-957c-daa8e5673324 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:39.248983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1027/2029] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:39 2022] PUT /identity/v3/projects/ae483b4b5aab456ea5841242c3f893c2/users/8c19371c3077443ebdcd8322fd2233b5/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:39.262451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de3a7-c18c-4352-9892-a887de87fd75 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:39.262746 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de3a7-c18c-4352-9892-a887de87fd75 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:39.263675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de3a7-c18c-4352-9892-a887de87fd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:39.291634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-ad7de3a7-c18c-4352-9892-a887de87fd75 None None] MFA Rules not processed for user `8c19371c3077443ebdcd8322fd2233b5`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:39.292820 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ad7de3a7-c18c-4352-9892-a887de87fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:39.363557 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1003/2030] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:39.380507 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b6e94-1bac-4269-957c-daa8e5673324 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:39.442586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b6e94-1bac-4269-957c-daa8e5673324 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:39.446358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaf858-9a45-428f-8ffc-991efab5117f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:39.447008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaf858-9a45-428f-8ffc-991efab5117f service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:39.447292 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaf858-9a45-428f-8ffc-991efab5117f service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:39.447611 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaf858-9a45-428f-8ffc-991efab5117f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:39.508063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaf858-9a45-428f-8ffc-991efab5117f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:39.509916 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaf858-9a45-428f-8ffc-991efab5117f service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:39.521000 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1028/2031] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:39.943711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:39.995534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:41.946031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7de3a7-c18c-4352-9892-a887de87fd75 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:41.947466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ad7de3a7-c18c-4352-9892-a887de87fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:42.013695 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7de3a7-c18c-4352-9892-a887de87fd75 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:42.018331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7cc94-6057-443e-a4ef-3c052f693fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:42.019205 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7cc94-6057-443e-a4ef-3c052f693fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:42.019508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7cc94-6057-443e-a4ef-3c052f693fee admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:42.019783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7cc94-6057-443e-a4ef-3c052f693fee admin admin] PATH_INFO: `/v3/users/bd12e3001ed646c1a24e2a14d93a45e6` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:42.020960 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7cc94-6057-443e-a4ef-3c052f693fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd12e3001ed646c1a24e2a14d93a45e6)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:42.022903 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7cc94-6057-443e-a4ef-3c052f693fee admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:42.398055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:42.413915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-19b7cc94-6057-443e-a4ef-3c052f693fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd12e3001ed646c1a24e2a14d93a45e6'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:42.428908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-19b7cc94-6057-443e-a4ef-3c052f693fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd12e3001ed646c1a24e2a14d93a45e6'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:42.438764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-19b7cc94-6057-443e-a4ef-3c052f693fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd12e3001ed646c1a24e2a14d93a45e6'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:42.439579 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-19b7cc94-6057-443e-a4ef-3c052f693fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd12e3001ed646c1a24e2a14d93a45e6'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:42.546510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:42.612210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-19b7cc94-6057-443e-a4ef-3c052f693fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd12e3001ed646c1a24e2a14d93a45e6'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:42.620324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1004/2032] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:41 2022] DELETE /identity/v3/users/bd12e3001ed646c1a24e2a14d93a45e6 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:42.623709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3961e1-4966-4eeb-91a6-5c26eaae93dd None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:42.624010 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3961e1-4966-4eeb-91a6-5c26eaae93dd None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:42.624363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3961e1-4966-4eeb-91a6-5c26eaae93dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:42.677382 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-3b3961e1-4966-4eeb-91a6-5c26eaae93dd None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:42.678856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3b3961e1-4966-4eeb-91a6-5c26eaae93dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:42.742827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1029/2033] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:42.752796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7cc94-6057-443e-a4ef-3c052f693fee admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:42.754237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-19b7cc94-6057-443e-a4ef-3c052f693fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:42.814650 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7cc94-6057-443e-a4ef-3c052f693fee admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:42.818724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0c993-493c-4a19-8113-8a0303ba3115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:42.819469 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0c993-493c-4a19-8113-8a0303ba3115 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:42.819761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0c993-493c-4a19-8113-8a0303ba3115 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:42.820037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0c993-493c-4a19-8113-8a0303ba3115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:42.830833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0c993-493c-4a19-8113-8a0303ba3115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:42.832319 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0c993-493c-4a19-8113-8a0303ba3115 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:42.842021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1005/2034] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:43.529563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3961e1-4966-4eeb-91a6-5c26eaae93dd None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:43.531310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3b3961e1-4966-4eeb-91a6-5c26eaae93dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:43.558981 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3961e1-4966-4eeb-91a6-5c26eaae93dd None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:43.588303 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:43.591363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:43.591363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:43.592261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] PATH_INFO: `/v3/projects/54ff1f8855f54b58888320b605e9ca67` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:43.599917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ff1f8855f54b58888320b605e9ca67)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:43.603685 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:43.683237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:43.843174 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ff1f8855f54b58888320b605e9ca67', 'request_id': 'req-8845d2bd-0fba-4868-b576-35b55be4a3c8'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:43.877791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0c993-493c-4a19-8113-8a0303ba3115 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:43.879971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6eb0c993-493c-4a19-8113-8a0303ba3115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:43.893515 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0c993-493c-4a19-8113-8a0303ba3115 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:43.923843 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ff1f8855f54b58888320b605e9ca67', 'request_id': 'req-8845d2bd-0fba-4868-b576-35b55be4a3c8'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:43.938259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ff1f8855f54b58888320b605e9ca67', 'request_id': 'req-8845d2bd-0fba-4868-b576-35b55be4a3c8'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:43.954499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] The token cache is being invalidate because project 54ff1f8855f54b58888320b605e9ca67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:43.955125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:43.956077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:43.957068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:43.958125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1030/2035] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:43 2022] DELETE /identity/v3/projects/54ff1f8855f54b58888320b605e9ca67 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:43.959227 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:43.961597 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:43.968433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39caa00-dd69-4f37-a399-9fe984bca64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:43.969351 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39caa00-dd69-4f37-a399-9fe984bca64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:43.969642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39caa00-dd69-4f37-a399-9fe984bca64e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:43.969918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39caa00-dd69-4f37-a399-9fe984bca64e admin admin] PATH_INFO: `/v3/users/a9f6a623aa3845bb800a466f965a3b5d` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:43.971124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39caa00-dd69-4f37-a399-9fe984bca64e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f6a623aa3845bb800a466f965a3b5d)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:43.973393 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39caa00-dd69-4f37-a399-9fe984bca64e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:44.053961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845d2bd-0fba-4868-b576-35b55be4a3c8 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:44.057962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d22a8e-4fe7-48a7-929a-88941ae06f86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:44.059297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22a8e-4fe7-48a7-929a-88941ae06f86 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:44.059772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22a8e-4fe7-48a7-929a-88941ae06f86 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:44.060197 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22a8e-4fe7-48a7-929a-88941ae06f86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:44.062522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-48d22a8e-4fe7-48a7-929a-88941ae06f86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:44.200179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d22a8e-4fe7-48a7-929a-88941ae06f86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:44.201990 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d22a8e-4fe7-48a7-929a-88941ae06f86 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:44.218386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a39caa00-dd69-4f37-a399-9fe984bca64e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f6a623aa3845bb800a466f965a3b5d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.222825 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1031/2036] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:44.225337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d22a8e-4fe7-48a7-929a-88941ae06f86 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:44.233982 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-48d22a8e-4fe7-48a7-929a-88941ae06f86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:44.244831 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a39caa00-dd69-4f37-a399-9fe984bca64e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f6a623aa3845bb800a466f965a3b5d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.262699 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a39caa00-dd69-4f37-a399-9fe984bca64e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f6a623aa3845bb800a466f965a3b5d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.264456 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d22a8e-4fe7-48a7-929a-88941ae06f86 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:44.264947 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a39caa00-dd69-4f37-a399-9fe984bca64e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f6a623aa3845bb800a466f965a3b5d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.276140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b95b0-8764-4adf-a5b1-05aec1948638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:44.277333 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b95b0-8764-4adf-a5b1-05aec1948638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:44.277745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b95b0-8764-4adf-a5b1-05aec1948638 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:44.278699 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b95b0-8764-4adf-a5b1-05aec1948638 admin admin] PATH_INFO: `/v3/users/1896eda172d14fbc97c850e5b802122e` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:44.282591 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b95b0-8764-4adf-a5b1-05aec1948638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1896eda172d14fbc97c850e5b802122e)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:44.286163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b95b0-8764-4adf-a5b1-05aec1948638 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:44.374313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a39caa00-dd69-4f37-a399-9fe984bca64e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f6a623aa3845bb800a466f965a3b5d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.381520 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1006/2037] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:43 2022] DELETE /identity/v3/users/a9f6a623aa3845bb800a466f965a3b5d => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:44.385961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741788b-2043-4175-af35-e21f951278e5 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:44.388872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741788b-2043-4175-af35-e21f951278e5 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:44.388872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741788b-2043-4175-af35-e21f951278e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:44.404883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-1741788b-2043-4175-af35-e21f951278e5 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:44.406093 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1741788b-2043-4175-af35-e21f951278e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:44.476488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1007/2038] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:44.482916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741788b-2043-4175-af35-e21f951278e5 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:44.492224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1741788b-2043-4175-af35-e21f951278e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:44.560561 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741788b-2043-4175-af35-e21f951278e5 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:44.563807 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-e83b95b0-8764-4adf-a5b1-05aec1948638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1896eda172d14fbc97c850e5b802122e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.565642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5698247-1332-4c40-95eb-1f20ef4bb3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:44.566308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5698247-1332-4c40-95eb-1f20ef4bb3fd service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:44.566598 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5698247-1332-4c40-95eb-1f20ef4bb3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:44.566881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5698247-1332-4c40-95eb-1f20ef4bb3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:44.577089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5698247-1332-4c40-95eb-1f20ef4bb3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:44.578558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5698247-1332-4c40-95eb-1f20ef4bb3fd service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:44.588031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1008/2039] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:44.731228 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-e83b95b0-8764-4adf-a5b1-05aec1948638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1896eda172d14fbc97c850e5b802122e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.767609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-e83b95b0-8764-4adf-a5b1-05aec1948638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1896eda172d14fbc97c850e5b802122e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.768918 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-e83b95b0-8764-4adf-a5b1-05aec1948638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1896eda172d14fbc97c850e5b802122e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.778785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-e83b95b0-8764-4adf-a5b1-05aec1948638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1896eda172d14fbc97c850e5b802122e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.791106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1032/2040] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:44 2022] DELETE /identity/v3/users/1896eda172d14fbc97c850e5b802122e => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:45.283329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:45.317201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5698247-1332-4c40-95eb-1f20ef4bb3fd service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:45.319024 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a5698247-1332-4c40-95eb-1f20ef4bb3fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:45.365857 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5698247-1332-4c40-95eb-1f20ef4bb3fd service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:45.467798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:45.468880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:45.469163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:45.469459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] PATH_INFO: `/v3/projects/f63120f62bda47d190ed6bcdec155caa` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:45.470739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63120f62bda47d190ed6bcdec155caa)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:45.472876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:45.489443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b95b0-8764-4adf-a5b1-05aec1948638 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:45.489443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e83b95b0-8764-4adf-a5b1-05aec1948638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:45.512130 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b95b0-8764-4adf-a5b1-05aec1948638 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:45.525914 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9fc65-8440-46d7-9e6f-875d575f421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:45.530925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9fc65-8440-46d7-9e6f-875d575f421f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:45.530925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9fc65-8440-46d7-9e6f-875d575f421f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:45.530925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9fc65-8440-46d7-9e6f-875d575f421f admin admin] PATH_INFO: `/v3/projects/985490d7fc1f4a1680e43dbb1e95718e` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:45.530925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9fc65-8440-46d7-9e6f-875d575f421f admin admin] RBAC: Authorizing `identity:delete_project(project_id=985490d7fc1f4a1680e43dbb1e95718e)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:45.530925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9fc65-8440-46d7-9e6f-875d575f421f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:45.763700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63120f62bda47d190ed6bcdec155caa', 'request_id': 'req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:45.767589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d9f9fc65-8440-46d7-9e6f-875d575f421f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985490d7fc1f4a1680e43dbb1e95718e', 'request_id': 'req-d9f9fc65-8440-46d7-9e6f-875d575f421f'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:45.949312 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:45.951792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63120f62bda47d190ed6bcdec155caa', 'request_id': 'req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:45.960320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63120f62bda47d190ed6bcdec155caa', 'request_id': 'req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:45.985649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] The token cache is being invalidate because project f63120f62bda47d190ed6bcdec155caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:45.985927 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:45.992693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:45.992693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1009/2041] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:45 2022] DELETE /identity/v3/projects/f63120f62bda47d190ed6bcdec155caa => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:45.993643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:45.994464 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:46.068223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39d997-5c54-41ec-ae31-cd0bf31efbc6 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:46.099865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d9f9fc65-8440-46d7-9e6f-875d575f421f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985490d7fc1f4a1680e43dbb1e95718e', 'request_id': 'req-d9f9fc65-8440-46d7-9e6f-875d575f421f'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:46.107360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d9f9fc65-8440-46d7-9e6f-875d575f421f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985490d7fc1f4a1680e43dbb1e95718e', 'request_id': 'req-d9f9fc65-8440-46d7-9e6f-875d575f421f'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:46.118748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d9f9fc65-8440-46d7-9e6f-875d575f421f admin admin] The token cache is being invalidate because project 985490d7fc1f4a1680e43dbb1e95718e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:46.119298 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d9f9fc65-8440-46d7-9e6f-875d575f421f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:46.120218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-d9f9fc65-8440-46d7-9e6f-875d575f421f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:46.123275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1033/2042] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:45 2022] DELETE /identity/v3/projects/985490d7fc1f4a1680e43dbb1e95718e => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:46.128080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02406-73b6-4f7a-9a2b-ea9a1dbad610 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.128441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02406-73b6-4f7a-9a2b-ea9a1dbad610 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.128634 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02406-73b6-4f7a-9a2b-ea9a1dbad610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.137105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a7b26-533d-43f1-a96b-ed7e0e2d3ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:46.137973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a7b26-533d-43f1-a96b-ed7e0e2d3ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.138260 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a7b26-533d-43f1-a96b-ed7e0e2d3ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.138533 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a7b26-533d-43f1-a96b-ed7e0e2d3ea7 admin admin] PATH_INFO: `/v3/users/32891121360d48c9a17cf857ba0ffdee` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.139796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a7b26-533d-43f1-a96b-ed7e0e2d3ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32891121360d48c9a17cf857ba0ffdee)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:46.141719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a7b26-533d-43f1-a96b-ed7e0e2d3ea7 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:46.150798 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-2aa02406-73b6-4f7a-9a2b-ea9a1dbad610 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:46.152062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2aa02406-73b6-4f7a-9a2b-ea9a1dbad610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:46.161590 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1034/2043] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:46.170131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ab107-3261-44a0-9429-8b6c9cd66920 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.170465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ab107-3261-44a0-9429-8b6c9cd66920 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.171825 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ab107-3261-44a0-9429-8b6c9cd66920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.188578 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-300ab107-3261-44a0-9429-8b6c9cd66920 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:46.189782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-300ab107-3261-44a0-9429-8b6c9cd66920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:46.205119 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1035/2044] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:46.209734 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ab107-3261-44a0-9429-8b6c9cd66920 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:46.221797 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ab107-3261-44a0-9429-8b6c9cd66920 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:46.231814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178aae4-131c-48c6-a5f5-d82575e9b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:46.231814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178aae4-131c-48c6-a5f5-d82575e9b5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.231814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178aae4-131c-48c6-a5f5-d82575e9b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.232415 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178aae4-131c-48c6-a5f5-d82575e9b5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.233670 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178aae4-131c-48c6-a5f5-d82575e9b5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:46.234040 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178aae4-131c-48c6-a5f5-d82575e9b5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:46.236895 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178aae4-131c-48c6-a5f5-d82575e9b5d1 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:46.253997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1036/2045] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:46.258333 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178aae4-131c-48c6-a5f5-d82575e9b5d1 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:46.271120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178aae4-131c-48c6-a5f5-d82575e9b5d1 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:46.276449 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75281039-2bb1-40f1-a102-cf18769e48a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:46.277161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75281039-2bb1-40f1-a102-cf18769e48a5 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.277450 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75281039-2bb1-40f1-a102-cf18769e48a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.277727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75281039-2bb1-40f1-a102-cf18769e48a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.279031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75281039-2bb1-40f1-a102-cf18769e48a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:46.280999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75281039-2bb1-40f1-a102-cf18769e48a5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:46.394737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1037/2046] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:46 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:46.398527 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75281039-2bb1-40f1-a102-cf18769e48a5 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:46.400531 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-7e1a7b26-533d-43f1-a96b-ed7e0e2d3ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32891121360d48c9a17cf857ba0ffdee'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:46.413127 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-7e1a7b26-533d-43f1-a96b-ed7e0e2d3ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32891121360d48c9a17cf857ba0ffdee'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:46.420501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-7e1a7b26-533d-43f1-a96b-ed7e0e2d3ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32891121360d48c9a17cf857ba0ffdee'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:46.421278 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-7e1a7b26-533d-43f1-a96b-ed7e0e2d3ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32891121360d48c9a17cf857ba0ffdee'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:46.486138 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75281039-2bb1-40f1-a102-cf18769e48a5 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:46.491281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487fe76-7763-4e99-8cca-9410a0fc6d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:46.506911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487fe76-7763-4e99-8cca-9410a0fc6d8b admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.506911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487fe76-7763-4e99-8cca-9410a0fc6d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.506911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487fe76-7763-4e99-8cca-9410a0fc6d8b admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.506911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487fe76-7763-4e99-8cca-9410a0fc6d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:46.506911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487fe76-7763-4e99-8cca-9410a0fc6d8b admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:46.571815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-7e1a7b26-533d-43f1-a96b-ed7e0e2d3ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32891121360d48c9a17cf857ba0ffdee'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:46.579001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1010/2047] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:45 2022] DELETE /identity/v3/users/32891121360d48c9a17cf857ba0ffdee => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:46.654490 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1038/2048] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:46 2022] POST /identity/v3/users => generated 291 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:46.655793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a7b26-533d-43f1-a96b-ed7e0e2d3ea7 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:46.657209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7e1a7b26-533d-43f1-a96b-ed7e0e2d3ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:46.733168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a7b26-533d-43f1-a96b-ed7e0e2d3ea7 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:46.741670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa171c3-98d8-477e-aa2c-74f162005a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:46.741670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa171c3-98d8-477e-aa2c-74f162005a98 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.741670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa171c3-98d8-477e-aa2c-74f162005a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.741670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa171c3-98d8-477e-aa2c-74f162005a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.742016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa171c3-98d8-477e-aa2c-74f162005a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:46.742016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa171c3-98d8-477e-aa2c-74f162005a98 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:46.752140 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1011/2049] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:46.756514 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487fe76-7763-4e99-8cca-9410a0fc6d8b admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:46.767828 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487fe76-7763-4e99-8cca-9410a0fc6d8b admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:46.772713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60649fc3-a1cb-4a19-9c4a-7ea4f1b92a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:46.773377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60649fc3-a1cb-4a19-9c4a-7ea4f1b92a98 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.773664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60649fc3-a1cb-4a19-9c4a-7ea4f1b92a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.773943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60649fc3-a1cb-4a19-9c4a-7ea4f1b92a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.774671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60649fc3-a1cb-4a19-9c4a-7ea4f1b92a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:46.776306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60649fc3-a1cb-4a19-9c4a-7ea4f1b92a98 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:46.786864 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1039/2050] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:46.791351 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa171c3-98d8-477e-aa2c-74f162005a98 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:46.795105 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60649fc3-a1cb-4a19-9c4a-7ea4f1b92a98 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:46.796859 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-60649fc3-a1cb-4a19-9c4a-7ea4f1b92a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:46.801714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa171c3-98d8-477e-aa2c-74f162005a98 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:46.806355 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b651232-03c5-4d54-9f44-cdf090aad8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:46.807234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b651232-03c5-4d54-9f44-cdf090aad8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.807555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b651232-03c5-4d54-9f44-cdf090aad8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.807832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b651232-03c5-4d54-9f44-cdf090aad8f7 admin admin] PATH_INFO: `/v3/projects/37b69e24fd76468cbeff29d5765459e9/users/4b2ef9ad65d24bcca77b666d6f4690f8/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.832197 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b651232-03c5-4d54-9f44-cdf090aad8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37b69e24fd76468cbeff29d5765459e9, user_id=4b2ef9ad65d24bcca77b666d6f4690f8, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:46.835337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b651232-03c5-4d54-9f44-cdf090aad8f7 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:46.859009 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60649fc3-a1cb-4a19-9c4a-7ea4f1b92a98 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:46.863022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf3f27-9b26-4a9d-8bc6-6fc4430b2b4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:46.863705 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf3f27-9b26-4a9d-8bc6-6fc4430b2b4c service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.863991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf3f27-9b26-4a9d-8bc6-6fc4430b2b4c service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.864800 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf3f27-9b26-4a9d-8bc6-6fc4430b2b4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.866209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-84cf3f27-9b26-4a9d-8bc6-6fc4430b2b4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:46.935793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf3f27-9b26-4a9d-8bc6-6fc4430b2b4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:46.937317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf3f27-9b26-4a9d-8bc6-6fc4430b2b4c service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:46.943107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1012/2051] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:46 2022] PUT /identity/v3/projects/37b69e24fd76468cbeff29d5765459e9/users/4b2ef9ad65d24bcca77b666d6f4690f8/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:46.954749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1040/2052] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:46.959116 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4238b-c073-4578-b06a-3e323312ef17 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.959403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4238b-c073-4578-b06a-3e323312ef17 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.959710 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4238b-c073-4578-b06a-3e323312ef17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:47.002350 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-07b4238b-c073-4578-b06a-3e323312ef17 None None] MFA Rules not processed for user `4b2ef9ad65d24bcca77b666d6f4690f8`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:47.003572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-07b4238b-c073-4578-b06a-3e323312ef17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:47.067188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1013/2053] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:47.071753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf3f27-9b26-4a9d-8bc6-6fc4430b2b4c service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:47.085312 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf3f27-9b26-4a9d-8bc6-6fc4430b2b4c service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:47.087325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:47.122244 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4238b-c073-4578-b06a-3e323312ef17 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:47.123740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-07b4238b-c073-4578-b06a-3e323312ef17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:47.163965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668c047-886c-449e-82c5-c1c363b41504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:47.164617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668c047-886c-449e-82c5-c1c363b41504 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:47.164786 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668c047-886c-449e-82c5-c1c363b41504 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:47.165304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668c047-886c-449e-82c5-c1c363b41504 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:47.166696 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668c047-886c-449e-82c5-c1c363b41504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:47.168879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668c047-886c-449e-82c5-c1c363b41504 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:47.204043 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4238b-c073-4578-b06a-3e323312ef17 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:47.208871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28fb8d-2415-4360-b511-66921806fc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:47.209742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28fb8d-2415-4360-b511-66921806fc22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:47.210021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28fb8d-2415-4360-b511-66921806fc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:47.210298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28fb8d-2415-4360-b511-66921806fc22 admin admin] PATH_INFO: `/v3/projects/112e3c4633634dd4aeaece81fd2eb4f6` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:47.211560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28fb8d-2415-4360-b511-66921806fc22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=112e3c4633634dd4aeaece81fd2eb4f6)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:47.213484 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28fb8d-2415-4360-b511-66921806fc22 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:47.285348 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1041/2054] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:47 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:47.289170 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668c047-886c-449e-82c5-c1c363b41504 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:47.361949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6e28fb8d-2415-4360-b511-66921806fc22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112e3c4633634dd4aeaece81fd2eb4f6', 'request_id': 'req-6e28fb8d-2415-4360-b511-66921806fc22'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:47.369322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668c047-886c-449e-82c5-c1c363b41504 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:47.435336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae92970-6afc-4ee1-94ad-3f8cec5e849b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:47.436140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92970-6afc-4ee1-94ad-3f8cec5e849b admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:47.436586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92970-6afc-4ee1-94ad-3f8cec5e849b admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:47.436784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92970-6afc-4ee1-94ad-3f8cec5e849b admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:47.437475 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae92970-6afc-4ee1-94ad-3f8cec5e849b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:47.439421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae92970-6afc-4ee1-94ad-3f8cec5e849b admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:47.494574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6e28fb8d-2415-4360-b511-66921806fc22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112e3c4633634dd4aeaece81fd2eb4f6', 'request_id': 'req-6e28fb8d-2415-4360-b511-66921806fc22'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:47.501959 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6e28fb8d-2415-4360-b511-66921806fc22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112e3c4633634dd4aeaece81fd2eb4f6', 'request_id': 'req-6e28fb8d-2415-4360-b511-66921806fc22'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:47.513539 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6e28fb8d-2415-4360-b511-66921806fc22 admin admin] The token cache is being invalidate because project 112e3c4633634dd4aeaece81fd2eb4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:47.513831 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6e28fb8d-2415-4360-b511-66921806fc22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:47.514636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6e28fb8d-2415-4360-b511-66921806fc22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:47.516141 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1014/2055] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:47 2022] DELETE /identity/v3/projects/112e3c4633634dd4aeaece81fd2eb4f6 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:47.520938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b693a-4118-4ff2-bde3-6eba15a283c0 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:47.521343 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b693a-4118-4ff2-bde3-6eba15a283c0 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:47.521621 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b693a-4118-4ff2-bde3-6eba15a283c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:47.540291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f94b693a-4118-4ff2-bde3-6eba15a283c0 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:47.541498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f94b693a-4118-4ff2-bde3-6eba15a283c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:47.552092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1015/2056] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:47.560506 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb8d5e-3439-43b0-9e23-5a1ae2a5b3e2 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:47.561608 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb8d5e-3439-43b0-9e23-5a1ae2a5b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:47.561608 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb8d5e-3439-43b0-9e23-5a1ae2a5b3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:47.568153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1042/2057] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:47 2022] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:47.570711 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae92970-6afc-4ee1-94ad-3f8cec5e849b admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:47.572467 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-cae92970-6afc-4ee1-94ad-3f8cec5e849b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:47.580319 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-8fcb8d5e-3439-43b0-9e23-5a1ae2a5b3e2 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:47.581506 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8fcb8d5e-3439-43b0-9e23-5a1ae2a5b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:47.586580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae92970-6afc-4ee1-94ad-3f8cec5e849b admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:47.589987 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1016/2058] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:47.592483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b693e87-b91c-4b16-9fab-f594c9c214f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:47.593259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693e87-b91c-4b16-9fab-f594c9c214f6 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:47.593626 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693e87-b91c-4b16-9fab-f594c9c214f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:47.593945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb8d5e-3439-43b0-9e23-5a1ae2a5b3e2 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:47.594055 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693e87-b91c-4b16-9fab-f594c9c214f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:47.594889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b693e87-b91c-4b16-9fab-f594c9c214f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:47.596856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b693e87-b91c-4b16-9fab-f594c9c214f6 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:47.603230 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb8d5e-3439-43b0-9e23-5a1ae2a5b3e2 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:47.608027 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce2609-63c2-49b8-a581-0c5a82829858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:47.608805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce2609-63c2-49b8-a581-0c5a82829858 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:47.609090 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce2609-63c2-49b8-a581-0c5a82829858 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:47.609413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce2609-63c2-49b8-a581-0c5a82829858 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:47.609531 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1043/2059] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:47.612183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce2609-63c2-49b8-a581-0c5a82829858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:47.612507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce2609-63c2-49b8-a581-0c5a82829858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:47.613676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b693e87-b91c-4b16-9fab-f594c9c214f6 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:47.614163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce2609-63c2-49b8-a581-0c5a82829858 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:47.623814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b693e87-b91c-4b16-9fab-f594c9c214f6 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:47.627482 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1017/2060] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:57:47.631709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d4e30-7be5-4c75-9986-44a7430025e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:47.632692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4e30-7be5-4c75-9986-44a7430025e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:47.632949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4e30-7be5-4c75-9986-44a7430025e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:47.633220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4e30-7be5-4c75-9986-44a7430025e7 admin admin] PATH_INFO: `/v3/projects/e22bfb9e843f4fd287b1f270da4173e6/users/d3e0b1732834448caaaeccbed1348a4e/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:47.633822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce2609-63c2-49b8-a581-0c5a82829858 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:47.644366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce2609-63c2-49b8-a581-0c5a82829858 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:47.649004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d4e30-7be5-4c75-9986-44a7430025e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22bfb9e843f4fd287b1f270da4173e6, user_id=d3e0b1732834448caaaeccbed1348a4e, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:47.649142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16970e-db7f-43ae-a5bd-0c21f97ec8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:47.649781 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16970e-db7f-43ae-a5bd-0c21f97ec8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:47.650067 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16970e-db7f-43ae-a5bd-0c21f97ec8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:47.650345 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16970e-db7f-43ae-a5bd-0c21f97ec8f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:47.651033 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16970e-db7f-43ae-a5bd-0c21f97ec8f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:47.651890 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d4e30-7be5-4c75-9986-44a7430025e7 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:47.653143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16970e-db7f-43ae-a5bd-0c21f97ec8f4 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:47.780185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1044/2061] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:47 2022] PUT /identity/v3/projects/e22bfb9e843f4fd287b1f270da4173e6/users/d3e0b1732834448caaaeccbed1348a4e/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:47.783949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d4e30-7be5-4c75-9986-44a7430025e7 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:47.830270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1018/2062] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:47 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:47.833651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16970e-db7f-43ae-a5bd-0c21f97ec8f4 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:47.850145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d4e30-7be5-4c75-9986-44a7430025e7 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:47.904706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16970e-db7f-43ae-a5bd-0c21f97ec8f4 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:47.907358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a3ab4-759c-4a9f-96a2-b4fa34d77141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:47.908141 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3ab4-759c-4a9f-96a2-b4fa34d77141 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:47.908426 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3ab4-759c-4a9f-96a2-b4fa34d77141 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:47.908701 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3ab4-759c-4a9f-96a2-b4fa34d77141 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:47.909481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a3ab4-759c-4a9f-96a2-b4fa34d77141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:47.909864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b1100-9f08-4839-96cf-b2ff95948cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:47.910525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b1100-9f08-4839-96cf-b2ff95948cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:47.910849 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b1100-9f08-4839-96cf-b2ff95948cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:47.911125 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b1100-9f08-4839-96cf-b2ff95948cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:47.911219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a3ab4-759c-4a9f-96a2-b4fa34d77141 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:47.911871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b1100-9f08-4839-96cf-b2ff95948cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:47.913769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b1100-9f08-4839-96cf-b2ff95948cf4 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:47.921323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1045/2063] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:47.925361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a3ab4-759c-4a9f-96a2-b4fa34d77141 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:47.934996 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a3ab4-759c-4a9f-96a2-b4fa34d77141 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:47.940363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9837afb-6417-4ba7-8af4-870552ab04b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:47.940561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837afb-6417-4ba7-8af4-870552ab04b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:47.940836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837afb-6417-4ba7-8af4-870552ab04b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:47.941111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837afb-6417-4ba7-8af4-870552ab04b6 admin admin] PATH_INFO: `/v3/projects/e22bfb9e843f4fd287b1f270da4173e6/users/d3e0b1732834448caaaeccbed1348a4e/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:47.943108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9837afb-6417-4ba7-8af4-870552ab04b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22bfb9e843f4fd287b1f270da4173e6, user_id=d3e0b1732834448caaaeccbed1348a4e, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:47.945826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9837afb-6417-4ba7-8af4-870552ab04b6 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:47.957133 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1046/2064] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:47 2022] PUT /identity/v3/projects/e22bfb9e843f4fd287b1f270da4173e6/users/d3e0b1732834448caaaeccbed1348a4e/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:47.967802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd665e-2f28-467c-ad0a-81912a2dbb72 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:47.968095 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd665e-2f28-467c-ad0a-81912a2dbb72 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:47.973472 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd665e-2f28-467c-ad0a-81912a2dbb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:47.994541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-cbdd665e-2f28-467c-ad0a-81912a2dbb72 None None] MFA Rules not processed for user `d3e0b1732834448caaaeccbed1348a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:47.995571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-cbdd665e-2f28-467c-ad0a-81912a2dbb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:48.002397 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1019/2065] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:47 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:48.002397 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b1100-9f08-4839-96cf-b2ff95948cf4 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:48.013555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b1100-9f08-4839-96cf-b2ff95948cf4 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:48.071431 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1047/2066] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:48.073597 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2733356-3a05-4ca4-b4b6-bca9fbd7c837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:48.074280 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2733356-3a05-4ca4-b4b6-bca9fbd7c837 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:48.074571 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2733356-3a05-4ca4-b4b6-bca9fbd7c837 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:48.075558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2733356-3a05-4ca4-b4b6-bca9fbd7c837 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:48.076275 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2733356-3a05-4ca4-b4b6-bca9fbd7c837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:48.077880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2733356-3a05-4ca4-b4b6-bca9fbd7c837 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:48.087753 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1020/2067] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:48.091676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd665e-2f28-467c-ad0a-81912a2dbb72 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:48.101919 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd665e-2f28-467c-ad0a-81912a2dbb72 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:48.106712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a10c6-048c-456f-8990-092a3e534b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:48.107395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a10c6-048c-456f-8990-092a3e534b87 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:48.107712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a10c6-048c-456f-8990-092a3e534b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:48.107989 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a10c6-048c-456f-8990-092a3e534b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:48.108716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a10c6-048c-456f-8990-092a3e534b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:48.110334 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a10c6-048c-456f-8990-092a3e534b87 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:48.120301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1048/2068] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:48.123321 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:48.124940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2733356-3a05-4ca4-b4b6-bca9fbd7c837 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:48.134925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2733356-3a05-4ca4-b4b6-bca9fbd7c837 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:48.140349 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665a692-b125-40c6-89a3-f733e5e78a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:48.141230 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665a692-b125-40c6-89a3-f733e5e78a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:48.141514 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665a692-b125-40c6-89a3-f733e5e78a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:48.141789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665a692-b125-40c6-89a3-f733e5e78a09 admin admin] PATH_INFO: `/v3/projects/7c6193a0de5744ba88e979ce995e6895/users/856a68b9a939491c93a19be80fbd532b/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:48.157120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665a692-b125-40c6-89a3-f733e5e78a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6193a0de5744ba88e979ce995e6895, user_id=856a68b9a939491c93a19be80fbd532b, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:48.159835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665a692-b125-40c6-89a3-f733e5e78a09 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:48.173370 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a10c6-048c-456f-8990-092a3e534b87 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:48.175173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-905a10c6-048c-456f-8990-092a3e534b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:48.235865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a10c6-048c-456f-8990-092a3e534b87 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:48.239478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd4c5b-65a1-4b87-9c06-e0b8816fa4df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:48.240128 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4c5b-65a1-4b87-9c06-e0b8816fa4df service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:48.240408 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4c5b-65a1-4b87-9c06-e0b8816fa4df service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:48.240680 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4c5b-65a1-4b87-9c06-e0b8816fa4df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:48.249979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd4c5b-65a1-4b87-9c06-e0b8816fa4df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:48.251738 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd4c5b-65a1-4b87-9c06-e0b8816fa4df service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:48.261748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1049/2069] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:48.267156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1021/2070] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:48 2022] PUT /identity/v3/projects/7c6193a0de5744ba88e979ce995e6895/users/856a68b9a939491c93a19be80fbd532b/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:48.281487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efbd2e-85f8-4f6f-9137-e9e4ed9a53fa None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:48.282282 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efbd2e-85f8-4f6f-9137-e9e4ed9a53fa None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:48.282282 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efbd2e-85f8-4f6f-9137-e9e4ed9a53fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:48.322775 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-e3efbd2e-85f8-4f6f-9137-e9e4ed9a53fa None None] MFA Rules not processed for user `856a68b9a939491c93a19be80fbd532b`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:48.324163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e3efbd2e-85f8-4f6f-9137-e9e4ed9a53fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:48.401380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1050/2071] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:48.405890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665a692-b125-40c6-89a3-f733e5e78a09 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:48.516769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665a692-b125-40c6-89a3-f733e5e78a09 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:48.522920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8933fdd-e905-4b2e-8af0-aff02066c9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:48.523629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8933fdd-e905-4b2e-8af0-aff02066c9ad admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:48.523915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8933fdd-e905-4b2e-8af0-aff02066c9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:48.524190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8933fdd-e905-4b2e-8af0-aff02066c9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:48.524883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8933fdd-e905-4b2e-8af0-aff02066c9ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:48.527746 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8933fdd-e905-4b2e-8af0-aff02066c9ad admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:48.553123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efbd2e-85f8-4f6f-9137-e9e4ed9a53fa None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:48.556091 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e3efbd2e-85f8-4f6f-9137-e9e4ed9a53fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:48.575142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efbd2e-85f8-4f6f-9137-e9e4ed9a53fa None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:48.583637 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd06168-3a17-462f-be47-f3dc83d39ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:48.583637 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd06168-3a17-462f-be47-f3dc83d39ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:48.583637 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd06168-3a17-462f-be47-f3dc83d39ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:48.583637 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd06168-3a17-462f-be47-f3dc83d39ac0 admin admin] PATH_INFO: `/v3/users/9026a0b51c254fca8d82e371cb85b9f7` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:48.585501 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd06168-3a17-462f-be47-f3dc83d39ac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9026a0b51c254fca8d82e371cb85b9f7)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:48.587583 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd06168-3a17-462f-be47-f3dc83d39ac0 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:48.643681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1022/2072] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:48 2022] POST /identity/v3/projects => generated 381 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:48.648018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8933fdd-e905-4b2e-8af0-aff02066c9ad admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:48.739113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8933fdd-e905-4b2e-8af0-aff02066c9ad admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:48.744384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2c5cc-a9cc-4e67-950e-a70ffe872836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:48.745078 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2c5cc-a9cc-4e67-950e-a70ffe872836 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:48.745456 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2c5cc-a9cc-4e67-950e-a70ffe872836 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:48.745775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2c5cc-a9cc-4e67-950e-a70ffe872836 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:48.746473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2c5cc-a9cc-4e67-950e-a70ffe872836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:48.749023 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2c5cc-a9cc-4e67-950e-a70ffe872836 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:48.869972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3fd06168-3a17-462f-be47-f3dc83d39ac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9026a0b51c254fca8d82e371cb85b9f7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:48.892473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1023/2073] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:48 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:48.897215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2c5cc-a9cc-4e67-950e-a70ffe872836 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:48.910894 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2c5cc-a9cc-4e67-950e-a70ffe872836 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:48.916292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c2e31-25b3-4ac5-93f3-2e94fe791083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:48.917046 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c2e31-25b3-4ac5-93f3-2e94fe791083 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:48.917388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c2e31-25b3-4ac5-93f3-2e94fe791083 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:48.917669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c2e31-25b3-4ac5-93f3-2e94fe791083 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:48.918398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c2e31-25b3-4ac5-93f3-2e94fe791083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:48.920794 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c2e31-25b3-4ac5-93f3-2e94fe791083 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:48.931686 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1024/2074] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:48.936015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c2e31-25b3-4ac5-93f3-2e94fe791083 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:48.945920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c2e31-25b3-4ac5-93f3-2e94fe791083 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:48.950629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59cfe0-8018-408f-b9f8-5f32b7a077a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:48.951546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59cfe0-8018-408f-b9f8-5f32b7a077a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:48.951894 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59cfe0-8018-408f-b9f8-5f32b7a077a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:48.952172 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59cfe0-8018-408f-b9f8-5f32b7a077a9 admin admin] PATH_INFO: `/v3/projects/b302a76aae9f463abf6e14a53f322d10/users/aad097e9cb8049c886fa522d4d614741/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:48.960245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3fd06168-3a17-462f-be47-f3dc83d39ac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9026a0b51c254fca8d82e371cb85b9f7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:48.968316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59cfe0-8018-408f-b9f8-5f32b7a077a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b302a76aae9f463abf6e14a53f322d10, user_id=aad097e9cb8049c886fa522d4d614741, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:48.970988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59cfe0-8018-408f-b9f8-5f32b7a077a9 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:48.974471 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3fd06168-3a17-462f-be47-f3dc83d39ac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9026a0b51c254fca8d82e371cb85b9f7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:48.975258 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3fd06168-3a17-462f-be47-f3dc83d39ac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9026a0b51c254fca8d82e371cb85b9f7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:48.983036 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3fd06168-3a17-462f-be47-f3dc83d39ac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9026a0b51c254fca8d82e371cb85b9f7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:49.001236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1051/2075] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:48 2022] DELETE /identity/v3/users/9026a0b51c254fca8d82e371cb85b9f7 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:49.001596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:49.004830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefad1c6-ac02-4c09-b83b-701e919ddc4f None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:49.005243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefad1c6-ac02-4c09-b83b-701e919ddc4f None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:49.005400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefad1c6-ac02-4c09-b83b-701e919ddc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:49.025847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-eefad1c6-ac02-4c09-b83b-701e919ddc4f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:49.027035 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-eefad1c6-ac02-4c09-b83b-701e919ddc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:49.054585 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1025/2076] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:48 2022] PUT /identity/v3/projects/b302a76aae9f463abf6e14a53f322d10/users/aad097e9cb8049c886fa522d4d614741/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:49.055166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59cfe0-8018-408f-b9f8-5f32b7a077a9 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:49.058918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5e59cfe0-8018-408f-b9f8-5f32b7a077a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:49.089968 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1052/2077] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:49.089968 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefad1c6-ac02-4c09-b83b-701e919ddc4f None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:49.089968 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-eefad1c6-ac02-4c09-b83b-701e919ddc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:49.101993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefad1c6-ac02-4c09-b83b-701e919ddc4f None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:49.130367 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59cfe0-8018-408f-b9f8-5f32b7a077a9 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:49.135547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641724-13f0-4eb4-aaae-bc8bda2075b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:49.136409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641724-13f0-4eb4-aaae-bc8bda2075b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:49.136696 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641724-13f0-4eb4-aaae-bc8bda2075b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:49.136974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641724-13f0-4eb4-aaae-bc8bda2075b9 admin admin] PATH_INFO: `/v3/users/4b2ef9ad65d24bcca77b666d6f4690f8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:49.138343 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce641724-13f0-4eb4-aaae-bc8bda2075b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2ef9ad65d24bcca77b666d6f4690f8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:49.140378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce641724-13f0-4eb4-aaae-bc8bda2075b9 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:49.169943 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5346b71-63d6-43d6-ba99-19ae5908741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:49.170612 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5346b71-63d6-43d6-ba99-19ae5908741f admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:49.170891 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5346b71-63d6-43d6-ba99-19ae5908741f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:49.171181 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5346b71-63d6-43d6-ba99-19ae5908741f admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:49.171917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5346b71-63d6-43d6-ba99-19ae5908741f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:49.173514 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5346b71-63d6-43d6-ba99-19ae5908741f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:49.183696 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1053/2078] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:49.184585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5346b71-63d6-43d6-ba99-19ae5908741f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:49.186220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a5346b71-63d6-43d6-ba99-19ae5908741f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:49.243382 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5346b71-63d6-43d6-ba99-19ae5908741f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:49.247126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b6707-647b-4e44-a22a-360d7f6da87f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:49.247791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b6707-647b-4e44-a22a-360d7f6da87f service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:49.248074 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b6707-647b-4e44-a22a-360d7f6da87f service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:49.248346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b6707-647b-4e44-a22a-360d7f6da87f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:49.257840 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b6707-647b-4e44-a22a-360d7f6da87f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:49.259415 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b6707-647b-4e44-a22a-360d7f6da87f service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:49.269809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1054/2079] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:49.270455 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b6707-647b-4e44-a22a-360d7f6da87f service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:49.281598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b6707-647b-4e44-a22a-360d7f6da87f service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:49.302046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2f19a-8568-4c35-9ede-65be67cf5779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:49.302046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2f19a-8568-4c35-9ede-65be67cf5779 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:49.302046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2f19a-8568-4c35-9ede-65be67cf5779 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:49.302046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2f19a-8568-4c35-9ede-65be67cf5779 admin admin] PATH_INFO: `/v3/projects/b302a76aae9f463abf6e14a53f322d10/users/aad097e9cb8049c886fa522d4d614741/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:49.302379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2f19a-8568-4c35-9ede-65be67cf5779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b302a76aae9f463abf6e14a53f322d10, user_id=aad097e9cb8049c886fa522d4d614741, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:49.302379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2f19a-8568-4c35-9ede-65be67cf5779 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:49.303007 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1055/2080] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:49 2022] PUT /identity/v3/projects/b302a76aae9f463abf6e14a53f322d10/users/aad097e9cb8049c886fa522d4d614741/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:49.313110 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e0bca-4153-4154-ac21-c7e27fbe9c02 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:49.313455 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e0bca-4153-4154-ac21-c7e27fbe9c02 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:49.313742 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e0bca-4153-4154-ac21-c7e27fbe9c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:49.341700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-178e0bca-4153-4154-ac21-c7e27fbe9c02 None None] MFA Rules not processed for user `aad097e9cb8049c886fa522d4d614741`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:49.342828 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-178e0bca-4153-4154-ac21-c7e27fbe9c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:49.374636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-ce641724-13f0-4eb4-aaae-bc8bda2075b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2ef9ad65d24bcca77b666d6f4690f8'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:49.387586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-ce641724-13f0-4eb4-aaae-bc8bda2075b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2ef9ad65d24bcca77b666d6f4690f8'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:49.394623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-ce641724-13f0-4eb4-aaae-bc8bda2075b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2ef9ad65d24bcca77b666d6f4690f8'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:49.395424 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-ce641724-13f0-4eb4-aaae-bc8bda2075b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2ef9ad65d24bcca77b666d6f4690f8'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:49.422088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1056/2081] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:49.434979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e0bca-4153-4154-ac21-c7e27fbe9c02 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:49.436403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-178e0bca-4153-4154-ac21-c7e27fbe9c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:49.493306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e0bca-4153-4154-ac21-c7e27fbe9c02 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:49.499191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94025bf7-fde9-4e2a-9e9f-10fe3063b6c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:49.499667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94025bf7-fde9-4e2a-9e9f-10fe3063b6c8 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:49.500024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94025bf7-fde9-4e2a-9e9f-10fe3063b6c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:49.500420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94025bf7-fde9-4e2a-9e9f-10fe3063b6c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:49.506663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-ce641724-13f0-4eb4-aaae-bc8bda2075b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2ef9ad65d24bcca77b666d6f4690f8'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:49.509394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:49.517897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94025bf7-fde9-4e2a-9e9f-10fe3063b6c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:49.520809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94025bf7-fde9-4e2a-9e9f-10fe3063b6c8 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:49.521264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1026/2082] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:49 2022] DELETE /identity/v3/users/4b2ef9ad65d24bcca77b666d6f4690f8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:49.522737 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f444d0-8f31-4e3f-9fd1-e9b5463b16bf None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:49.523034 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f444d0-8f31-4e3f-9fd1-e9b5463b16bf None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:49.523321 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f444d0-8f31-4e3f-9fd1-e9b5463b16bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:49.535051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1057/2083] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:49.545560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f5f444d0-8f31-4e3f-9fd1-e9b5463b16bf None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:49.546793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f5f444d0-8f31-4e3f-9fd1-e9b5463b16bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:49.647037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1027/2084] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:49.668318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94025bf7-fde9-4e2a-9e9f-10fe3063b6c8 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:49.670532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-94025bf7-fde9-4e2a-9e9f-10fe3063b6c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:49.751914 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94025bf7-fde9-4e2a-9e9f-10fe3063b6c8 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:49.818646 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102257d-5127-4831-bf22-ece82b93574d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:49.819309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102257d-5127-4831-bf22-ece82b93574d service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:49.819629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102257d-5127-4831-bf22-ece82b93574d service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:49.819909 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102257d-5127-4831-bf22-ece82b93574d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:49.830714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102257d-5127-4831-bf22-ece82b93574d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:49.831791 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102257d-5127-4831-bf22-ece82b93574d service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:49.842350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1058/2085] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:49.920800 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:49.940856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f444d0-8f31-4e3f-9fd1-e9b5463b16bf None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:49.942468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f5f444d0-8f31-4e3f-9fd1-e9b5463b16bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:49.956576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f444d0-8f31-4e3f-9fd1-e9b5463b16bf None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:49.962033 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:49.963191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:49.970516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:49.970516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] PATH_INFO: `/v3/projects/974f6ff9746a48fa99da1b4705fa9616` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:49.970516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=974f6ff9746a48fa99da1b4705fa9616)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:49.970516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:50.106835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '974f6ff9746a48fa99da1b4705fa9616', 'request_id': 'req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.196588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '974f6ff9746a48fa99da1b4705fa9616', 'request_id': 'req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.206475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '974f6ff9746a48fa99da1b4705fa9616', 'request_id': 'req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.219605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] The token cache is being invalidate because project 974f6ff9746a48fa99da1b4705fa9616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:50.219930 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.220715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.222478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1028/2086] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:49 2022] DELETE /identity/v3/projects/974f6ff9746a48fa99da1b4705fa9616 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:50.226231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102257d-5127-4831-bf22-ece82b93574d service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:50.236435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102257d-5127-4831-bf22-ece82b93574d service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:50.297991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306af17a-538f-4444-ba2d-7fd828760219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:50.298861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af17a-538f-4444-ba2d-7fd828760219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:50.299161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af17a-538f-4444-ba2d-7fd828760219 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:50.299417 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af17a-538f-4444-ba2d-7fd828760219 admin admin] PATH_INFO: `/v3/users/b379e260b21f4bd1ae8b1c6a2f32911e` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:50.300755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306af17a-538f-4444-ba2d-7fd828760219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b379e260b21f4bd1ae8b1c6a2f32911e)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:50.302680 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306af17a-538f-4444-ba2d-7fd828760219 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:50.460467 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:50.462845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:50.476556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda3496-cf8b-4571-ab14-a3d0c5aaa533 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:50.481634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:50.482694 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:50.482809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:50.483014 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] PATH_INFO: `/v3/projects/37b69e24fd76468cbeff29d5765459e9` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:50.484273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37b69e24fd76468cbeff29d5765459e9)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:50.486248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:50.599287 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-306af17a-538f-4444-ba2d-7fd828760219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b379e260b21f4bd1ae8b1c6a2f32911e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.653342 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37b69e24fd76468cbeff29d5765459e9', 'request_id': 'req-a27c42f1-def6-43a6-bdd5-659240360aa8'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.725837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-306af17a-538f-4444-ba2d-7fd828760219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b379e260b21f4bd1ae8b1c6a2f32911e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.738755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-306af17a-538f-4444-ba2d-7fd828760219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b379e260b21f4bd1ae8b1c6a2f32911e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.739396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-306af17a-538f-4444-ba2d-7fd828760219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b379e260b21f4bd1ae8b1c6a2f32911e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.746266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-306af17a-538f-4444-ba2d-7fd828760219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b379e260b21f4bd1ae8b1c6a2f32911e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.752837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1059/2087] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:50 2022] DELETE /identity/v3/users/b379e260b21f4bd1ae8b1c6a2f32911e => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:50.899513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37b69e24fd76468cbeff29d5765459e9', 'request_id': 'req-a27c42f1-def6-43a6-bdd5-659240360aa8'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.900092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:50.909318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37b69e24fd76468cbeff29d5765459e9', 'request_id': 'req-a27c42f1-def6-43a6-bdd5-659240360aa8'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.926508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] The token cache is being invalidate because project 37b69e24fd76468cbeff29d5765459e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:50.926508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.926508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.926508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1029/2088] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:50 2022] DELETE /identity/v3/projects/37b69e24fd76468cbeff29d5765459e9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:50.931005 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306af17a-538f-4444-ba2d-7fd828760219 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:50.933607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-306af17a-538f-4444-ba2d-7fd828760219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:50.994560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:50.996932 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:51.054648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306af17a-538f-4444-ba2d-7fd828760219 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:51.060412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611f1e7-9965-44c0-8d6b-bf6c53ea079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:51.060961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f1e7-9965-44c0-8d6b-bf6c53ea079a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:51.061304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f1e7-9965-44c0-8d6b-bf6c53ea079a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:51.062364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f1e7-9965-44c0-8d6b-bf6c53ea079a admin admin] PATH_INFO: `/v3/users/d3e0b1732834448caaaeccbed1348a4e` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:51.063592 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611f1e7-9965-44c0-8d6b-bf6c53ea079a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3e0b1732834448caaaeccbed1348a4e)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:51.065550 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611f1e7-9965-44c0-8d6b-bf6c53ea079a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:51.081541 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c42f1-def6-43a6-bdd5-659240360aa8 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:51.149631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb798e2-7a98-4d51-86b9-66410517a470 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad097e9cb8049c886fa522d4d614741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302a76aae9f463abf6e14a53f322d10', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:51.149631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb798e2-7a98-4d51-86b9-66410517a470 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:51.149631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb798e2-7a98-4d51-86b9-66410517a470 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:51.149906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb798e2-7a98-4d51-86b9-66410517a470 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:51.149906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb798e2-7a98-4d51-86b9-66410517a470 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:51.149906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb798e2-7a98-4d51-86b9-66410517a470 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:51.150281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb798e2-7a98-4d51-86b9-66410517a470 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:51.164509 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1030/2089] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:57:51.168855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb798e2-7a98-4d51-86b9-66410517a470 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:51.179951 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb798e2-7a98-4d51-86b9-66410517a470 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:51.184915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0ff97-c353-42d8-b200-5e1643387953 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad097e9cb8049c886fa522d4d614741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302a76aae9f463abf6e14a53f322d10', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:51.185681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0ff97-c353-42d8-b200-5e1643387953 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:51.185997 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0ff97-c353-42d8-b200-5e1643387953 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:51.186284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0ff97-c353-42d8-b200-5e1643387953 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:51.187010 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0ff97-c353-42d8-b200-5e1643387953 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:51.188994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0ff97-c353-42d8-b200-5e1643387953 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:51.297187 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6611f1e7-9965-44c0-8d6b-bf6c53ea079a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3e0b1732834448caaaeccbed1348a4e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.361658 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1031/2090] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:51 2022] POST /identity/v3/projects => generated 354 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:51.362938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0ff97-c353-42d8-b200-5e1643387953 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:51.380360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6611f1e7-9965-44c0-8d6b-bf6c53ea079a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3e0b1732834448caaaeccbed1348a4e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.406805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6611f1e7-9965-44c0-8d6b-bf6c53ea079a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3e0b1732834448caaaeccbed1348a4e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.407794 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6611f1e7-9965-44c0-8d6b-bf6c53ea079a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3e0b1732834448caaaeccbed1348a4e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.424691 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6611f1e7-9965-44c0-8d6b-bf6c53ea079a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3e0b1732834448caaaeccbed1348a4e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.432074 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1060/2091] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:50 2022] DELETE /identity/v3/users/d3e0b1732834448caaaeccbed1348a4e => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:51.435755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611f1e7-9965-44c0-8d6b-bf6c53ea079a admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:51.437052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6611f1e7-9965-44c0-8d6b-bf6c53ea079a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:51.439292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0ff97-c353-42d8-b200-5e1643387953 tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:51.525201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611f1e7-9965-44c0-8d6b-bf6c53ea079a admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:51.530703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943efe06-f113-4a44-bddd-0f6649a70e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:51.532341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943efe06-f113-4a44-bddd-0f6649a70e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:51.532341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943efe06-f113-4a44-bddd-0f6649a70e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:51.532341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943efe06-f113-4a44-bddd-0f6649a70e50 admin admin] PATH_INFO: `/v3/projects/6d50f3a12a9b4d4f95c09d9ca21e2899` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:51.533779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943efe06-f113-4a44-bddd-0f6649a70e50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d50f3a12a9b4d4f95c09d9ca21e2899)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:51.534028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfc227-681a-4743-9a14-a7b37cdf52ba tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad097e9cb8049c886fa522d4d614741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302a76aae9f463abf6e14a53f322d10', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:51.536260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943efe06-f113-4a44-bddd-0f6649a70e50 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:51.544546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfc227-681a-4743-9a14-a7b37cdf52ba tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:51.544847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfc227-681a-4743-9a14-a7b37cdf52ba tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:51.546339 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfc227-681a-4743-9a14-a7b37cdf52ba tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:51.547872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfc227-681a-4743-9a14-a7b37cdf52ba tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:51.548196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfc227-681a-4743-9a14-a7b37cdf52ba tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:51.554713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfc227-681a-4743-9a14-a7b37cdf52ba tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:51.575255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1032/2092] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:57:51.623608 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfc227-681a-4743-9a14-a7b37cdf52ba tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:51.625368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-79dfc227-681a-4743-9a14-a7b37cdf52ba tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:51.638243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfc227-681a-4743-9a14-a7b37cdf52ba tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:51.643624 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad097e9cb8049c886fa522d4d614741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302a76aae9f463abf6e14a53f322d10', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:51.644640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:51.644933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:51.645213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] PATH_INFO: `/v3/projects/8c1b9a91230d4f2cb0d74c175b119230` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:51.646417 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8c1b9a91230d4f2cb0d74c175b119230)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:51.648376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:51.724666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-943efe06-f113-4a44-bddd-0f6649a70e50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d50f3a12a9b4d4f95c09d9ca21e2899', 'request_id': 'req-943efe06-f113-4a44-bddd-0f6649a70e50'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.814078 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c1b9a91230d4f2cb0d74c175b119230', 'request_id': 'req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.825473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-943efe06-f113-4a44-bddd-0f6649a70e50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d50f3a12a9b4d4f95c09d9ca21e2899', 'request_id': 'req-943efe06-f113-4a44-bddd-0f6649a70e50'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.833523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-943efe06-f113-4a44-bddd-0f6649a70e50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d50f3a12a9b4d4f95c09d9ca21e2899', 'request_id': 'req-943efe06-f113-4a44-bddd-0f6649a70e50'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.844522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-943efe06-f113-4a44-bddd-0f6649a70e50 admin admin] The token cache is being invalidate because project 6d50f3a12a9b4d4f95c09d9ca21e2899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:51.844811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-943efe06-f113-4a44-bddd-0f6649a70e50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.845493 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-943efe06-f113-4a44-bddd-0f6649a70e50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.847066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1061/2093] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:51 2022] DELETE /identity/v3/projects/6d50f3a12a9b4d4f95c09d9ca21e2899 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:51.851775 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be98446-a786-4e05-9444-a83746bad838 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:51.852072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be98446-a786-4e05-9444-a83746bad838 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:51.852354 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be98446-a786-4e05-9444-a83746bad838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:51.870596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-1be98446-a786-4e05-9444-a83746bad838 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:51.871842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1be98446-a786-4e05-9444-a83746bad838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:51.916726 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c1b9a91230d4f2cb0d74c175b119230', 'request_id': 'req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.924715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c1b9a91230d4f2cb0d74c175b119230', 'request_id': 'req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.939357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] The token cache is being invalidate because project 8c1b9a91230d4f2cb0d74c175b119230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:51.939826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.940736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e6bacec3-43d9-4f7d-8fa4-4cb3f916e6ab tempest-VolumeQuotaClassesTest-1041503285 tempest-VolumeQuotaClassesTest-1041503285-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.942550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1033/2094] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:51 2022] DELETE /identity/v3/projects/8c1b9a91230d4f2cb0d74c175b119230 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:51.962056 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1062/2095] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:51.970069 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaf7ea-36c6-4d28-bf6d-89823357ab83 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:51.971160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaf7ea-36c6-4d28-bf6d-89823357ab83 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:51.971445 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaf7ea-36c6-4d28-bf6d-89823357ab83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:51.995776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be98446-a786-4e05-9444-a83746bad838 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.001800 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1be98446-a786-4e05-9444-a83746bad838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:52.005378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-80eaf7ea-36c6-4d28-bf6d-89823357ab83 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:52.006913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-80eaf7ea-36c6-4d28-bf6d-89823357ab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:52.016963 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be98446-a786-4e05-9444-a83746bad838 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.024164 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1034/2096] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:52.024870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.024870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.024870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.024870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f admin admin] PATH_INFO: `/v3/projects/e22bfb9e843f4fd287b1f270da4173e6` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.026118 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22bfb9e843f4fd287b1f270da4173e6)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.028535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.031050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaf7ea-36c6-4d28-bf6d-89823357ab83 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.049612 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaf7ea-36c6-4d28-bf6d-89823357ab83 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.055568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cac2-c505-4c57-ad3d-ae729ec36ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.056372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cac2-c505-4c57-ad3d-ae729ec36ffc admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.057145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cac2-c505-4c57-ad3d-ae729ec36ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.057399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cac2-c505-4c57-ad3d-ae729ec36ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.059354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850cac2-c505-4c57-ad3d-ae729ec36ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:52.060037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850cac2-c505-4c57-ad3d-ae729ec36ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.072111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850cac2-c505-4c57-ad3d-ae729ec36ffc admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.079485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1035/2097] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:52.082029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cac2-c505-4c57-ad3d-ae729ec36ffc admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.093067 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cac2-c505-4c57-ad3d-ae729ec36ffc admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.101886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798fb5b-93eb-4bdf-b87a-90c8eb29605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.101886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798fb5b-93eb-4bdf-b87a-90c8eb29605e admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.101886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798fb5b-93eb-4bdf-b87a-90c8eb29605e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.101886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798fb5b-93eb-4bdf-b87a-90c8eb29605e admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.102216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798fb5b-93eb-4bdf-b87a-90c8eb29605e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.103234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798fb5b-93eb-4bdf-b87a-90c8eb29605e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.156046 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:52.203973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1036/2098] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:52 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:52.208684 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798fb5b-93eb-4bdf-b87a-90c8eb29605e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.215224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22bfb9e843f4fd287b1f270da4173e6', 'request_id': 'req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:52.281013 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798fb5b-93eb-4bdf-b87a-90c8eb29605e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.286046 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e739cc5-c9be-4490-af57-19fbf4adf4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.286709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e739cc5-c9be-4490-af57-19fbf4adf4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.286979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e739cc5-c9be-4490-af57-19fbf4adf4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.287680 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e739cc5-c9be-4490-af57-19fbf4adf4b2 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.287963 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e739cc5-c9be-4490-af57-19fbf4adf4b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.290156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e739cc5-c9be-4490-af57-19fbf4adf4b2 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.311786 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22bfb9e843f4fd287b1f270da4173e6', 'request_id': 'req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:52.318610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22bfb9e843f4fd287b1f270da4173e6', 'request_id': 'req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:52.329248 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f admin admin] The token cache is being invalidate because project e22bfb9e843f4fd287b1f270da4173e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:52.329539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:52.330227 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-73f3e3ea-c169-477f-8ad6-4bad0e4e0f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:52.331825 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1063/2099] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:51 2022] DELETE /identity/v3/projects/e22bfb9e843f4fd287b1f270da4173e6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:52.336419 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f39ff-e787-4ab2-ad1d-d7135232bee3 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.336709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f39ff-e787-4ab2-ad1d-d7135232bee3 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.336991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f39ff-e787-4ab2-ad1d-d7135232bee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.355200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-e68f39ff-e787-4ab2-ad1d-d7135232bee3 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:52.356418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e68f39ff-e787-4ab2-ad1d-d7135232bee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:52.365339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1064/2100] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:52.372456 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57668e92-a69c-4323-a5ae-4465b69d95c2 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.372759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57668e92-a69c-4323-a5ae-4465b69d95c2 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.373084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57668e92-a69c-4323-a5ae-4465b69d95c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.391052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-57668e92-a69c-4323-a5ae-4465b69d95c2 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:52.392271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-57668e92-a69c-4323-a5ae-4465b69d95c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:52.399912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1065/2101] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:52.403857 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57668e92-a69c-4323-a5ae-4465b69d95c2 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.409063 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1037/2102] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:52 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:52.413052 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e739cc5-c9be-4490-af57-19fbf4adf4b2 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.413196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57668e92-a69c-4323-a5ae-4465b69d95c2 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.414768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7e739cc5-c9be-4490-af57-19fbf4adf4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:52.417897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d1cb3-12e1-4034-b6bf-e8d21aff1fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.418542 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d1cb3-12e1-4034-b6bf-e8d21aff1fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.418820 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d1cb3-12e1-4034-b6bf-e8d21aff1fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.419092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d1cb3-12e1-4034-b6bf-e8d21aff1fe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.420351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d1cb3-12e1-4034-b6bf-e8d21aff1fe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:52.420660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d1cb3-12e1-4034-b6bf-e8d21aff1fe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.422262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d1cb3-12e1-4034-b6bf-e8d21aff1fe6 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.427505 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e739cc5-c9be-4490-af57-19fbf4adf4b2 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.434983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1066/2103] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:57:52.435084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5d8de-8e09-4e19-a36a-89123dc8ffad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.435084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5d8de-8e09-4e19-a36a-89123dc8ffad admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.435267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5d8de-8e09-4e19-a36a-89123dc8ffad admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.436238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5d8de-8e09-4e19-a36a-89123dc8ffad admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.436757 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5d8de-8e09-4e19-a36a-89123dc8ffad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.438399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5d8de-8e09-4e19-a36a-89123dc8ffad admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.438951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d1cb3-12e1-4034-b6bf-e8d21aff1fe6 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.450622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1038/2104] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:52.454764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5d8de-8e09-4e19-a36a-89123dc8ffad admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.461384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d1cb3-12e1-4034-b6bf-e8d21aff1fe6 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.465919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5d8de-8e09-4e19-a36a-89123dc8ffad admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.466149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c3edc-19e7-4ad5-9dd5-db9e559471d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.467491 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c3edc-19e7-4ad5-9dd5-db9e559471d0 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.467693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c3edc-19e7-4ad5-9dd5-db9e559471d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.467966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c3edc-19e7-4ad5-9dd5-db9e559471d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.468647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c3edc-19e7-4ad5-9dd5-db9e559471d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.471098 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c3edc-19e7-4ad5-9dd5-db9e559471d0 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.472226 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0191c9-0564-4f30-b984-f712abccd971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.472879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0191c9-0564-4f30-b984-f712abccd971 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.473161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0191c9-0564-4f30-b984-f712abccd971 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.473436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0191c9-0564-4f30-b984-f712abccd971 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.474291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0191c9-0564-4f30-b984-f712abccd971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.476051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0191c9-0564-4f30-b984-f712abccd971 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.487548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1039/2105] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:52.492256 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0191c9-0564-4f30-b984-f712abccd971 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.503723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0191c9-0564-4f30-b984-f712abccd971 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.508851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fa788-9939-44f3-ba08-5a9a64ccb90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.509854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fa788-9939-44f3-ba08-5a9a64ccb90b admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.510245 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fa788-9939-44f3-ba08-5a9a64ccb90b admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.510629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fa788-9939-44f3-ba08-5a9a64ccb90b admin admin] PATH_INFO: `/v3/projects/bd67a169bb5b461b991ca4da53ba0bf8/users/9d0edfde83a640d1875ea4924dd83dfc/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.527682 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fa788-9939-44f3-ba08-5a9a64ccb90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd67a169bb5b461b991ca4da53ba0bf8, user_id=9d0edfde83a640d1875ea4924dd83dfc, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.530399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fa788-9939-44f3-ba08-5a9a64ccb90b admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.633125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1067/2106] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:52 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:52.637210 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c3edc-19e7-4ad5-9dd5-db9e559471d0 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.687925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1040/2107] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:52 2022] PUT /identity/v3/projects/bd67a169bb5b461b991ca4da53ba0bf8/users/9d0edfde83a640d1875ea4924dd83dfc/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:52.702241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d68ad5-829e-4c97-8c0f-d52a10b0488d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.702943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d68ad5-829e-4c97-8c0f-d52a10b0488d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.703730 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c3edc-19e7-4ad5-9dd5-db9e559471d0 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.703970 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d68ad5-829e-4c97-8c0f-d52a10b0488d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.736781 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-21d68ad5-829e-4c97-8c0f-d52a10b0488d None None] MFA Rules not processed for user `9d0edfde83a640d1875ea4924dd83dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:52.737590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-21d68ad5-829e-4c97-8c0f-d52a10b0488d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:52.770640 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c90458-76d2-4ec5-93b7-5a057c5c7e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.771312 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c90458-76d2-4ec5-93b7-5a057c5c7e7a admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.771631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c90458-76d2-4ec5-93b7-5a057c5c7e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.771908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c90458-76d2-4ec5-93b7-5a057c5c7e7a admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.772592 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c90458-76d2-4ec5-93b7-5a057c5c7e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.774504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c90458-76d2-4ec5-93b7-5a057c5c7e7a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.805116 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1041/2108] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:52.816606 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d68ad5-829e-4c97-8c0f-d52a10b0488d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.817956 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-21d68ad5-829e-4c97-8c0f-d52a10b0488d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:52.874609 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d68ad5-829e-4c97-8c0f-d52a10b0488d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.878386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b88d4-01c7-4cb5-9619-a6072081ad41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be4de0fa80784de1acfcd47a2b77d9ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.879019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b88d4-01c7-4cb5-9619-a6072081ad41 service glance] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.879592 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b88d4-01c7-4cb5-9619-a6072081ad41 service glance] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.879866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b88d4-01c7-4cb5-9619-a6072081ad41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.888359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b88d4-01c7-4cb5-9619-a6072081ad41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.890701 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b88d4-01c7-4cb5-9619-a6072081ad41 service glance] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.901102 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1068/2109] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:52 2022] POST /identity/v3/users => generated 292 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:52.901208 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1042/2110] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:52.904522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c90458-76d2-4ec5-93b7-5a057c5c7e7a admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.911070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b88d4-01c7-4cb5-9619-a6072081ad41 service glance] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.913122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-de1b88d4-01c7-4cb5-9619-a6072081ad41 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:52.919518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c90458-76d2-4ec5-93b7-5a057c5c7e7a admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.925481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ba571-0c65-4011-8d86-1fef63464574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.926370 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ba571-0c65-4011-8d86-1fef63464574 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.926692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ba571-0c65-4011-8d86-1fef63464574 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.927077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ba571-0c65-4011-8d86-1fef63464574 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.927987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ba571-0c65-4011-8d86-1fef63464574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.929755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ba571-0c65-4011-8d86-1fef63464574 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.932448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b88d4-01c7-4cb5-9619-a6072081ad41 service glance] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.938022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff10ac-23bd-4ae3-9ce7-2ab84e79c33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.939012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff10ac-23bd-4ae3-9ce7-2ab84e79c33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.939348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff10ac-23bd-4ae3-9ce7-2ab84e79c33e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.939713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff10ac-23bd-4ae3-9ce7-2ab84e79c33e admin admin] PATH_INFO: `/v3/users/856a68b9a939491c93a19be80fbd532b` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.940991 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff10ac-23bd-4ae3-9ce7-2ab84e79c33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=856a68b9a939491c93a19be80fbd532b)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.941465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1069/2111] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:52.943151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff10ac-23bd-4ae3-9ce7-2ab84e79c33e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.949392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ba571-0c65-4011-8d86-1fef63464574 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.963090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ba571-0c65-4011-8d86-1fef63464574 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.969621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06cbaf-2143-47ac-9b71-e7e0bfdda92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.970224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06cbaf-2143-47ac-9b71-e7e0bfdda92c admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.970665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06cbaf-2143-47ac-9b71-e7e0bfdda92c admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.970823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06cbaf-2143-47ac-9b71-e7e0bfdda92c admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.971594 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06cbaf-2143-47ac-9b71-e7e0bfdda92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.973244 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06cbaf-2143-47ac-9b71-e7e0bfdda92c admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.986521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1070/2112] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:52.995516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06cbaf-2143-47ac-9b71-e7e0bfdda92c admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:53.007502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06cbaf-2143-47ac-9b71-e7e0bfdda92c admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:53.012974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d48f1-0821-4e21-9016-edbd1382e055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:53.015856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:53.016424 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d48f1-0821-4e21-9016-edbd1382e055 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:53.016865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d48f1-0821-4e21-9016-edbd1382e055 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:53.017144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d48f1-0821-4e21-9016-edbd1382e055 admin admin] PATH_INFO: `/v3/projects/1303123c4695456db924cf14ff85d422/users/b1015872175647b4a6cd4c41b36d7bb2/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:53.033375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d48f1-0821-4e21-9016-edbd1382e055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1303123c4695456db924cf14ff85d422, user_id=b1015872175647b4a6cd4c41b36d7bb2, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:53.036121 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d48f1-0821-4e21-9016-edbd1382e055 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:53.125263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1071/2113] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:52 2022] PUT /identity/v3/projects/1303123c4695456db924cf14ff85d422/users/b1015872175647b4a6cd4c41b36d7bb2/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:53.139142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4df182-27f0-4a3d-b245-be1eb6ee9000 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:53.139436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4df182-27f0-4a3d-b245-be1eb6ee9000 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:53.139763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4df182-27f0-4a3d-b245-be1eb6ee9000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:53.180700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-13ff10ac-23bd-4ae3-9ce7-2ab84e79c33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '856a68b9a939491c93a19be80fbd532b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:53.194626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-13ff10ac-23bd-4ae3-9ce7-2ab84e79c33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '856a68b9a939491c93a19be80fbd532b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:53.203149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ef4df182-27f0-4a3d-b245-be1eb6ee9000 None None] MFA Rules not processed for user `b1015872175647b4a6cd4c41b36d7bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:53.204433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-13ff10ac-23bd-4ae3-9ce7-2ab84e79c33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '856a68b9a939491c93a19be80fbd532b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:53.204730 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ef4df182-27f0-4a3d-b245-be1eb6ee9000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:53.209789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-13ff10ac-23bd-4ae3-9ce7-2ab84e79c33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '856a68b9a939491c93a19be80fbd532b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:53.302308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-13ff10ac-23bd-4ae3-9ce7-2ab84e79c33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '856a68b9a939491c93a19be80fbd532b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:53.311740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1043/2114] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:52 2022] DELETE /identity/v3/users/856a68b9a939491c93a19be80fbd532b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:53.311740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff10ac-23bd-4ae3-9ce7-2ab84e79c33e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:53.317625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-13ff10ac-23bd-4ae3-9ce7-2ab84e79c33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:53.319701 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1072/2115] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:53.323129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349c199-31f2-41fd-9518-ad323cfaaacb None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:53.323598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349c199-31f2-41fd-9518-ad323cfaaacb None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:53.324153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349c199-31f2-41fd-9518-ad323cfaaacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:53.350648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-1349c199-31f2-41fd-9518-ad323cfaaacb None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:53.351941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1349c199-31f2-41fd-9518-ad323cfaaacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:53.408679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff10ac-23bd-4ae3-9ce7-2ab84e79c33e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:53.415833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a3c29-a2cb-475b-86b3-fded38883a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:53.416724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a3c29-a2cb-475b-86b3-fded38883a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:53.420805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a3c29-a2cb-475b-86b3-fded38883a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:53.420805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a3c29-a2cb-475b-86b3-fded38883a53 admin admin] PATH_INFO: `/v3/users/232e7593ef8f457389be4f6fb53f6068` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:53.420805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a3c29-a2cb-475b-86b3-fded38883a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=232e7593ef8f457389be4f6fb53f6068)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:53.421261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a3c29-a2cb-475b-86b3-fded38883a53 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:53.428792 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1073/2116] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:53.429487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349c199-31f2-41fd-9518-ad323cfaaacb None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:53.430833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1349c199-31f2-41fd-9518-ad323cfaaacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:53.443558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349c199-31f2-41fd-9518-ad323cfaaacb None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:53.449149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f89e5e-25cf-4ef5-a35c-c435220ce43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:53.449876 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89e5e-25cf-4ef5-a35c-c435220ce43d admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:53.450166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89e5e-25cf-4ef5-a35c-c435220ce43d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:53.450440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89e5e-25cf-4ef5-a35c-c435220ce43d admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:53.451165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f89e5e-25cf-4ef5-a35c-c435220ce43d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:53.453173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f89e5e-25cf-4ef5-a35c-c435220ce43d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:53.604201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1074/2117] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:53 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:53.604912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f89e5e-25cf-4ef5-a35c-c435220ce43d admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:53.606661 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e4f89e5e-25cf-4ef5-a35c-c435220ce43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:53.669117 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f89e5e-25cf-4ef5-a35c-c435220ce43d admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:53.674904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726514e3-3686-4b61-8dc7-c41bd9a5b1b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:53.674904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726514e3-3686-4b61-8dc7-c41bd9a5b1b4 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:53.674904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726514e3-3686-4b61-8dc7-c41bd9a5b1b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:53.675366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726514e3-3686-4b61-8dc7-c41bd9a5b1b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:53.700552 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:53.720139 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c64a3c29-a2cb-475b-86b3-fded38883a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '232e7593ef8f457389be4f6fb53f6068'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:53.733314 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c64a3c29-a2cb-475b-86b3-fded38883a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '232e7593ef8f457389be4f6fb53f6068'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:53.740401 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c64a3c29-a2cb-475b-86b3-fded38883a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '232e7593ef8f457389be4f6fb53f6068'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:53.741027 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c64a3c29-a2cb-475b-86b3-fded38883a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '232e7593ef8f457389be4f6fb53f6068'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:53.742706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726514e3-3686-4b61-8dc7-c41bd9a5b1b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:53.744214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726514e3-3686-4b61-8dc7-c41bd9a5b1b4 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:53.754026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1075/2118] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:53.755258 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726514e3-3686-4b61-8dc7-c41bd9a5b1b4 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:53.766130 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726514e3-3686-4b61-8dc7-c41bd9a5b1b4 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:53.772865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5ce9a-ae2b-4e51-aab4-5279af38c63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:53.772865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5ce9a-ae2b-4e51-aab4-5279af38c63d admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:53.772865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5ce9a-ae2b-4e51-aab4-5279af38c63d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:53.773275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5ce9a-ae2b-4e51-aab4-5279af38c63d admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:53.773617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5ce9a-ae2b-4e51-aab4-5279af38c63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:53.775650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5ce9a-ae2b-4e51-aab4-5279af38c63d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:53.885448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c64a3c29-a2cb-475b-86b3-fded38883a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '232e7593ef8f457389be4f6fb53f6068'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:53.892425 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1044/2119] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:53 2022] DELETE /identity/v3/users/232e7593ef8f457389be4f6fb53f6068 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:53.896715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de3638-51b8-47a1-b921-58d1a3cd5411 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:53.897001 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de3638-51b8-47a1-b921-58d1a3cd5411 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:53.897278 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de3638-51b8-47a1-b921-58d1a3cd5411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:53.916195 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-11de3638-51b8-47a1-b921-58d1a3cd5411 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:53.917928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-11de3638-51b8-47a1-b921-58d1a3cd5411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:53.921408 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1076/2120] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:53 2022] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:53.925748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5ce9a-ae2b-4e51-aab4-5279af38c63d admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:53.928256 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-19f5ce9a-ae2b-4e51-aab4-5279af38c63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:53.940308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5ce9a-ae2b-4e51-aab4-5279af38c63d admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:53.996131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1045/2121] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:54.008185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de3638-51b8-47a1-b921-58d1a3cd5411 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:54.009714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-11de3638-51b8-47a1-b921-58d1a3cd5411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:54.020328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6587cf3-53a0-47c6-ba29-b3f5f5546e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:54.021482 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6587cf3-53a0-47c6-ba29-b3f5f5546e96 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:54.021482 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6587cf3-53a0-47c6-ba29-b3f5f5546e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:54.021706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6587cf3-53a0-47c6-ba29-b3f5f5546e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:54.022457 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6587cf3-53a0-47c6-ba29-b3f5f5546e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:54.024356 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6587cf3-53a0-47c6-ba29-b3f5f5546e96 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:54.035496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1077/2122] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:54.039896 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6587cf3-53a0-47c6-ba29-b3f5f5546e96 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:54.049983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6587cf3-53a0-47c6-ba29-b3f5f5546e96 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:54.055226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7db6d6-e155-450e-b50a-713adb0426e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:54.056270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7db6d6-e155-450e-b50a-713adb0426e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:54.056668 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7db6d6-e155-450e-b50a-713adb0426e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:54.057042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7db6d6-e155-450e-b50a-713adb0426e9 admin admin] PATH_INFO: `/v3/projects/95afbe1ec815442cb8f3bb215857e5cc/users/3e1140946a324714b44117a755e6cd81/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:54.081719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7db6d6-e155-450e-b50a-713adb0426e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95afbe1ec815442cb8f3bb215857e5cc, user_id=3e1140946a324714b44117a755e6cd81, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:54.083768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de3638-51b8-47a1-b921-58d1a3cd5411 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:54.084503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7db6d6-e155-450e-b50a-713adb0426e9 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:54.096190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836556e-ab1a-410f-b110-f64f37865c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:54.097897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836556e-ab1a-410f-b110-f64f37865c25 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:54.098240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836556e-ab1a-410f-b110-f64f37865c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:54.099020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836556e-ab1a-410f-b110-f64f37865c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:54.109746 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836556e-ab1a-410f-b110-f64f37865c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:54.111405 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836556e-ab1a-410f-b110-f64f37865c25 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:54.128028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1046/2123] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:54.158924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1078/2124] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:54 2022] PUT /identity/v3/projects/95afbe1ec815442cb8f3bb215857e5cc/users/3e1140946a324714b44117a755e6cd81/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:54.162824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836556e-ab1a-410f-b110-f64f37865c25 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:54.173899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836556e-ab1a-410f-b110-f64f37865c25 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:54.223582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7db6d6-e155-450e-b50a-713adb0426e9 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:54.227743 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8e7db6d6-e155-450e-b50a-713adb0426e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:54.259303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79f44d-f670-4e9c-accf-73bedb46788a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:54.260084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79f44d-f670-4e9c-accf-73bedb46788a admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:54.260371 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79f44d-f670-4e9c-accf-73bedb46788a admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:54.260650 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79f44d-f670-4e9c-accf-73bedb46788a admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:54.261572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79f44d-f670-4e9c-accf-73bedb46788a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:54.263297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79f44d-f670-4e9c-accf-73bedb46788a admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:54.293700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1047/2125] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:54.299373 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79f44d-f670-4e9c-accf-73bedb46788a admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:54.314086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79f44d-f670-4e9c-accf-73bedb46788a admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:54.321235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2237f-65f0-4383-b34c-e26c59d45d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:54.322097 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2237f-65f0-4383-b34c-e26c59d45d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:54.327078 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2237f-65f0-4383-b34c-e26c59d45d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:54.327078 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2237f-65f0-4383-b34c-e26c59d45d9a admin admin] PATH_INFO: `/v3/projects/95afbe1ec815442cb8f3bb215857e5cc/users/3e1140946a324714b44117a755e6cd81/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:54.327078 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2237f-65f0-4383-b34c-e26c59d45d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95afbe1ec815442cb8f3bb215857e5cc, user_id=3e1140946a324714b44117a755e6cd81, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:54.328575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2237f-65f0-4383-b34c-e26c59d45d9a admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:54.335935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7db6d6-e155-450e-b50a-713adb0426e9 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:54.339767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1048/2126] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:54 2022] PUT /identity/v3/projects/95afbe1ec815442cb8f3bb215857e5cc/users/3e1140946a324714b44117a755e6cd81/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:54.350058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c267e6-4584-45f2-b350-9b0cdf4fc1a6 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:54.350350 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c267e6-4584-45f2-b350-9b0cdf4fc1a6 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:54.350632 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c267e6-4584-45f2-b350-9b0cdf4fc1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:54.377379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-c7c267e6-4584-45f2-b350-9b0cdf4fc1a6 None None] MFA Rules not processed for user `3e1140946a324714b44117a755e6cd81`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:54.378596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c7c267e6-4584-45f2-b350-9b0cdf4fc1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:54.394935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:54.395851 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:54.396163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:54.396446 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] PATH_INFO: `/v3/projects/7c6193a0de5744ba88e979ce995e6895` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:54.397719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6193a0de5744ba88e979ce995e6895)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:54.399992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:54.447443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1049/2127] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:54.459305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c267e6-4584-45f2-b350-9b0cdf4fc1a6 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:54.460693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c7c267e6-4584-45f2-b350-9b0cdf4fc1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:54.539730 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6193a0de5744ba88e979ce995e6895', 'request_id': 'req-2b87b6ae-b7f3-440e-bade-d13861dbe19a'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:54.547133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c267e6-4584-45f2-b350-9b0cdf4fc1a6 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:54.620249 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48562708-cb2f-47a0-95d9-ebc08c7564fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:54.620898 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48562708-cb2f-47a0-95d9-ebc08c7564fb service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:54.621178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48562708-cb2f-47a0-95d9-ebc08c7564fb service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:54.621450 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48562708-cb2f-47a0-95d9-ebc08c7564fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:54.686228 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6193a0de5744ba88e979ce995e6895', 'request_id': 'req-2b87b6ae-b7f3-440e-bade-d13861dbe19a'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:54.686450 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48562708-cb2f-47a0-95d9-ebc08c7564fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:54.687945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48562708-cb2f-47a0-95d9-ebc08c7564fb service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:54.693470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6193a0de5744ba88e979ce995e6895', 'request_id': 'req-2b87b6ae-b7f3-440e-bade-d13861dbe19a'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:54.699133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1050/2128] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:54.705981 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] The token cache is being invalidate because project 7c6193a0de5744ba88e979ce995e6895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:54.706332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:54.706950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:54.708636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1079/2129] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:54 2022] DELETE /identity/v3/projects/7c6193a0de5744ba88e979ce995e6895 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:54.713395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48562708-cb2f-47a0-95d9-ebc08c7564fb service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:54.793039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48562708-cb2f-47a0-95d9-ebc08c7564fb service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:54.802451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd763804-10c5-435b-8548-5d7bfb0ee6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:54.803525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd763804-10c5-435b-8548-5d7bfb0ee6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:54.803895 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd763804-10c5-435b-8548-5d7bfb0ee6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:54.804297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd763804-10c5-435b-8548-5d7bfb0ee6ca admin admin] PATH_INFO: `/v3/users/aad097e9cb8049c886fa522d4d614741` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:54.806140 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd763804-10c5-435b-8548-5d7bfb0ee6ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad097e9cb8049c886fa522d4d614741)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:54.808478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd763804-10c5-435b-8548-5d7bfb0ee6ca admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:54.860346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:54.860346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:54.874827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87b6ae-b7f3-440e-bade-d13861dbe19a admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:54.880484 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae844f0-8873-499e-8598-5735af21f4f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:54.881303 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae844f0-8873-499e-8598-5735af21f4f0 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:54.881710 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae844f0-8873-499e-8598-5735af21f4f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:54.882312 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae844f0-8873-499e-8598-5735af21f4f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:54.884657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-aae844f0-8873-499e-8598-5735af21f4f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:54.962266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae844f0-8873-499e-8598-5735af21f4f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:54.963885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae844f0-8873-499e-8598-5735af21f4f0 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:54.975471 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1080/2130] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:55.036167 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bd763804-10c5-435b-8548-5d7bfb0ee6ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad097e9cb8049c886fa522d4d614741'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:55.053056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bd763804-10c5-435b-8548-5d7bfb0ee6ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad097e9cb8049c886fa522d4d614741'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:55.053325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae844f0-8873-499e-8598-5735af21f4f0 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:55.053325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-aae844f0-8873-499e-8598-5735af21f4f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:55.059552 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bd763804-10c5-435b-8548-5d7bfb0ee6ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad097e9cb8049c886fa522d4d614741'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:55.061006 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bd763804-10c5-435b-8548-5d7bfb0ee6ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad097e9cb8049c886fa522d4d614741'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:55.071157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae844f0-8873-499e-8598-5735af21f4f0 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:55.079130 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711ed48-48cd-4be6-a7e5-0592cd34e306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:55.080224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ed48-48cd-4be6-a7e5-0592cd34e306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:55.089034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ed48-48cd-4be6-a7e5-0592cd34e306 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:55.089034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ed48-48cd-4be6-a7e5-0592cd34e306 admin admin] PATH_INFO: `/v3/projects/c62ed18530404c009d105064e25f6bba` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:55.089034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711ed48-48cd-4be6-a7e5-0592cd34e306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c62ed18530404c009d105064e25f6bba)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:55.089034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711ed48-48cd-4be6-a7e5-0592cd34e306 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:55.149938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bd763804-10c5-435b-8548-5d7bfb0ee6ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad097e9cb8049c886fa522d4d614741'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:55.157978 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1051/2131] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:54 2022] DELETE /identity/v3/users/aad097e9cb8049c886fa522d4d614741 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:55.231344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6711ed48-48cd-4be6-a7e5-0592cd34e306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62ed18530404c009d105064e25f6bba', 'request_id': 'req-6711ed48-48cd-4be6-a7e5-0592cd34e306'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:55.363308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6711ed48-48cd-4be6-a7e5-0592cd34e306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62ed18530404c009d105064e25f6bba', 'request_id': 'req-6711ed48-48cd-4be6-a7e5-0592cd34e306'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:55.371044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6711ed48-48cd-4be6-a7e5-0592cd34e306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62ed18530404c009d105064e25f6bba', 'request_id': 'req-6711ed48-48cd-4be6-a7e5-0592cd34e306'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:55.383395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6711ed48-48cd-4be6-a7e5-0592cd34e306 admin admin] The token cache is being invalidate because project c62ed18530404c009d105064e25f6bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:55.383727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6711ed48-48cd-4be6-a7e5-0592cd34e306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:55.384915 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6711ed48-48cd-4be6-a7e5-0592cd34e306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:55.391142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1081/2132] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:55 2022] DELETE /identity/v3/projects/c62ed18530404c009d105064e25f6bba => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:55.392256 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd763804-10c5-435b-8548-5d7bfb0ee6ca admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:55.393961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-bd763804-10c5-435b-8548-5d7bfb0ee6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:55.468733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd763804-10c5-435b-8548-5d7bfb0ee6ca admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:55.522690 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:55.546209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90575b-08ee-4e0f-8e12-c2645c316893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:55.546470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90575b-08ee-4e0f-8e12-c2645c316893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:55.546693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90575b-08ee-4e0f-8e12-c2645c316893 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:55.547008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90575b-08ee-4e0f-8e12-c2645c316893 admin admin] PATH_INFO: `/v3/users/a890a411563e4df5987a54581ca6734b` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:55.548952 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90575b-08ee-4e0f-8e12-c2645c316893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a890a411563e4df5987a54581ca6734b)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:55.558416 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90575b-08ee-4e0f-8e12-c2645c316893 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:55.567890 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ed43-9081-4ef6-942e-1fead4e4a1f9 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:55.568272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ed43-9081-4ef6-942e-1fead4e4a1f9 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:55.568624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ed43-9081-4ef6-942e-1fead4e4a1f9 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:55.570457 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1082/2133] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 2 13:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:57:55.612575 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4ed43-9081-4ef6-942e-1fead4e4a1f9 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:55.617222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-dea4ed43-9081-4ef6-942e-1fead4e4a1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:55.647214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4ed43-9081-4ef6-942e-1fead4e4a1f9 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:55.652552 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d5eb8-96d8-4120-8528-bf55e4a88845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:55.653539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d5eb8-96d8-4120-8528-bf55e4a88845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:55.653899 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d5eb8-96d8-4120-8528-bf55e4a88845 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:55.654299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d5eb8-96d8-4120-8528-bf55e4a88845 admin admin] PATH_INFO: `/v3/users/b1015872175647b4a6cd4c41b36d7bb2` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:55.655697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d5eb8-96d8-4120-8528-bf55e4a88845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1015872175647b4a6cd4c41b36d7bb2)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:55.657695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d5eb8-96d8-4120-8528-bf55e4a88845 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:55.944569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-eb90575b-08ee-4e0f-8e12-c2645c316893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a890a411563e4df5987a54581ca6734b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:55.957596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-eb90575b-08ee-4e0f-8e12-c2645c316893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a890a411563e4df5987a54581ca6734b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:55.965674 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-eb90575b-08ee-4e0f-8e12-c2645c316893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a890a411563e4df5987a54581ca6734b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:55.966722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-eb90575b-08ee-4e0f-8e12-c2645c316893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a890a411563e4df5987a54581ca6734b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:55.989849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3b3d5eb8-96d8-4120-8528-bf55e4a88845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1015872175647b4a6cd4c41b36d7bb2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.039636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-eb90575b-08ee-4e0f-8e12-c2645c316893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a890a411563e4df5987a54581ca6734b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.048966 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1052/2134] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:55 2022] DELETE /identity/v3/users/a890a411563e4df5987a54581ca6734b => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:56.050539 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47784de5-04f6-496d-b5d6-2d5190495c3d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:56.050926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47784de5-04f6-496d-b5d6-2d5190495c3d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:56.066648 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47784de5-04f6-496d-b5d6-2d5190495c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:56.074757 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-47784de5-04f6-496d-b5d6-2d5190495c3d None None] MFA Rules not processed for user `b387ad13a6c843d0b9a43bc8f5f7fa13`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:56.076362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-47784de5-04f6-496d-b5d6-2d5190495c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:56.145876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1053/2135] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 2 13:57:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:56.146616 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47784de5-04f6-496d-b5d6-2d5190495c3d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:56.147990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-47784de5-04f6-496d-b5d6-2d5190495c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:56.156834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3b3d5eb8-96d8-4120-8528-bf55e4a88845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1015872175647b4a6cd4c41b36d7bb2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.173289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3b3d5eb8-96d8-4120-8528-bf55e4a88845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1015872175647b4a6cd4c41b36d7bb2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.174156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3b3d5eb8-96d8-4120-8528-bf55e4a88845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1015872175647b4a6cd4c41b36d7bb2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.183172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3b3d5eb8-96d8-4120-8528-bf55e4a88845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1015872175647b4a6cd4c41b36d7bb2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.194015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1083/2136] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:55 2022] DELETE /identity/v3/users/b1015872175647b4a6cd4c41b36d7bb2 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:56.195109 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d5eb8-96d8-4120-8528-bf55e4a88845 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:56.196908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3b3d5eb8-96d8-4120-8528-bf55e4a88845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:56.230928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47784de5-04f6-496d-b5d6-2d5190495c3d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:56.275553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d5eb8-96d8-4120-8528-bf55e4a88845 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:56.280333 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:56.281193 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:56.281546 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:56.282031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] PATH_INFO: `/v3/projects/b302a76aae9f463abf6e14a53f322d10` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:56.283289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b302a76aae9f463abf6e14a53f322d10)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:56.285288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:56.295977 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617828f-a4c7-40f9-bdc9-711e402744b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:56.295977 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617828f-a4c7-40f9-bdc9-711e402744b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:56.295977 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617828f-a4c7-40f9-bdc9-711e402744b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:56.295977 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617828f-a4c7-40f9-bdc9-711e402744b3 admin admin] PATH_INFO: `/v3/users/deaa4b41deda4b1d951765fd10ecf2a7` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:56.296596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617828f-a4c7-40f9-bdc9-711e402744b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deaa4b41deda4b1d951765fd10ecf2a7)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:56.298654 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617828f-a4c7-40f9-bdc9-711e402744b3 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:56.400492 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b302a76aae9f463abf6e14a53f322d10', 'request_id': 'req-a1066f84-d097-48ab-9df8-aad4d00b11b1'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.476548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b302a76aae9f463abf6e14a53f322d10', 'request_id': 'req-a1066f84-d097-48ab-9df8-aad4d00b11b1'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.483261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b302a76aae9f463abf6e14a53f322d10', 'request_id': 'req-a1066f84-d097-48ab-9df8-aad4d00b11b1'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.493788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] The token cache is being invalidate because project b302a76aae9f463abf6e14a53f322d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:56.494074 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.494771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.496436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1084/2137] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:56 2022] DELETE /identity/v3/projects/b302a76aae9f463abf6e14a53f322d10 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:56.497211 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:56.499185 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:56.510816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:56.526262 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a617828f-a4c7-40f9-bdc9-711e402744b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deaa4b41deda4b1d951765fd10ecf2a7'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.538881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a617828f-a4c7-40f9-bdc9-711e402744b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deaa4b41deda4b1d951765fd10ecf2a7'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.546120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a617828f-a4c7-40f9-bdc9-711e402744b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deaa4b41deda4b1d951765fd10ecf2a7'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.546941 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a617828f-a4c7-40f9-bdc9-711e402744b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deaa4b41deda4b1d951765fd10ecf2a7'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.566547 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1066f84-d097-48ab-9df8-aad4d00b11b1 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:56.571253 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dedd52-1d0e-4adc-add0-08e62fc94f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:56.572156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dedd52-1d0e-4adc-add0-08e62fc94f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:56.572461 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dedd52-1d0e-4adc-add0-08e62fc94f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:56.572738 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dedd52-1d0e-4adc-add0-08e62fc94f76 admin admin] PATH_INFO: `/v3/users/8288f45c6eae440fb4b8594b375d6400` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:56.573962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dedd52-1d0e-4adc-add0-08e62fc94f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8288f45c6eae440fb4b8594b375d6400)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:56.576559 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dedd52-1d0e-4adc-add0-08e62fc94f76 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:56.636139 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a617828f-a4c7-40f9-bdc9-711e402744b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deaa4b41deda4b1d951765fd10ecf2a7'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.643857 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1054/2138] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:56 2022] DELETE /identity/v3/users/deaa4b41deda4b1d951765fd10ecf2a7 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:56.645315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617828f-a4c7-40f9-bdc9-711e402744b3 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:56.647119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a617828f-a4c7-40f9-bdc9-711e402744b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:56.716690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617828f-a4c7-40f9-bdc9-711e402744b3 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:56.721978 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdb7b1-4194-4348-88ff-f4baecd8c85f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:56.722657 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb7b1-4194-4348-88ff-f4baecd8c85f service placement] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:56.722939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb7b1-4194-4348-88ff-f4baecd8c85f service placement] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:56.723215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb7b1-4194-4348-88ff-f4baecd8c85f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:56.725142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-fecdb7b1-4194-4348-88ff-f4baecd8c85f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:56.737237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdb7b1-4194-4348-88ff-f4baecd8c85f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:56.739164 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdb7b1-4194-4348-88ff-f4baecd8c85f service placement] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:56.749882 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1055/2139] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:56.751522 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25c9c7-e407-42db-8f8b-cacd6debd87b None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:56.751917 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25c9c7-e407-42db-8f8b-cacd6debd87b None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:56.752111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25c9c7-e407-42db-8f8b-cacd6debd87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:56.770434 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-5a25c9c7-e407-42db-8f8b-cacd6debd87b None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:56.771659 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5a25c9c7-e407-42db-8f8b-cacd6debd87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:56.792126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4dedd52-1d0e-4adc-add0-08e62fc94f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8288f45c6eae440fb4b8594b375d6400'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.832114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1056/2140] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:56.833414 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7ac2c-8738-4dc7-8c41-9b0680871c83 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:56.833696 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7ac2c-8738-4dc7-8c41-9b0680871c83 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:56.833994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7ac2c-8738-4dc7-8c41-9b0680871c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:56.853903 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-78a7ac2c-8738-4dc7-8c41-9b0680871c83 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:56.855109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-78a7ac2c-8738-4dc7-8c41-9b0680871c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:56.863592 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1057/2141] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:56.864352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7ac2c-8738-4dc7-8c41-9b0680871c83 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:56.865563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-78a7ac2c-8738-4dc7-8c41-9b0680871c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:56.877402 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7ac2c-8738-4dc7-8c41-9b0680871c83 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:56.879892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4dedd52-1d0e-4adc-add0-08e62fc94f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8288f45c6eae440fb4b8594b375d6400'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.882642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0d991-8970-4079-b2c0-3c655456f566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:56.883506 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0d991-8970-4079-b2c0-3c655456f566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:56.883798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0d991-8970-4079-b2c0-3c655456f566 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:56.887777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0d991-8970-4079-b2c0-3c655456f566 admin admin] PATH_INFO: `/v3/projects/2f808073f738410f954a1c7f0f6d8f83` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:56.889263 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0d991-8970-4079-b2c0-3c655456f566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f808073f738410f954a1c7f0f6d8f83)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:56.891258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0d991-8970-4079-b2c0-3c655456f566 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:56.893181 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4dedd52-1d0e-4adc-add0-08e62fc94f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8288f45c6eae440fb4b8594b375d6400'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.893897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4dedd52-1d0e-4adc-add0-08e62fc94f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8288f45c6eae440fb4b8594b375d6400'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.900725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4dedd52-1d0e-4adc-add0-08e62fc94f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8288f45c6eae440fb4b8594b375d6400'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:56.906714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1085/2142] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:56 2022] DELETE /identity/v3/users/8288f45c6eae440fb4b8594b375d6400 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:56.910825 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd4fac-0ffd-4c4a-95d3-743bbcc71ed2 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:56.911295 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd4fac-0ffd-4c4a-95d3-743bbcc71ed2 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:56.911606 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd4fac-0ffd-4c4a-95d3-743bbcc71ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:56.930331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-39cd4fac-0ffd-4c4a-95d3-743bbcc71ed2 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:56.931591 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-39cd4fac-0ffd-4c4a-95d3-743bbcc71ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:56.991403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1086/2143] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:56.992521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd4fac-0ffd-4c4a-95d3-743bbcc71ed2 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:56.994099 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-39cd4fac-0ffd-4c4a-95d3-743bbcc71ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:57.015379 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-dad0d991-8970-4079-b2c0-3c655456f566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f808073f738410f954a1c7f0f6d8f83', 'request_id': 'req-dad0d991-8970-4079-b2c0-3c655456f566'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.060761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd4fac-0ffd-4c4a-95d3-743bbcc71ed2 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:57.104783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-dad0d991-8970-4079-b2c0-3c655456f566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f808073f738410f954a1c7f0f6d8f83', 'request_id': 'req-dad0d991-8970-4079-b2c0-3c655456f566'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.112030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041267eb-9971-4538-b4f4-6c7a5b1bf4f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:57.112175 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-dad0d991-8970-4079-b2c0-3c655456f566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f808073f738410f954a1c7f0f6d8f83', 'request_id': 'req-dad0d991-8970-4079-b2c0-3c655456f566'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.112687 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041267eb-9971-4538-b4f4-6c7a5b1bf4f6 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:57.112973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041267eb-9971-4538-b4f4-6c7a5b1bf4f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:57.113252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041267eb-9971-4538-b4f4-6c7a5b1bf4f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:57.115054 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-041267eb-9971-4538-b4f4-6c7a5b1bf4f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:57.123203 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-dad0d991-8970-4079-b2c0-3c655456f566 admin admin] The token cache is being invalidate because project 2f808073f738410f954a1c7f0f6d8f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:57.123573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-dad0d991-8970-4079-b2c0-3c655456f566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.124537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-dad0d991-8970-4079-b2c0-3c655456f566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.126758 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1058/2144] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:56 2022] DELETE /identity/v3/projects/2f808073f738410f954a1c7f0f6d8f83 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:57.127932 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092989b-f245-4078-b107-2ba4c2d336d4 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:57.128202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092989b-f245-4078-b107-2ba4c2d336d4 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:57.128480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092989b-f245-4078-b107-2ba4c2d336d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:57.146898 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-7092989b-f245-4078-b107-2ba4c2d336d4 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:57.148145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7092989b-f245-4078-b107-2ba4c2d336d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:57.180558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041267eb-9971-4538-b4f4-6c7a5b1bf4f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:57.182033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041267eb-9971-4538-b4f4-6c7a5b1bf4f6 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:57.192558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1087/2145] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:57.193472 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041267eb-9971-4538-b4f4-6c7a5b1bf4f6 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:57.203099 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041267eb-9971-4538-b4f4-6c7a5b1bf4f6 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:57.207839 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae691d77-fdd1-4d10-b9db-4dd586c01231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:57.208201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691d77-fdd1-4d10-b9db-4dd586c01231 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:57.208775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1059/2146] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:57.208887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691d77-fdd1-4d10-b9db-4dd586c01231 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:57.208887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691d77-fdd1-4d10-b9db-4dd586c01231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:57.209458 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092989b-f245-4078-b107-2ba4c2d336d4 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:57.210785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7092989b-f245-4078-b107-2ba4c2d336d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:57.211120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ae691d77-fdd1-4d10-b9db-4dd586c01231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:57.224974 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092989b-f245-4078-b107-2ba4c2d336d4 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:57.227843 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae691d77-fdd1-4d10-b9db-4dd586c01231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:57.229468 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae691d77-fdd1-4d10-b9db-4dd586c01231 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:57.230344 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940073d-6ba9-423a-804d-3242d6f38b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:57.231701 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940073d-6ba9-423a-804d-3242d6f38b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:57.240752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940073d-6ba9-423a-804d-3242d6f38b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:57.240752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940073d-6ba9-423a-804d-3242d6f38b02 admin admin] PATH_INFO: `/v3/users/8c19371c3077443ebdcd8322fd2233b5` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:57.240752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940073d-6ba9-423a-804d-3242d6f38b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c19371c3077443ebdcd8322fd2233b5)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:57.244210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940073d-6ba9-423a-804d-3242d6f38b02 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:57.245904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1088/2147] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:57.247094 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae691d77-fdd1-4d10-b9db-4dd586c01231 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:57.282554 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae691d77-fdd1-4d10-b9db-4dd586c01231 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:57.293607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e87b9f-0562-421a-8005-b480a225b29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:57.294396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87b9f-0562-421a-8005-b480a225b29e admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:57.295062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87b9f-0562-421a-8005-b480a225b29e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:57.295196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87b9f-0562-421a-8005-b480a225b29e admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:57.295898 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e87b9f-0562-421a-8005-b480a225b29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:57.296251 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e87b9f-0562-421a-8005-b480a225b29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:57.298039 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e87b9f-0562-421a-8005-b480a225b29e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:57.317504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1089/2148] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:57.317504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e87b9f-0562-421a-8005-b480a225b29e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:57.325629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f5e87b9f-0562-421a-8005-b480a225b29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:57.335793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e87b9f-0562-421a-8005-b480a225b29e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:57.341921 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:57.343107 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:57.344155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:57.344155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] PATH_INFO: `/v3/projects/70c69e86eed54f6d9a4ca49f9cf45ce1` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:57.345328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c69e86eed54f6d9a4ca49f9cf45ce1)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:57.347756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:57.523323 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3940073d-6ba9-423a-804d-3242d6f38b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c19371c3077443ebdcd8322fd2233b5'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.524633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c69e86eed54f6d9a4ca49f9cf45ce1', 'request_id': 'req-63ee879a-4bc8-41b7-875f-f8e61638e9de'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.538464 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3940073d-6ba9-423a-804d-3242d6f38b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c19371c3077443ebdcd8322fd2233b5'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.545982 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3940073d-6ba9-423a-804d-3242d6f38b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c19371c3077443ebdcd8322fd2233b5'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.546725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3940073d-6ba9-423a-804d-3242d6f38b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c19371c3077443ebdcd8322fd2233b5'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.634134 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c69e86eed54f6d9a4ca49f9cf45ce1', 'request_id': 'req-63ee879a-4bc8-41b7-875f-f8e61638e9de'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.642323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c69e86eed54f6d9a4ca49f9cf45ce1', 'request_id': 'req-63ee879a-4bc8-41b7-875f-f8e61638e9de'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.653902 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] The token cache is being invalidate because project 70c69e86eed54f6d9a4ca49f9cf45ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:57.654719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.655424 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.658430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1090/2149] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:57 2022] DELETE /identity/v3/projects/70c69e86eed54f6d9a4ca49f9cf45ce1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:57.659032 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:57.664559 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:57.716181 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3940073d-6ba9-423a-804d-3242d6f38b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c19371c3077443ebdcd8322fd2233b5'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.722818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1060/2150] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:57 2022] DELETE /identity/v3/users/8c19371c3077443ebdcd8322fd2233b5 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:57.724146 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5438457-46ff-41c7-8641-3e9d043b7fc3 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:57.724438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5438457-46ff-41c7-8641-3e9d043b7fc3 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:57.724725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5438457-46ff-41c7-8641-3e9d043b7fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:57.736420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee879a-4bc8-41b7-875f-f8e61638e9de admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:57.744295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-a5438457-46ff-41c7-8641-3e9d043b7fc3 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:57.745553 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a5438457-46ff-41c7-8641-3e9d043b7fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:57.798033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59779d07-8a2a-4e51-a63e-cc52429d8010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:57.798709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59779d07-8a2a-4e51-a63e-cc52429d8010 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:57.798997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59779d07-8a2a-4e51-a63e-cc52429d8010 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:57.799284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59779d07-8a2a-4e51-a63e-cc52429d8010 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:57.800448 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59779d07-8a2a-4e51-a63e-cc52429d8010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:57.802425 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59779d07-8a2a-4e51-a63e-cc52429d8010 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:57.811540 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1061/2151] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:57.812497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5438457-46ff-41c7-8641-3e9d043b7fc3 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:57.813804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a5438457-46ff-41c7-8641-3e9d043b7fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:57.826633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5438457-46ff-41c7-8641-3e9d043b7fc3 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:57.831952 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:57.835128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:57.835128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:57.835128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] PATH_INFO: `/v3/projects/1303123c4695456db924cf14ff85d422` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:57.835128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1303123c4695456db924cf14ff85d422)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:57.836813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:57.937216 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1091/2152] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:57 2022] POST /identity/v3/projects => generated 401 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:57.937216 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58526da3-c1d0-4095-b8e7-a3b9e5b60022 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:57.937216 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58526da3-c1d0-4095-b8e7-a3b9e5b60022 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:57.937216 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58526da3-c1d0-4095-b8e7-a3b9e5b60022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:57.947542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1303123c4695456db924cf14ff85d422', 'request_id': 'req-d79e6c00-302a-42ef-adab-d17adf25841d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:57.951818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:57.954497 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-58526da3-c1d0-4095-b8e7-a3b9e5b60022 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:57.955761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-58526da3-c1d0-4095-b8e7-a3b9e5b60022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:58.015442 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:58.023596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1092/2153] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:58.024639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58526da3-c1d0-4095-b8e7-a3b9e5b60022 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:58.026105 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-58526da3-c1d0-4095-b8e7-a3b9e5b60022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:58.038930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58526da3-c1d0-4095-b8e7-a3b9e5b60022 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:58.046291 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:58.047177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.047478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.047585 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1303123c4695456db924cf14ff85d422', 'request_id': 'req-d79e6c00-302a-42ef-adab-d17adf25841d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.047761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] PATH_INFO: `/v3/projects/f3aed740fe4b45e6b22a5e94d31d3164` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.048967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3aed740fe4b45e6b22a5e94d31d3164)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:58.050910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:58.054760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1303123c4695456db924cf14ff85d422', 'request_id': 'req-d79e6c00-302a-42ef-adab-d17adf25841d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.069926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] The token cache is being invalidate because project 1303123c4695456db924cf14ff85d422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:58.070216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.070908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.072685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1062/2154] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:57 2022] DELETE /identity/v3/projects/1303123c4695456db924cf14ff85d422 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:58.079887 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:58.083626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:58.152989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e6c00-302a-42ef-adab-d17adf25841d admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:58.158151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4d5c8-fe6e-472b-8c45-fb9105165bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:58.158834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4d5c8-fe6e-472b-8c45-fb9105165bed admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.159100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4d5c8-fe6e-472b-8c45-fb9105165bed admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.159376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4d5c8-fe6e-472b-8c45-fb9105165bed admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.160095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4d5c8-fe6e-472b-8c45-fb9105165bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:58.162011 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4d5c8-fe6e-472b-8c45-fb9105165bed admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:58.170514 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3aed740fe4b45e6b22a5e94d31d3164', 'request_id': 'req-97791b45-7d71-4585-a54d-74e1c90018cc'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.264042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3aed740fe4b45e6b22a5e94d31d3164', 'request_id': 'req-97791b45-7d71-4585-a54d-74e1c90018cc'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.275325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1063/2155] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:58 2022] POST /identity/v3/users => generated 301 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:58.276324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4d5c8-fe6e-472b-8c45-fb9105165bed admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:58.278121 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9bb4d5c8-fe6e-472b-8c45-fb9105165bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:58.278922 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3aed740fe4b45e6b22a5e94d31d3164', 'request_id': 'req-97791b45-7d71-4585-a54d-74e1c90018cc'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.289669 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] The token cache is being invalidate because project f3aed740fe4b45e6b22a5e94d31d3164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:58.289950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.290599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.290803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4d5c8-fe6e-472b-8c45-fb9105165bed admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:58.292462 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1093/2156] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:58 2022] DELETE /identity/v3/projects/f3aed740fe4b45e6b22a5e94d31d3164 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:58.293023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:58.294289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:58.355880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d0fec-e92d-459c-ac06-ac6657cb86e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:58.356546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d0fec-e92d-459c-ac06-ac6657cb86e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.356833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d0fec-e92d-459c-ac06-ac6657cb86e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.357624 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d0fec-e92d-459c-ac06-ac6657cb86e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.358405 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d0fec-e92d-459c-ac06-ac6657cb86e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:58.358708 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d0fec-e92d-459c-ac06-ac6657cb86e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:58.360369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d0fec-e92d-459c-ac06-ac6657cb86e8 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:58.366983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97791b45-7d71-4585-a54d-74e1c90018cc admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:58.371844 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea66a5-709d-400e-88d7-256338b5ce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:58.380283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1064/2157] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:58.380474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea66a5-709d-400e-88d7-256338b5ce38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.380572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d0fec-e92d-459c-ac06-ac6657cb86e8 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:58.380983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea66a5-709d-400e-88d7-256338b5ce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.380983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea66a5-709d-400e-88d7-256338b5ce38 admin admin] PATH_INFO: `/v3/users/3e1140946a324714b44117a755e6cd81` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.380983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea66a5-709d-400e-88d7-256338b5ce38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1140946a324714b44117a755e6cd81)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:58.381255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0f1d0fec-e92d-459c-ac06-ac6657cb86e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:58.381344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea66a5-709d-400e-88d7-256338b5ce38 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:58.391688 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d0fec-e92d-459c-ac06-ac6657cb86e8 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:58.396385 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebacde5-f45f-42b1-92d2-bd63365c0e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:58.397240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebacde5-f45f-42b1-92d2-bd63365c0e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.397524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebacde5-f45f-42b1-92d2-bd63365c0e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.397798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebacde5-f45f-42b1-92d2-bd63365c0e1b admin admin] PATH_INFO: `/v3/projects/ae483b4b5aab456ea5841242c3f893c2` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.398980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebacde5-f45f-42b1-92d2-bd63365c0e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae483b4b5aab456ea5841242c3f893c2)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:58.400922 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebacde5-f45f-42b1-92d2-bd63365c0e1b admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:58.644311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-35ea66a5-709d-400e-88d7-256338b5ce38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1140946a324714b44117a755e6cd81'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.644883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-aebacde5-f45f-42b1-92d2-bd63365c0e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae483b4b5aab456ea5841242c3f893c2', 'request_id': 'req-aebacde5-f45f-42b1-92d2-bd63365c0e1b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.704602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-35ea66a5-709d-400e-88d7-256338b5ce38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1140946a324714b44117a755e6cd81'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.717658 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-35ea66a5-709d-400e-88d7-256338b5ce38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1140946a324714b44117a755e6cd81'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.718325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-35ea66a5-709d-400e-88d7-256338b5ce38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1140946a324714b44117a755e6cd81'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.725280 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-35ea66a5-709d-400e-88d7-256338b5ce38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1140946a324714b44117a755e6cd81'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.731814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1094/2158] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:58 2022] DELETE /identity/v3/users/3e1140946a324714b44117a755e6cd81 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:58.732816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea66a5-709d-400e-88d7-256338b5ce38 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:58.734180 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-35ea66a5-709d-400e-88d7-256338b5ce38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:58.782368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-aebacde5-f45f-42b1-92d2-bd63365c0e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae483b4b5aab456ea5841242c3f893c2', 'request_id': 'req-aebacde5-f45f-42b1-92d2-bd63365c0e1b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.791567 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-aebacde5-f45f-42b1-92d2-bd63365c0e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae483b4b5aab456ea5841242c3f893c2', 'request_id': 'req-aebacde5-f45f-42b1-92d2-bd63365c0e1b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.802826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-aebacde5-f45f-42b1-92d2-bd63365c0e1b admin admin] The token cache is being invalidate because project ae483b4b5aab456ea5841242c3f893c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:58.803014 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-aebacde5-f45f-42b1-92d2-bd63365c0e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.803710 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-aebacde5-f45f-42b1-92d2-bd63365c0e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:58.805272 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1065/2159] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:58 2022] DELETE /identity/v3/projects/ae483b4b5aab456ea5841242c3f893c2 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:58.806601 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236dd09-c024-4ef5-8caa-fd436667e6f6 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.808582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236dd09-c024-4ef5-8caa-fd436667e6f6 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.808582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236dd09-c024-4ef5-8caa-fd436667e6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.809209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea66a5-709d-400e-88d7-256338b5ce38 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:58.815106 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9048f3-ee61-496d-9d7e-4d6ceb4f1093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:58.815824 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9048f3-ee61-496d-9d7e-4d6ceb4f1093 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.816112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9048f3-ee61-496d-9d7e-4d6ceb4f1093 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.816389 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9048f3-ee61-496d-9d7e-4d6ceb4f1093 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.817309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9048f3-ee61-496d-9d7e-4d6ceb4f1093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:58.818739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9048f3-ee61-496d-9d7e-4d6ceb4f1093 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:58.826872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-3236dd09-c024-4ef5-8caa-fd436667e6f6 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:58.828118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3236dd09-c024-4ef5-8caa-fd436667e6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:58.833860 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1095/2160] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:58.833860 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9048f3-ee61-496d-9d7e-4d6ceb4f1093 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:58.835124 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ed9048f3-ee61-496d-9d7e-4d6ceb4f1093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:58.839860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1066/2161] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:58.841253 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3358b-0a08-4068-912b-5cf2b494dd49 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.841556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3358b-0a08-4068-912b-5cf2b494dd49 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.841833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3358b-0a08-4068-912b-5cf2b494dd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.848562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9048f3-ee61-496d-9d7e-4d6ceb4f1093 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:58.853991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652755e-b438-481d-9dfb-213435689ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:58.854782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652755e-b438-481d-9dfb-213435689ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.855227 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652755e-b438-481d-9dfb-213435689ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.855584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652755e-b438-481d-9dfb-213435689ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.856347 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652755e-b438-481d-9dfb-213435689ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:58.858302 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652755e-b438-481d-9dfb-213435689ba7 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:58.863241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-8ac3358b-0a08-4068-912b-5cf2b494dd49 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:58.864473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8ac3358b-0a08-4068-912b-5cf2b494dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:58.873430 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1067/2162] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:58.874364 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3358b-0a08-4068-912b-5cf2b494dd49 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:58.875730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8ac3358b-0a08-4068-912b-5cf2b494dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:58.887757 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3358b-0a08-4068-912b-5cf2b494dd49 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:58.893041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdf7eb-6cec-4a8a-a737-cb5958127140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:58.893701 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdf7eb-6cec-4a8a-a737-cb5958127140 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.903143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdf7eb-6cec-4a8a-a737-cb5958127140 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.903143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdf7eb-6cec-4a8a-a737-cb5958127140 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.903143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdf7eb-6cec-4a8a-a737-cb5958127140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:58.903143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdf7eb-6cec-4a8a-a737-cb5958127140 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:58.906513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1068/2163] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:58.907749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aae0a-e1be-414f-9d80-17d098268c16 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.908038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aae0a-e1be-414f-9d80-17d098268c16 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.908317 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aae0a-e1be-414f-9d80-17d098268c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.927168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-b85aae0a-e1be-414f-9d80-17d098268c16 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:58.928421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-b85aae0a-e1be-414f-9d80-17d098268c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:58.936963 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1069/2164] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:58.938199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a03e21-b32b-4402-862d-6c1300e084d2 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.938488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a03e21-b32b-4402-862d-6c1300e084d2 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.938765 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a03e21-b32b-4402-862d-6c1300e084d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.958813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-d7a03e21-b32b-4402-862d-6c1300e084d2 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:58.960063 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d7a03e21-b32b-4402-862d-6c1300e084d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:58.962228 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1096/2165] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:58 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:58.963360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652755e-b438-481d-9dfb-213435689ba7 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.022236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1070/2166] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:59.024458 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a03e21-b32b-4402-862d-6c1300e084d2 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.036685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a03e21-b32b-4402-862d-6c1300e084d2 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.046229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c26e05-b81a-4a14-b73f-80382a9cb525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.046229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c26e05-b81a-4a14-b73f-80382a9cb525 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.046229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c26e05-b81a-4a14-b73f-80382a9cb525 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.046229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c26e05-b81a-4a14-b73f-80382a9cb525 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.046651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c26e05-b81a-4a14-b73f-80382a9cb525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:59.046651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c26e05-b81a-4a14-b73f-80382a9cb525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.047257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c26e05-b81a-4a14-b73f-80382a9cb525 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.064337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1071/2167] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:59.064337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c26e05-b81a-4a14-b73f-80382a9cb525 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.064714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652755e-b438-481d-9dfb-213435689ba7 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.068663 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b54b0-6f8c-4e65-8283-58e05ca25114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.069561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b54b0-6f8c-4e65-8283-58e05ca25114 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.069843 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b54b0-6f8c-4e65-8283-58e05ca25114 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.070124 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b54b0-6f8c-4e65-8283-58e05ca25114 admin admin] PATH_INFO: `/v3/projects/ef976c55bb0f47f388578a110d0aff70/users/c6db66260fcd48b385464f61c7be6b18/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.074852 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c26e05-b81a-4a14-b73f-80382a9cb525 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.085285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba759488-cada-4f5b-83cd-b1485659a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.086125 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba759488-cada-4f5b-83cd-b1485659a338 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.086419 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba759488-cada-4f5b-83cd-b1485659a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.086701 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba759488-cada-4f5b-83cd-b1485659a338 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.087403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba759488-cada-4f5b-83cd-b1485659a338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.089526 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba759488-cada-4f5b-83cd-b1485659a338 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.090375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b54b0-6f8c-4e65-8283-58e05ca25114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef976c55bb0f47f388578a110d0aff70, user_id=c6db66260fcd48b385464f61c7be6b18, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.093357 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b54b0-6f8c-4e65-8283-58e05ca25114 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.199659 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1097/2168] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:58 2022] PUT /identity/v3/projects/ef976c55bb0f47f388578a110d0aff70/users/c6db66260fcd48b385464f61c7be6b18/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:59.200487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b54b0-6f8c-4e65-8283-58e05ca25114 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.233652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1072/2169] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:59 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:59.234142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba759488-cada-4f5b-83cd-b1485659a338 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.246643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba759488-cada-4f5b-83cd-b1485659a338 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.290060 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b54b0-6f8c-4e65-8283-58e05ca25114 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.295521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e8dfc-42f6-4011-9f74-228a31826d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.296194 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e8dfc-42f6-4011-9f74-228a31826d2e admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.296481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e8dfc-42f6-4011-9f74-228a31826d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.299534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e8dfc-42f6-4011-9f74-228a31826d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.299534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e8dfc-42f6-4011-9f74-228a31826d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:59.299534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e8dfc-42f6-4011-9f74-228a31826d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.299534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e8dfc-42f6-4011-9f74-228a31826d2e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.309823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6ad31-ba7c-431a-a0b0-e90e996943c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.310505 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6ad31-ba7c-431a-a0b0-e90e996943c7 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.310785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6ad31-ba7c-431a-a0b0-e90e996943c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.311059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6ad31-ba7c-431a-a0b0-e90e996943c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.311197 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1098/2170] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:59.311871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6ad31-ba7c-431a-a0b0-e90e996943c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.312649 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b45077-ceae-4fa5-8b57-161c3c3db052 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.312946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b45077-ceae-4fa5-8b57-161c3c3db052 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.313229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b45077-ceae-4fa5-8b57-161c3c3db052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.313814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6ad31-ba7c-431a-a0b0-e90e996943c7 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.341038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-27b45077-ceae-4fa5-8b57-161c3c3db052 None None] MFA Rules not processed for user `c6db66260fcd48b385464f61c7be6b18`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:59.342694 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-27b45077-ceae-4fa5-8b57-161c3c3db052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:59.405874 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1099/2171] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:57:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:59.406711 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b45077-ceae-4fa5-8b57-161c3c3db052 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.417610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b45077-ceae-4fa5-8b57-161c3c3db052 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.422935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaf6eb-6358-431f-a78d-af0ce134dc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.423668 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaf6eb-6358-431f-a78d-af0ce134dc6e admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.423957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaf6eb-6358-431f-a78d-af0ce134dc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.424235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaf6eb-6358-431f-a78d-af0ce134dc6e admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.424967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaf6eb-6358-431f-a78d-af0ce134dc6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.426618 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaf6eb-6358-431f-a78d-af0ce134dc6e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.439109 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1100/2172] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:59.439109 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaf6eb-6358-431f-a78d-af0ce134dc6e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.441186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-66eaf6eb-6358-431f-a78d-af0ce134dc6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:59.452880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1073/2173] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:59 2022] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:59.453724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6ad31-ba7c-431a-a0b0-e90e996943c7 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.453854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaf6eb-6358-431f-a78d-af0ce134dc6e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.516093 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.517331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.517647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.517921 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] PATH_INFO: `/v3/projects/95afbe1ec815442cb8f3bb215857e5cc` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.518212 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6ad31-ba7c-431a-a0b0-e90e996943c7 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.519495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] RBAC: Authorizing `identity:delete_project(project_id=95afbe1ec815442cb8f3bb215857e5cc)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.521607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.529211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d95b35-3cfe-4628-953d-2d9a2fd34392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.529875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95b35-3cfe-4628-953d-2d9a2fd34392 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.530163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95b35-3cfe-4628-953d-2d9a2fd34392 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.530442 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95b35-3cfe-4628-953d-2d9a2fd34392 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.531377 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d95b35-3cfe-4628-953d-2d9a2fd34392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.533466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d95b35-3cfe-4628-953d-2d9a2fd34392 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.774575 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95afbe1ec815442cb8f3bb215857e5cc', 'request_id': 'req-f4999f06-cf44-49dc-b6a2-684c29f8e90d'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:59.798102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1074/2174] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:59 2022] POST /identity/v3/projects => generated 383 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:59.798915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d95b35-3cfe-4628-953d-2d9a2fd34392 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.859085 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95afbe1ec815442cb8f3bb215857e5cc', 'request_id': 'req-f4999f06-cf44-49dc-b6a2-684c29f8e90d'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:59.860191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d95b35-3cfe-4628-953d-2d9a2fd34392 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.865063 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d31cf7-51e2-4ace-9888-15c49ab7e87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.865604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d31cf7-51e2-4ace-9888-15c49ab7e87f admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.865833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95afbe1ec815442cb8f3bb215857e5cc', 'request_id': 'req-f4999f06-cf44-49dc-b6a2-684c29f8e90d'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:59.868215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d31cf7-51e2-4ace-9888-15c49ab7e87f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.868215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d31cf7-51e2-4ace-9888-15c49ab7e87f admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.868215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d31cf7-51e2-4ace-9888-15c49ab7e87f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.868815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d31cf7-51e2-4ace-9888-15c49ab7e87f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.877298 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] The token cache is being invalidate because project 95afbe1ec815442cb8f3bb215857e5cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:59.877576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:59.878268 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:59.880364 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1101/2175] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:59 2022] DELETE /identity/v3/projects/95afbe1ec815442cb8f3bb215857e5cc => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:59.882949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.884441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:59.947678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4999f06-cf44-49dc-b6a2-684c29f8e90d admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.952909 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a4205-9a6f-4611-a43e-fac4eb05fe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.953577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a4205-9a6f-4611-a43e-fac4eb05fe7f admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.953865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a4205-9a6f-4611-a43e-fac4eb05fe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.954163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a4205-9a6f-4611-a43e-fac4eb05fe7f admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.954912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a4205-9a6f-4611-a43e-fac4eb05fe7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.956542 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a4205-9a6f-4611-a43e-fac4eb05fe7f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.970245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1102/2176] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:59.970245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a4205-9a6f-4611-a43e-fac4eb05fe7f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.970245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b28a4205-9a6f-4611-a43e-fac4eb05fe7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:59.982040 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a4205-9a6f-4611-a43e-fac4eb05fe7f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.986737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fefdff-bc65-430c-91e5-cf2f6a6c4a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.987397 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fefdff-bc65-430c-91e5-cf2f6a6c4a2d admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.987713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fefdff-bc65-430c-91e5-cf2f6a6c4a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.987992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fefdff-bc65-430c-91e5-cf2f6a6c4a2d admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.988679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fefdff-bc65-430c-91e5-cf2f6a6c4a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.990590 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fefdff-bc65-430c-91e5-cf2f6a6c4a2d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.029820 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1075/2177] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:59 2022] POST /identity/v3/projects => generated 401 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:00.030816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d31cf7-51e2-4ace-9888-15c49ab7e87f admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.032373 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-93d31cf7-51e2-4ace-9888-15c49ab7e87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:00.096404 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d31cf7-51e2-4ace-9888-15c49ab7e87f admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.101525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb56989-8049-4bb1-97f5-8ab512b06712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.102151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb56989-8049-4bb1-97f5-8ab512b06712 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.102431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb56989-8049-4bb1-97f5-8ab512b06712 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.102707 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb56989-8049-4bb1-97f5-8ab512b06712 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.103395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb56989-8049-4bb1-97f5-8ab512b06712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.105351 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb56989-8049-4bb1-97f5-8ab512b06712 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.119764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1103/2178] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:59 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:00.121288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c1879-d2ba-4e69-bd16-ef140f4868d1 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.122011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c1879-d2ba-4e69-bd16-ef140f4868d1 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.122967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c1879-d2ba-4e69-bd16-ef140f4868d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.125100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:00.142074 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-c60c1879-d2ba-4e69-bd16-ef140f4868d1 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:00.143203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c60c1879-d2ba-4e69-bd16-ef140f4868d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:00.151155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1104/2179] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:00.152071 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c1879-d2ba-4e69-bd16-ef140f4868d1 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.162036 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c1879-d2ba-4e69-bd16-ef140f4868d1 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.166690 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcf91f-e4e0-4c70-890e-c2992ddc395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.167596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcf91f-e4e0-4c70-890e-c2992ddc395e admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.167965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcf91f-e4e0-4c70-890e-c2992ddc395e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.168165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcf91f-e4e0-4c70-890e-c2992ddc395e admin admin] PATH_INFO: `/v3/projects/a2fef7c72fff4c1cbca16f9b19121278/users/0a019fdb84494ec294c16dbc936e7d99/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.184014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcf91f-e4e0-4c70-890e-c2992ddc395e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fef7c72fff4c1cbca16f9b19121278, user_id=0a019fdb84494ec294c16dbc936e7d99, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.186734 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcf91f-e4e0-4c70-890e-c2992ddc395e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.190950 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1076/2180] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:58:00 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:00.191790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb56989-8049-4bb1-97f5-8ab512b06712 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.193356 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2cb56989-8049-4bb1-97f5-8ab512b06712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:00.196442 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:00.206373 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb56989-8049-4bb1-97f5-8ab512b06712 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.211230 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb824f-c42e-4b46-b9d9-2faebaf215bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.211970 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb824f-c42e-4b46-b9d9-2faebaf215bd admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.212253 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb824f-c42e-4b46-b9d9-2faebaf215bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.212533 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb824f-c42e-4b46-b9d9-2faebaf215bd admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.213227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb824f-c42e-4b46-b9d9-2faebaf215bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.215632 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb824f-c42e-4b46-b9d9-2faebaf215bd admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.308230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1105/2181] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:00 2022] PUT /identity/v3/projects/a2fef7c72fff4c1cbca16f9b19121278/users/0a019fdb84494ec294c16dbc936e7d99/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:00.309064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcf91f-e4e0-4c70-890e-c2992ddc395e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.338352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1077/2182] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:58:00 2022] POST /identity/v3/users => generated 307 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:00.338878 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d13b6e-3fd2-4b02-8beb-815f641cf94a None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.338878 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d13b6e-3fd2-4b02-8beb-815f641cf94a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.339089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d13b6e-3fd2-4b02-8beb-815f641cf94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.363591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-63d13b6e-3fd2-4b02-8beb-815f641cf94a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:00.364823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-63d13b6e-3fd2-4b02-8beb-815f641cf94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:00.375711 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcf91f-e4e0-4c70-890e-c2992ddc395e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.380737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e1a2c-e312-41dc-b041-504824819b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.384257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1a2c-e312-41dc-b041-504824819b97 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.384257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1a2c-e312-41dc-b041-504824819b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.384257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1a2c-e312-41dc-b041-504824819b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.384257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e1a2c-e312-41dc-b041-504824819b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.384578 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e1a2c-e312-41dc-b041-504824819b97 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.395120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1106/2183] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:00.395898 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e1a2c-e312-41dc-b041-504824819b97 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.407625 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e1a2c-e312-41dc-b041-504824819b97 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.412620 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86354535-ea31-4bc3-a08b-c05d855a0d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.414676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86354535-ea31-4bc3-a08b-c05d855a0d14 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.414676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86354535-ea31-4bc3-a08b-c05d855a0d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.414676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86354535-ea31-4bc3-a08b-c05d855a0d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.414676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86354535-ea31-4bc3-a08b-c05d855a0d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.416229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86354535-ea31-4bc3-a08b-c05d855a0d14 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.429486 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1107/2184] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:00.429662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1078/2185] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:00.429761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f704-765c-427f-9835-7fb7ce59cf6d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.429761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f704-765c-427f-9835-7fb7ce59cf6d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.429761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f704-765c-427f-9835-7fb7ce59cf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.430007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d13b6e-3fd2-4b02-8beb-815f641cf94a None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.439988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d13b6e-3fd2-4b02-8beb-815f641cf94a None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.444736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77d3e6-7c90-4b5c-8756-0bc01d16fe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.445403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77d3e6-7c90-4b5c-8756-0bc01d16fe43 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.445684 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77d3e6-7c90-4b5c-8756-0bc01d16fe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.447431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77d3e6-7c90-4b5c-8756-0bc01d16fe43 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.447431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77d3e6-7c90-4b5c-8756-0bc01d16fe43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.448160 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-7b60f704-765c-427f-9835-7fb7ce59cf6d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:00.448292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77d3e6-7c90-4b5c-8756-0bc01d16fe43 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.449359 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-7b60f704-765c-427f-9835-7fb7ce59cf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:00.457904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1108/2186] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:00.458692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60f704-765c-427f-9835-7fb7ce59cf6d None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.459180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1079/2187] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:00.460026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77d3e6-7c90-4b5c-8756-0bc01d16fe43 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.472817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77d3e6-7c90-4b5c-8756-0bc01d16fe43 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.474008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60f704-765c-427f-9835-7fb7ce59cf6d None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.477124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d5e2e-7c22-4f2b-b955-f9a6966a57b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.477878 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d5e2e-7c22-4f2b-b955-f9a6966a57b2 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.478235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d5e2e-7c22-4f2b-b955-f9a6966a57b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.478594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d5e2e-7c22-4f2b-b955-f9a6966a57b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.479020 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e7d00-0386-455d-811d-baa0f41323d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.479494 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d5e2e-7c22-4f2b-b955-f9a6966a57b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.479727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e7d00-0386-455d-811d-baa0f41323d8 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.480011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e7d00-0386-455d-811d-baa0f41323d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.480315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e7d00-0386-455d-811d-baa0f41323d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.481075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e7d00-0386-455d-811d-baa0f41323d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.481446 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d5e2e-7c22-4f2b-b955-f9a6966a57b2 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.483250 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e7d00-0386-455d-811d-baa0f41323d8 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.492522 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1080/2188] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:00.493384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d5e2e-7c22-4f2b-b955-f9a6966a57b2 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.494051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1109/2189] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:00.494792 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e7d00-0386-455d-811d-baa0f41323d8 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.505901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e7d00-0386-455d-811d-baa0f41323d8 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.507318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d5e2e-7c22-4f2b-b955-f9a6966a57b2 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.511277 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70f85f-4d4a-4a67-847d-2119d1ef02af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.512082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99cf99-8d82-44e9-bcd4-5c432000de34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.512245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70f85f-4d4a-4a67-847d-2119d1ef02af admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.512531 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70f85f-4d4a-4a67-847d-2119d1ef02af admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.512741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99cf99-8d82-44e9-bcd4-5c432000de34 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.512892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70f85f-4d4a-4a67-847d-2119d1ef02af admin admin] PATH_INFO: `/v3/projects/6487afb5f64b4f1986a06fe5c5b939f7/users/620c625c52294f1ca63bb64b45934884/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.513052 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99cf99-8d82-44e9-bcd4-5c432000de34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.513293 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99cf99-8d82-44e9-bcd4-5c432000de34 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.514022 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99cf99-8d82-44e9-bcd4-5c432000de34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:58:00.514332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99cf99-8d82-44e9-bcd4-5c432000de34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.515984 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99cf99-8d82-44e9-bcd4-5c432000de34 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.529013 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1081/2190] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:58:00.529262 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99cf99-8d82-44e9-bcd4-5c432000de34 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.532934 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70f85f-4d4a-4a67-847d-2119d1ef02af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6487afb5f64b4f1986a06fe5c5b939f7, user_id=620c625c52294f1ca63bb64b45934884, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.533179 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5d99cf99-8d82-44e9-bcd4-5c432000de34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:00.536187 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70f85f-4d4a-4a67-847d-2119d1ef02af admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.591822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99cf99-8d82-44e9-bcd4-5c432000de34 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.595465 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a6b4d-76de-48eb-b70f-cfad6236c076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.596115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6b4d-76de-48eb-b70f-cfad6236c076 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.596400 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6b4d-76de-48eb-b70f-cfad6236c076 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.596681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6b4d-76de-48eb-b70f-cfad6236c076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.606815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a6b4d-76de-48eb-b70f-cfad6236c076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.608287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a6b4d-76de-48eb-b70f-cfad6236c076 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.614500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1110/2191] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:00 2022] PUT /identity/v3/projects/6487afb5f64b4f1986a06fe5c5b939f7/users/620c625c52294f1ca63bb64b45934884/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:00.614500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70f85f-4d4a-4a67-847d-2119d1ef02af admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.619030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1082/2192] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:00.619978 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a6b4d-76de-48eb-b70f-cfad6236c076 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.630095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a6b4d-76de-48eb-b70f-cfad6236c076 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.678504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70f85f-4d4a-4a67-847d-2119d1ef02af admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.684021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a23507-214f-4719-85d0-7260b50fd210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.684966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a23507-214f-4719-85d0-7260b50fd210 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.685249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a23507-214f-4719-85d0-7260b50fd210 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.685660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a23507-214f-4719-85d0-7260b50fd210 admin admin] PATH_INFO: `/v3/projects/60c20c3dbd654dc8aea02e3bdf50a53a/users/35355d654eee4e0eb81c6d4d334a22e7/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.689159 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa950b8c-6b40-49e8-a3fd-f42f18bcac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.690085 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950b8c-6b40-49e8-a3fd-f42f18bcac1e admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.690490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950b8c-6b40-49e8-a3fd-f42f18bcac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.690827 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950b8c-6b40-49e8-a3fd-f42f18bcac1e admin admin] PATH_INFO: `/v3/projects/60efbc121a8e4653b34e8db0fdcda368/users/a767f424f39c4fbf88b4ec38b0f74144/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.701610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a23507-214f-4719-85d0-7260b50fd210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c20c3dbd654dc8aea02e3bdf50a53a, user_id=35355d654eee4e0eb81c6d4d334a22e7, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.704394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a23507-214f-4719-85d0-7260b50fd210 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.705971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa950b8c-6b40-49e8-a3fd-f42f18bcac1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60efbc121a8e4653b34e8db0fdcda368, user_id=a767f424f39c4fbf88b4ec38b0f74144, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.708730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa950b8c-6b40-49e8-a3fd-f42f18bcac1e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.805143 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1111/2193] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:00 2022] PUT /identity/v3/projects/60c20c3dbd654dc8aea02e3bdf50a53a/users/35355d654eee4e0eb81c6d4d334a22e7/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:00.805143 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a23507-214f-4719-85d0-7260b50fd210 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.859328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1083/2194] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:00 2022] PUT /identity/v3/projects/60efbc121a8e4653b34e8db0fdcda368/users/a767f424f39c4fbf88b4ec38b0f74144/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:00.860666 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa950b8c-6b40-49e8-a3fd-f42f18bcac1e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.877581 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a23507-214f-4719-85d0-7260b50fd210 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.940608 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa950b8c-6b40-49e8-a3fd-f42f18bcac1e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.946403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de1a4d-71fd-49fc-80ad-aef570e97bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.947108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1a4d-71fd-49fc-80ad-aef570e97bcb admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.947245 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d93fba-faa1-4c6a-b81b-4898214cf2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.947408 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1a4d-71fd-49fc-80ad-aef570e97bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.947696 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1a4d-71fd-49fc-80ad-aef570e97bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.948487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de1a4d-71fd-49fc-80ad-aef570e97bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.948971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d93fba-faa1-4c6a-b81b-4898214cf2bf admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.949724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d93fba-faa1-4c6a-b81b-4898214cf2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.950652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d93fba-faa1-4c6a-b81b-4898214cf2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.950758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de1a4d-71fd-49fc-80ad-aef570e97bcb admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.952280 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d93fba-faa1-4c6a-b81b-4898214cf2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.956597 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d93fba-faa1-4c6a-b81b-4898214cf2bf admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.969249 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1084/2195] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:00.970973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9105c-d9bb-424b-9eb3-2d4a0dd9cab3 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.971343 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9105c-d9bb-424b-9eb3-2d4a0dd9cab3 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.971725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9105c-d9bb-424b-9eb3-2d4a0dd9cab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.993689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-d6a9105c-d9bb-424b-9eb3-2d4a0dd9cab3 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:00.995333 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d6a9105c-d9bb-424b-9eb3-2d4a0dd9cab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:01.005946 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1085/2196] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:01.007257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcb103-3552-4e3d-a30c-0d43666e281d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:01.007581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcb103-3552-4e3d-a30c-0d43666e281d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:01.007864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcb103-3552-4e3d-a30c-0d43666e281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:01.035610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-6abcb103-3552-4e3d-a30c-0d43666e281d None None] MFA Rules not processed for user `a767f424f39c4fbf88b4ec38b0f74144`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:01.036891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6abcb103-3552-4e3d-a30c-0d43666e281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:01.077588 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1112/2197] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:58:00 2022] POST /identity/v3/projects => generated 371 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:01.078404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de1a4d-71fd-49fc-80ad-aef570e97bcb admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:01.104618 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1086/2198] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:01.106066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcb103-3552-4e3d-a30c-0d43666e281d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:01.118766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6abcb103-3552-4e3d-a30c-0d43666e281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:01.152991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de1a4d-71fd-49fc-80ad-aef570e97bcb admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:01.162962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916255fc-b3a4-4b7a-8541-0c3e7a59032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:01.163902 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916255fc-b3a4-4b7a-8541-0c3e7a59032a admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:01.164190 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916255fc-b3a4-4b7a-8541-0c3e7a59032a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:01.164477 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916255fc-b3a4-4b7a-8541-0c3e7a59032a admin admin] PATH_INFO: `/v3/projects/6487afb5f64b4f1986a06fe5c5b939f7/users/620c625c52294f1ca63bb64b45934884/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:01.166756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916255fc-b3a4-4b7a-8541-0c3e7a59032a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6487afb5f64b4f1986a06fe5c5b939f7, user_id=620c625c52294f1ca63bb64b45934884, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:01.169615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916255fc-b3a4-4b7a-8541-0c3e7a59032a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:01.180767 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1113/2199] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:01 2022] PUT /identity/v3/projects/6487afb5f64b4f1986a06fe5c5b939f7/users/620c625c52294f1ca63bb64b45934884/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:01.181633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916255fc-b3a4-4b7a-8541-0c3e7a59032a admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:01.193070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcb103-3552-4e3d-a30c-0d43666e281d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:01.271880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916255fc-b3a4-4b7a-8541-0c3e7a59032a admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:01.275502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f1896-04f9-4627-a209-3c5fe423c8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:01.276338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f1896-04f9-4627-a209-3c5fe423c8ee service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:01.276632 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f1896-04f9-4627-a209-3c5fe423c8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:01.276748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aed11-f985-456c-9014-9b082c43a7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:01.276911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f1896-04f9-4627-a209-3c5fe423c8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:01.277396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aed11-f985-456c-9014-9b082c43a7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:01.277683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aed11-f985-456c-9014-9b082c43a7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:01.277959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aed11-f985-456c-9014-9b082c43a7c6 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:01.278864 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aed11-f985-456c-9014-9b082c43a7c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:01.280851 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aed11-f985-456c-9014-9b082c43a7c6 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:01.287062 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f1896-04f9-4627-a209-3c5fe423c8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:01.288708 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f1896-04f9-4627-a209-3c5fe423c8ee service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:01.299550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1087/2200] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:01.300455 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f1896-04f9-4627-a209-3c5fe423c8ee service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:01.301888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-159f1896-04f9-4627-a209-3c5fe423c8ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:01.360697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f1896-04f9-4627-a209-3c5fe423c8ee service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:01.364427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5ccde-aaeb-4554-98ed-b04ac963ad91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:01.365079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5ccde-aaeb-4554-98ed-b04ac963ad91 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:01.365362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5ccde-aaeb-4554-98ed-b04ac963ad91 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:01.365644 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5ccde-aaeb-4554-98ed-b04ac963ad91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:01.422543 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5ccde-aaeb-4554-98ed-b04ac963ad91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:01.423942 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5ccde-aaeb-4554-98ed-b04ac963ad91 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:01.432685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1088/2201] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:01.433935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5721d-4136-408c-be19-11573550b3fd None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:01.434225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5721d-4136-408c-be19-11573550b3fd None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:01.434776 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5721d-4136-408c-be19-11573550b3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:01.443887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1114/2202] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:58:01 2022] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:01.449068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aed11-f985-456c-9014-9b082c43a7c6 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:01.463587 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aed11-f985-456c-9014-9b082c43a7c6 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:01.468908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-31c5721d-4136-408c-be19-11573550b3fd None None] MFA Rules not processed for user `620c625c52294f1ca63bb64b45934884`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:01.470560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-31c5721d-4136-408c-be19-11573550b3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:01.470684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acb0de-0206-498a-bb1c-37353d84541f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:01.471442 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acb0de-0206-498a-bb1c-37353d84541f admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:01.471856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acb0de-0206-498a-bb1c-37353d84541f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:01.472332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acb0de-0206-498a-bb1c-37353d84541f admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:01.473192 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acb0de-0206-498a-bb1c-37353d84541f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:01.475312 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acb0de-0206-498a-bb1c-37353d84541f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:01.487517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1115/2203] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:01.494462 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acb0de-0206-498a-bb1c-37353d84541f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:01.506436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acb0de-0206-498a-bb1c-37353d84541f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:01.511617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c6f22-b68d-4c92-8ef4-4ac693ac9f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:01.512290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c6f22-b68d-4c92-8ef4-4ac693ac9f0b admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:01.512678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c6f22-b68d-4c92-8ef4-4ac693ac9f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:01.513031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c6f22-b68d-4c92-8ef4-4ac693ac9f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:01.513772 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c6f22-b68d-4c92-8ef4-4ac693ac9f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:01.515983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c6f22-b68d-4c92-8ef4-4ac693ac9f0b admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:01.531842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1116/2204] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:58:01.533478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c6f22-b68d-4c92-8ef4-4ac693ac9f0b admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:01.551982 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c6f22-b68d-4c92-8ef4-4ac693ac9f0b admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:01.558060 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251950c-4028-44aa-a4c8-b6a63ad7fb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:01.559015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251950c-4028-44aa-a4c8-b6a63ad7fb11 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:01.562518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251950c-4028-44aa-a4c8-b6a63ad7fb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:01.562518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251950c-4028-44aa-a4c8-b6a63ad7fb11 admin admin] PATH_INFO: `/v3/projects/86cc5cb634f6475f8c01c5cf6780a934/users/e60ccd477dd7489aaa4491cfb09b5cd2/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:01.573711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1089/2205] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:01 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:01.576517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251950c-4028-44aa-a4c8-b6a63ad7fb11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86cc5cb634f6475f8c01c5cf6780a934, user_id=e60ccd477dd7489aaa4491cfb09b5cd2, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:01.580055 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251950c-4028-44aa-a4c8-b6a63ad7fb11 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:01.588999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5721d-4136-408c-be19-11573550b3fd None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:01.590866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-31c5721d-4136-408c-be19-11573550b3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:01.606385 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5721d-4136-408c-be19-11573550b3fd None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:01.611180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447b92e-96bf-43db-872e-a335d7650cfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:01.611919 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447b92e-96bf-43db-872e-a335d7650cfd service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:01.612237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447b92e-96bf-43db-872e-a335d7650cfd service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:01.612513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447b92e-96bf-43db-872e-a335d7650cfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:01.623469 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447b92e-96bf-43db-872e-a335d7650cfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:01.625472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447b92e-96bf-43db-872e-a335d7650cfd service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:01.636954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1090/2206] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:01 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:58:01.658857 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1117/2207] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:01 2022] PUT /identity/v3/projects/86cc5cb634f6475f8c01c5cf6780a934/users/e60ccd477dd7489aaa4491cfb09b5cd2/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:01.660358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bcdf5-657c-45e2-95fc-788917069132 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:01.660702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bcdf5-657c-45e2-95fc-788917069132 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:01.661019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bcdf5-657c-45e2-95fc-788917069132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:01.690292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-816bcdf5-657c-45e2-95fc-788917069132 None None] MFA Rules not processed for user `e60ccd477dd7489aaa4491cfb09b5cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:01.691541 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-816bcdf5-657c-45e2-95fc-788917069132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:01.775754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1091/2208] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:58:01.916924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251950c-4028-44aa-a4c8-b6a63ad7fb11 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:01.951118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:01.977868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251950c-4028-44aa-a4c8-b6a63ad7fb11 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:01.981477 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58c8a8-438a-416e-8a5b-8a7255f935c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:01.982631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58c8a8-438a-416e-8a5b-8a7255f935c1 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:01.982911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58c8a8-438a-416e-8a5b-8a7255f935c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:01.983180 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58c8a8-438a-416e-8a5b-8a7255f935c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:01.992510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58c8a8-438a-416e-8a5b-8a7255f935c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:01.994008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58c8a8-438a-416e-8a5b-8a7255f935c1 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:02.004367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1118/2209] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:02.019233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bcdf5-657c-45e2-95fc-788917069132 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:02.024299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58c8a8-438a-416e-8a5b-8a7255f935c1 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:02.038451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:02.051155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bcdf5-657c-45e2-95fc-788917069132 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:02.063468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56a478-0553-4940-b246-54ccfe32a7ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:02.064297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56a478-0553-4940-b246-54ccfe32a7ca service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:02.064650 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56a478-0553-4940-b246-54ccfe32a7ca service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:02.065634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56a478-0553-4940-b246-54ccfe32a7ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:02.067384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ab56a478-0553-4940-b246-54ccfe32a7ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:02.111372 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58c8a8-438a-416e-8a5b-8a7255f935c1 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:02.116350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca52407-4481-4bc6-bff1-81d757c96682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:02.117381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca52407-4481-4bc6-bff1-81d757c96682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:02.117658 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca52407-4481-4bc6-bff1-81d757c96682 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:02.117973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca52407-4481-4bc6-bff1-81d757c96682 admin admin] PATH_INFO: `/v3/users/e60ccd477dd7489aaa4491cfb09b5cd2` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:02.119363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca52407-4481-4bc6-bff1-81d757c96682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e60ccd477dd7489aaa4491cfb09b5cd2)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:02.121695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca52407-4481-4bc6-bff1-81d757c96682 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:02.146131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56a478-0553-4940-b246-54ccfe32a7ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:02.147634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56a478-0553-4940-b246-54ccfe32a7ca service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:02.159713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1092/2210] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:58:02.417892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3ca52407-4481-4bc6-bff1-81d757c96682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e60ccd477dd7489aaa4491cfb09b5cd2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:02.590242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3ca52407-4481-4bc6-bff1-81d757c96682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e60ccd477dd7489aaa4491cfb09b5cd2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:02.605392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3ca52407-4481-4bc6-bff1-81d757c96682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e60ccd477dd7489aaa4491cfb09b5cd2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:02.606004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3ca52407-4481-4bc6-bff1-81d757c96682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e60ccd477dd7489aaa4491cfb09b5cd2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:02.613400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3ca52407-4481-4bc6-bff1-81d757c96682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e60ccd477dd7489aaa4491cfb09b5cd2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:02.619744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1119/2211] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:58:02 2022] DELETE /identity/v3/users/e60ccd477dd7489aaa4491cfb09b5cd2 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:58:02.624850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06847c1-db60-41f6-b545-9a76de4a4b78 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:02.625370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06847c1-db60-41f6-b545-9a76de4a4b78 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:02.626334 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06847c1-db60-41f6-b545-9a76de4a4b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:02.648332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-d06847c1-db60-41f6-b545-9a76de4a4b78 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:02.649796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d06847c1-db60-41f6-b545-9a76de4a4b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:02.739602 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1093/2212] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:02.749820 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca52407-4481-4bc6-bff1-81d757c96682 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:02.751251 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3ca52407-4481-4bc6-bff1-81d757c96682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:02.822072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca52407-4481-4bc6-bff1-81d757c96682 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:02.827136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9699ac-ccee-42c6-9b16-453898ff9e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:02.827833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9699ac-ccee-42c6-9b16-453898ff9e79 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:02.828166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9699ac-ccee-42c6-9b16-453898ff9e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:02.828447 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9699ac-ccee-42c6-9b16-453898ff9e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:02.839011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9699ac-ccee-42c6-9b16-453898ff9e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:02.840548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9699ac-ccee-42c6-9b16-453898ff9e79 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:02.852549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1120/2213] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:03.236131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb1677-75f0-4011-8ac3-09a83adca610 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:03.236411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb1677-75f0-4011-8ac3-09a83adca610 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:03.236692 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb1677-75f0-4011-8ac3-09a83adca610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:03.276350 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-8fbb1677-75f0-4011-8ac3-09a83adca610 None None] MFA Rules not processed for user `35355d654eee4e0eb81c6d4d334a22e7`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:03.277542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8fbb1677-75f0-4011-8ac3-09a83adca610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:03.307219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9699ac-ccee-42c6-9b16-453898ff9e79 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:03.312355 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2a9699ac-ccee-42c6-9b16-453898ff9e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:03.344689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9699ac-ccee-42c6-9b16-453898ff9e79 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:03.354356 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437fa35-3220-44f3-a2bb-3a29423838bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:03.357924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437fa35-3220-44f3-a2bb-3a29423838bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:03.358486 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437fa35-3220-44f3-a2bb-3a29423838bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:03.359528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437fa35-3220-44f3-a2bb-3a29423838bf admin admin] PATH_INFO: `/v3/projects/86cc5cb634f6475f8c01c5cf6780a934` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:03.363065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437fa35-3220-44f3-a2bb-3a29423838bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=86cc5cb634f6475f8c01c5cf6780a934)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:03.374304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437fa35-3220-44f3-a2bb-3a29423838bf admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:03.439065 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1094/2214] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:03.451914 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb1677-75f0-4011-8ac3-09a83adca610 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:03.453277 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8fbb1677-75f0-4011-8ac3-09a83adca610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:03.568066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5437fa35-3220-44f3-a2bb-3a29423838bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86cc5cb634f6475f8c01c5cf6780a934', 'request_id': 'req-5437fa35-3220-44f3-a2bb-3a29423838bf'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:03.579741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb1677-75f0-4011-8ac3-09a83adca610 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:03.647083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e13079-1342-4f3e-b951-efe8a4945e54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:03.647692 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e13079-1342-4f3e-b951-efe8a4945e54 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:03.648147 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e13079-1342-4f3e-b951-efe8a4945e54 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:03.648264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e13079-1342-4f3e-b951-efe8a4945e54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:03.712205 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e13079-1342-4f3e-b951-efe8a4945e54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:03.713770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e13079-1342-4f3e-b951-efe8a4945e54 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:03.722018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5437fa35-3220-44f3-a2bb-3a29423838bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86cc5cb634f6475f8c01c5cf6780a934', 'request_id': 'req-5437fa35-3220-44f3-a2bb-3a29423838bf'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:03.730769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1095/2215] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:03.733536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5437fa35-3220-44f3-a2bb-3a29423838bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86cc5cb634f6475f8c01c5cf6780a934', 'request_id': 'req-5437fa35-3220-44f3-a2bb-3a29423838bf'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:03.745571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5437fa35-3220-44f3-a2bb-3a29423838bf admin admin] The token cache is being invalidate because project 86cc5cb634f6475f8c01c5cf6780a934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:58:03.745571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5437fa35-3220-44f3-a2bb-3a29423838bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:03.745571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5437fa35-3220-44f3-a2bb-3a29423838bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:03.747686 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1121/2216] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:58:03 2022] DELETE /identity/v3/projects/86cc5cb634f6475f8c01c5cf6780a934 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:03.762697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aab7ba-fbc4-476c-ab0a-99e81c3dcfcd None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:03.764025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aab7ba-fbc4-476c-ab0a-99e81c3dcfcd None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:03.764497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aab7ba-fbc4-476c-ab0a-99e81c3dcfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:03.805413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f5aab7ba-fbc4-476c-ab0a-99e81c3dcfcd None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:03.806697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f5aab7ba-fbc4-476c-ab0a-99e81c3dcfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:03.893705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:03.910487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1096/2217] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:03.917993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da5fae-98ff-4c3c-95d3-3faec21f4d28 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:03.918158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da5fae-98ff-4c3c-95d3-3faec21f4d28 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:03.918438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da5fae-98ff-4c3c-95d3-3faec21f4d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:03.952517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-c6da5fae-98ff-4c3c-95d3-3faec21f4d28 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:03.953763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c6da5fae-98ff-4c3c-95d3-3faec21f4d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:03.962882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1122/2218] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:03.967583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aab7ba-fbc4-476c-ab0a-99e81c3dcfcd None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:03.978802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aab7ba-fbc4-476c-ab0a-99e81c3dcfcd None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:03.986864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d247b-3e74-4dfb-88ce-00a3700faa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:03.987772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d247b-3e74-4dfb-88ce-00a3700faa2e admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:03.987894 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d247b-3e74-4dfb-88ce-00a3700faa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:03.988272 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d247b-3e74-4dfb-88ce-00a3700faa2e admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:03.989562 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d247b-3e74-4dfb-88ce-00a3700faa2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:58:03.989562 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d247b-3e74-4dfb-88ce-00a3700faa2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:03.990948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d247b-3e74-4dfb-88ce-00a3700faa2e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:04.004821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1097/2219] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:58:04.010430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da5fae-98ff-4c3c-95d3-3faec21f4d28 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:04.018521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da5fae-98ff-4c3c-95d3-3faec21f4d28 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:04.024178 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba96a98-b5e7-40df-a490-6c2059189072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:04.024946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96a98-b5e7-40df-a490-6c2059189072 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:04.025238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96a98-b5e7-40df-a490-6c2059189072 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:04.025514 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96a98-b5e7-40df-a490-6c2059189072 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:04.026209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba96a98-b5e7-40df-a490-6c2059189072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:04.029502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba96a98-b5e7-40df-a490-6c2059189072 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:04.175298 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1123/2220] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:58:04 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:04.179323 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d247b-3e74-4dfb-88ce-00a3700faa2e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:04.190332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d247b-3e74-4dfb-88ce-00a3700faa2e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:04.249843 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527c6c4-f046-4f91-b699-389203ba2e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:04.250541 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c6c4-f046-4f91-b699-389203ba2e54 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:04.250895 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c6c4-f046-4f91-b699-389203ba2e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:04.251254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c6c4-f046-4f91-b699-389203ba2e54 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:04.252087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527c6c4-f046-4f91-b699-389203ba2e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:04.254365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527c6c4-f046-4f91-b699-389203ba2e54 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:04.405948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1098/2221] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:58:04 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:04.407222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba96a98-b5e7-40df-a490-6c2059189072 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:04.418279 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba96a98-b5e7-40df-a490-6c2059189072 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:04.424313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac15334-84a6-4d41-ae2b-aba35db9ad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:04.425206 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac15334-84a6-4d41-ae2b-aba35db9ad85 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:04.425497 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac15334-84a6-4d41-ae2b-aba35db9ad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:04.425774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac15334-84a6-4d41-ae2b-aba35db9ad85 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:04.426520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac15334-84a6-4d41-ae2b-aba35db9ad85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:04.428293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac15334-84a6-4d41-ae2b-aba35db9ad85 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:04.446831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1124/2222] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:04.450717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527c6c4-f046-4f91-b699-389203ba2e54 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:04.463018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527c6c4-f046-4f91-b699-389203ba2e54 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:04.468982 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3a715-0703-4d1f-987a-252219dce7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:04.469738 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3a715-0703-4d1f-987a-252219dce7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:04.470095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3a715-0703-4d1f-987a-252219dce7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:04.470442 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3a715-0703-4d1f-987a-252219dce7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:04.471622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3a715-0703-4d1f-987a-252219dce7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:04.473319 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3a715-0703-4d1f-987a-252219dce7a9 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:04.486909 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1099/2223] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:04.491529 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac15334-84a6-4d41-ae2b-aba35db9ad85 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:04.504599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac15334-84a6-4d41-ae2b-aba35db9ad85 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:04.511118 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7e5e4-e306-434a-8409-7ce2d7b883f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:04.512067 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7e5e4-e306-434a-8409-7ce2d7b883f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:04.512375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7e5e4-e306-434a-8409-7ce2d7b883f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:04.512787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7e5e4-e306-434a-8409-7ce2d7b883f8 admin admin] PATH_INFO: `/v3/projects/d1b2211e247c4268870520a343a303ca/users/c5b1cbf30ffc4cf1835b2aabd5778397/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:04.531417 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7e5e4-e306-434a-8409-7ce2d7b883f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b2211e247c4268870520a343a303ca, user_id=c5b1cbf30ffc4cf1835b2aabd5778397, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:04.534707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7e5e4-e306-434a-8409-7ce2d7b883f8 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:04.623021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1125/2224] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:04 2022] PUT /identity/v3/projects/d1b2211e247c4268870520a343a303ca/users/c5b1cbf30ffc4cf1835b2aabd5778397/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:04.704668 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d1757-1b5c-463e-aa9d-758d5f578406 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:04.705163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d1757-1b5c-463e-aa9d-758d5f578406 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:04.705241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d1757-1b5c-463e-aa9d-758d5f578406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:04.798094 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-476d1757-1b5c-463e-aa9d-758d5f578406 None None] MFA Rules not processed for user `c5b1cbf30ffc4cf1835b2aabd5778397`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:04.799306 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-476d1757-1b5c-463e-aa9d-758d5f578406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:04.943648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:04.960500 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1100/2225] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:05.021426 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7e5e4-e306-434a-8409-7ce2d7b883f8 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:05.023711 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3bb7e5e4-e306-434a-8409-7ce2d7b883f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:05.110716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7e5e4-e306-434a-8409-7ce2d7b883f8 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:05.117450 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a0f1e-2142-4bcc-bf76-9d51218b80d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:05.118135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a0f1e-2142-4bcc-bf76-9d51218b80d6 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:05.118419 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a0f1e-2142-4bcc-bf76-9d51218b80d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:05.118702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a0f1e-2142-4bcc-bf76-9d51218b80d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:05.139527 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a0f1e-2142-4bcc-bf76-9d51218b80d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:05.142117 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a0f1e-2142-4bcc-bf76-9d51218b80d6 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:05.154590 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1126/2226] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:58:06.990698 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:06.998254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f645cd4-0765-4dd9-9152-aa899d28ba86 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:06.999222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f645cd4-0765-4dd9-9152-aa899d28ba86 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:06.999592 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f645cd4-0765-4dd9-9152-aa899d28ba86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:07.024092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-2f645cd4-0765-4dd9-9152-aa899d28ba86 None None] MFA Rules not processed for user `35355d654eee4e0eb81c6d4d334a22e7`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:07.025550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2f645cd4-0765-4dd9-9152-aa899d28ba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:07.051274 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:07.117864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1101/2227] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:07.357329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76180245-bbc1-489f-8411-773f2902b2ba None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:07.357782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76180245-bbc1-489f-8411-773f2902b2ba None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:07.358309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76180245-bbc1-489f-8411-773f2902b2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:07.406932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-76180245-bbc1-489f-8411-773f2902b2ba None None] MFA Rules not processed for user `0a019fdb84494ec294c16dbc936e7d99`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:07.408268 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-76180245-bbc1-489f-8411-773f2902b2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:07.547111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1127/2228] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:07.807912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f645cd4-0765-4dd9-9152-aa899d28ba86 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:07.809736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2f645cd4-0765-4dd9-9152-aa899d28ba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:07.890696 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f645cd4-0765-4dd9-9152-aa899d28ba86 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:07.896514 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92e2b8-e433-4c8c-a286-6745d6107a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:07.897098 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92e2b8-e433-4c8c-a286-6745d6107a8a service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:07.897383 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92e2b8-e433-4c8c-a286-6745d6107a8a service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:07.897661 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92e2b8-e433-4c8c-a286-6745d6107a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:07.906243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92e2b8-e433-4c8c-a286-6745d6107a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:07.907891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92e2b8-e433-4c8c-a286-6745d6107a8a service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:07.932089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1102/2229] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:07.993491 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76180245-bbc1-489f-8411-773f2902b2ba None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:07.994945 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-76180245-bbc1-489f-8411-773f2902b2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:08.062712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76180245-bbc1-489f-8411-773f2902b2ba None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:08.067560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e239ef7-70fb-4c93-b579-af2758b3772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:08.068430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e239ef7-70fb-4c93-b579-af2758b3772d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:08.068713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e239ef7-70fb-4c93-b579-af2758b3772d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:08.068989 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e239ef7-70fb-4c93-b579-af2758b3772d admin admin] PATH_INFO: `/v3/users/a767f424f39c4fbf88b4ec38b0f74144` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:08.070267 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e239ef7-70fb-4c93-b579-af2758b3772d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a767f424f39c4fbf88b4ec38b0f74144)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:08.072294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e239ef7-70fb-4c93-b579-af2758b3772d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:08.284688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6e239ef7-70fb-4c93-b579-af2758b3772d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a767f424f39c4fbf88b4ec38b0f74144'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:08.431583 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6e239ef7-70fb-4c93-b579-af2758b3772d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a767f424f39c4fbf88b4ec38b0f74144'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:08.449091 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6e239ef7-70fb-4c93-b579-af2758b3772d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a767f424f39c4fbf88b4ec38b0f74144'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:08.450437 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6e239ef7-70fb-4c93-b579-af2758b3772d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a767f424f39c4fbf88b4ec38b0f74144'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:08.460909 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-6e239ef7-70fb-4c93-b579-af2758b3772d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a767f424f39c4fbf88b4ec38b0f74144'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:08.469246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1128/2230] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:58:07 2022] DELETE /identity/v3/users/a767f424f39c4fbf88b4ec38b0f74144 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:08.474820 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cabe4f-439d-4ca5-b79f-b29dadfc9b4e None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:08.475965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cabe4f-439d-4ca5-b79f-b29dadfc9b4e None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:08.476130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cabe4f-439d-4ca5-b79f-b29dadfc9b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:08.495936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-58cabe4f-439d-4ca5-b79f-b29dadfc9b4e None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:08.497221 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-58cabe4f-439d-4ca5-b79f-b29dadfc9b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:08.575776 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1103/2231] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:08.585848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e239ef7-70fb-4c93-b579-af2758b3772d admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:08.588254 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6e239ef7-70fb-4c93-b579-af2758b3772d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:08.667135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e239ef7-70fb-4c93-b579-af2758b3772d admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:08.675128 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a3592-a218-410e-aa75-e892ff287430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:08.676016 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3592-a218-410e-aa75-e892ff287430 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:08.676507 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3592-a218-410e-aa75-e892ff287430 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:08.676778 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3592-a218-410e-aa75-e892ff287430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:08.709874 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a3592-a218-410e-aa75-e892ff287430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:08.711351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a3592-a218-410e-aa75-e892ff287430 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:08.728733 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1129/2232] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:09.041446 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:09.339018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cabe4f-439d-4ca5-b79f-b29dadfc9b4e None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:09.339018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-58cabe4f-439d-4ca5-b79f-b29dadfc9b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:09.353626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cabe4f-439d-4ca5-b79f-b29dadfc9b4e None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:09.359791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453784e6-24b9-4656-80bc-d564ccfa472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:09.361047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453784e6-24b9-4656-80bc-d564ccfa472d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:09.361419 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453784e6-24b9-4656-80bc-d564ccfa472d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:09.361903 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453784e6-24b9-4656-80bc-d564ccfa472d admin admin] PATH_INFO: `/v3/projects/60efbc121a8e4653b34e8db0fdcda368` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:09.363335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453784e6-24b9-4656-80bc-d564ccfa472d admin admin] RBAC: Authorizing `identity:delete_project(project_id=60efbc121a8e4653b34e8db0fdcda368)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:09.365491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453784e6-24b9-4656-80bc-d564ccfa472d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:09.516978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a3592-a218-410e-aa75-e892ff287430 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:09.520596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a88a3592-a218-410e-aa75-e892ff287430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:09.522676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-453784e6-24b9-4656-80bc-d564ccfa472d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60efbc121a8e4653b34e8db0fdcda368', 'request_id': 'req-453784e6-24b9-4656-80bc-d564ccfa472d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:09.544129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a3592-a218-410e-aa75-e892ff287430 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:09.600788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d5572-3f35-4a03-a3e3-640d2859eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:09.601665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d5572-3f35-4a03-a3e3-640d2859eda4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:09.601946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d5572-3f35-4a03-a3e3-640d2859eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:09.602217 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d5572-3f35-4a03-a3e3-640d2859eda4 admin admin] PATH_INFO: `/v3/users/c6db66260fcd48b385464f61c7be6b18` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:09.603414 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d5572-3f35-4a03-a3e3-640d2859eda4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6db66260fcd48b385464f61c7be6b18)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:09.605580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d5572-3f35-4a03-a3e3-640d2859eda4 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:09.641249 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-453784e6-24b9-4656-80bc-d564ccfa472d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60efbc121a8e4653b34e8db0fdcda368', 'request_id': 'req-453784e6-24b9-4656-80bc-d564ccfa472d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:09.647904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-453784e6-24b9-4656-80bc-d564ccfa472d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60efbc121a8e4653b34e8db0fdcda368', 'request_id': 'req-453784e6-24b9-4656-80bc-d564ccfa472d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:09.658854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-453784e6-24b9-4656-80bc-d564ccfa472d admin admin] The token cache is being invalidate because project 60efbc121a8e4653b34e8db0fdcda368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:58:09.659169 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-453784e6-24b9-4656-80bc-d564ccfa472d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:09.659833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-453784e6-24b9-4656-80bc-d564ccfa472d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:09.661400 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1104/2233] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:58:09 2022] DELETE /identity/v3/projects/60efbc121a8e4653b34e8db0fdcda368 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:09.666814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab25c3c-7cba-43b3-9262-3c2140a5bde2 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:09.667117 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab25c3c-7cba-43b3-9262-3c2140a5bde2 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:09.667427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab25c3c-7cba-43b3-9262-3c2140a5bde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:09.686198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-aab25c3c-7cba-43b3-9262-3c2140a5bde2 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:09.687420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-aab25c3c-7cba-43b3-9262-3c2140a5bde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:09.695469 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1105/2234] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:09.703474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb474-0caa-4b3f-a3fb-2a3125fedc7a None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:09.703732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb474-0caa-4b3f-a3fb-2a3125fedc7a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:09.704011 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb474-0caa-4b3f-a3fb-2a3125fedc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:09.722575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-40fcb474-0caa-4b3f-a3fb-2a3125fedc7a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:09.723790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-40fcb474-0caa-4b3f-a3fb-2a3125fedc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:09.732360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1106/2235] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:58:09.736413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcb474-0caa-4b3f-a3fb-2a3125fedc7a None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:09.745398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcb474-0caa-4b3f-a3fb-2a3125fedc7a None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:09.750638 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e44782-b876-402d-b163-5c968c60e825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:09.751265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e44782-b876-402d-b163-5c968c60e825 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:09.751581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e44782-b876-402d-b163-5c968c60e825 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:09.751864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e44782-b876-402d-b163-5c968c60e825 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:09.752586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e44782-b876-402d-b163-5c968c60e825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:58:09.752893 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e44782-b876-402d-b163-5c968c60e825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:09.754748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e44782-b876-402d-b163-5c968c60e825 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:09.765950 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1107/2236] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:58:09.770371 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e44782-b876-402d-b163-5c968c60e825 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:09.781465 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e44782-b876-402d-b163-5c968c60e825 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:09.786224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4564cda-eea2-4356-8462-63c22339a396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:09.786873 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4564cda-eea2-4356-8462-63c22339a396 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:09.787161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4564cda-eea2-4356-8462-63c22339a396 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:09.787438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4564cda-eea2-4356-8462-63c22339a396 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:09.788153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4564cda-eea2-4356-8462-63c22339a396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:09.790055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4564cda-eea2-4356-8462-63c22339a396 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:09.872496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-428d5572-3f35-4a03-a3e3-640d2859eda4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6db66260fcd48b385464f61c7be6b18'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:09.956251 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1108/2237] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:58:09 2022] POST /identity/v3/projects => generated 361 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:09.960541 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4564cda-eea2-4356-8462-63c22339a396 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:09.971636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-428d5572-3f35-4a03-a3e3-640d2859eda4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6db66260fcd48b385464f61c7be6b18'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:09.994643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-428d5572-3f35-4a03-a3e3-640d2859eda4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6db66260fcd48b385464f61c7be6b18'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:09.997368 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-428d5572-3f35-4a03-a3e3-640d2859eda4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6db66260fcd48b385464f61c7be6b18'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:10.017223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-428d5572-3f35-4a03-a3e3-640d2859eda4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6db66260fcd48b385464f61c7be6b18'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:10.034725 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1130/2238] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:58:09 2022] DELETE /identity/v3/users/c6db66260fcd48b385464f61c7be6b18 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:10.039266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f03ed-9adb-477e-a7a9-8eed9c65c000 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:10.039624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f03ed-9adb-477e-a7a9-8eed9c65c000 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:10.039977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f03ed-9adb-477e-a7a9-8eed9c65c000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:10.063109 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-0f2f03ed-9adb-477e-a7a9-8eed9c65c000 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:10.064505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-0f2f03ed-9adb-477e-a7a9-8eed9c65c000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:10.086018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:10.098104 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4564cda-eea2-4356-8462-63c22339a396 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:10.138586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1131/2239] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:58:10.140081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f03ed-9adb-477e-a7a9-8eed9c65c000 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:10.145899 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-0f2f03ed-9adb-477e-a7a9-8eed9c65c000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:10.158065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f03ed-9adb-477e-a7a9-8eed9c65c000 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:10.163779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8166a-627e-4903-978d-92192efbd7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:10.165045 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8166a-627e-4903-978d-92192efbd7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:10.165475 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8166a-627e-4903-978d-92192efbd7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:10.165897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8166a-627e-4903-978d-92192efbd7c1 admin admin] PATH_INFO: `/v3/users/c5b1cbf30ffc4cf1835b2aabd5778397` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:10.167377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8166a-627e-4903-978d-92192efbd7c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b1cbf30ffc4cf1835b2aabd5778397)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:10.170051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8166a-627e-4903-978d-92192efbd7c1 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:10.171314 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4534d-b07f-4a63-aca8-0e5ad3752479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:10.172133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4534d-b07f-4a63-aca8-0e5ad3752479 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:10.172582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4534d-b07f-4a63-aca8-0e5ad3752479 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:10.172970 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4534d-b07f-4a63-aca8-0e5ad3752479 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:10.173910 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4534d-b07f-4a63-aca8-0e5ad3752479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:10.176926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4534d-b07f-4a63-aca8-0e5ad3752479 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:10.385761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1109/2240] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:58:09 2022] POST /identity/v3/users => generated 281 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:58:10.387083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4534d-b07f-4a63-aca8-0e5ad3752479 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:10.389953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9ca4534d-b07f-4a63-aca8-0e5ad3752479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:10.434816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-93f8166a-627e-4903-978d-92192efbd7c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b1cbf30ffc4cf1835b2aabd5778397'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:10.506872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4534d-b07f-4a63-aca8-0e5ad3752479 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:10.519335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eb05a-cf02-4ac0-82e4-e61c10826d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:10.519335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eb05a-cf02-4ac0-82e4-e61c10826d37 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:10.519335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eb05a-cf02-4ac0-82e4-e61c10826d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:10.519335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eb05a-cf02-4ac0-82e4-e61c10826d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:10.529782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221eb05a-cf02-4ac0-82e4-e61c10826d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:10.531895 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221eb05a-cf02-4ac0-82e4-e61c10826d37 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:10.542325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1110/2241] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:10.543238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eb05a-cf02-4ac0-82e4-e61c10826d37 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:10.544663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-221eb05a-cf02-4ac0-82e4-e61c10826d37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:10.570050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eb05a-cf02-4ac0-82e4-e61c10826d37 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:10.578431 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-93f8166a-627e-4903-978d-92192efbd7c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b1cbf30ffc4cf1835b2aabd5778397'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:10.587394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387d9a0-8cae-41aa-ba9e-d41acbdb107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:10.587394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387d9a0-8cae-41aa-ba9e-d41acbdb107a admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:10.587394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387d9a0-8cae-41aa-ba9e-d41acbdb107a admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:10.587394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387d9a0-8cae-41aa-ba9e-d41acbdb107a admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:10.588255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387d9a0-8cae-41aa-ba9e-d41acbdb107a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:10.588255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387d9a0-8cae-41aa-ba9e-d41acbdb107a admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:10.605273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1111/2242] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:10.607529 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-93f8166a-627e-4903-978d-92192efbd7c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b1cbf30ffc4cf1835b2aabd5778397'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:10.608461 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-93f8166a-627e-4903-978d-92192efbd7c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b1cbf30ffc4cf1835b2aabd5778397'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:10.614501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387d9a0-8cae-41aa-ba9e-d41acbdb107a admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:10.619786 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d387d9a0-8cae-41aa-ba9e-d41acbdb107a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:10.624123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-93f8166a-627e-4903-978d-92192efbd7c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b1cbf30ffc4cf1835b2aabd5778397'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:10.634500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1132/2243] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:58:10 2022] DELETE /identity/v3/users/c5b1cbf30ffc4cf1835b2aabd5778397 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:10.643375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa010ebd-c325-431d-85ee-2ac4c2ed1eb5 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:10.644006 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa010ebd-c325-431d-85ee-2ac4c2ed1eb5 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:10.644964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa010ebd-c325-431d-85ee-2ac4c2ed1eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:10.651066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387d9a0-8cae-41aa-ba9e-d41acbdb107a admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:10.687492 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-fa010ebd-c325-431d-85ee-2ac4c2ed1eb5 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:10.688953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-fa010ebd-c325-431d-85ee-2ac4c2ed1eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:10.763201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0032-4e25-4cbf-bee1-54ae91d1c2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:10.764571 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0032-4e25-4cbf-bee1-54ae91d1c2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:10.766166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0032-4e25-4cbf-bee1-54ae91d1c2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:10.766666 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0032-4e25-4cbf-bee1-54ae91d1c2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:10.767941 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c0032-4e25-4cbf-bee1-54ae91d1c2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:10.771971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c0032-4e25-4cbf-bee1-54ae91d1c2a1 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:10.792123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1112/2244] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:10.796907 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0032-4e25-4cbf-bee1-54ae91d1c2a1 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:10.801303 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1133/2245] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:10.811802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0032-4e25-4cbf-bee1-54ae91d1c2a1 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:10.818528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa010ebd-c325-431d-85ee-2ac4c2ed1eb5 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:10.821045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a945b-9d5b-4fdb-987f-1c33bfbc1ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:10.822116 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a945b-9d5b-4fdb-987f-1c33bfbc1ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:10.822260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-fa010ebd-c325-431d-85ee-2ac4c2ed1eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:10.822510 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a945b-9d5b-4fdb-987f-1c33bfbc1ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:10.822920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a945b-9d5b-4fdb-987f-1c33bfbc1ce6 admin admin] PATH_INFO: `/v3/projects/32fbca63162f47cea7ca24b3a9fcf62b/users/5d287c8e2ba6463ebe8e8bc93461ee9a/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:10.843194 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a945b-9d5b-4fdb-987f-1c33bfbc1ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fbca63162f47cea7ca24b3a9fcf62b, user_id=5d287c8e2ba6463ebe8e8bc93461ee9a, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:10.846664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a945b-9d5b-4fdb-987f-1c33bfbc1ce6 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:10.907091 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa010ebd-c325-431d-85ee-2ac4c2ed1eb5 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:10.911279 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f408cfc-29d2-4fe3-8f60-690da8cb4d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:10.912150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408cfc-29d2-4fe3-8f60-690da8cb4d8c service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:10.912591 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408cfc-29d2-4fe3-8f60-690da8cb4d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:10.912867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408cfc-29d2-4fe3-8f60-690da8cb4d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:10.962129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f408cfc-29d2-4fe3-8f60-690da8cb4d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:10.962129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f408cfc-29d2-4fe3-8f60-690da8cb4d8c service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:10.962819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1134/2246] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:11.133921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1113/2247] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:10 2022] PUT /identity/v3/projects/32fbca63162f47cea7ca24b3a9fcf62b/users/5d287c8e2ba6463ebe8e8bc93461ee9a/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:11.134994 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a729d5d-3d2f-4c21-8c38-81768155527f None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:11.135389 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a729d5d-3d2f-4c21-8c38-81768155527f None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:11.135932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a729d5d-3d2f-4c21-8c38-81768155527f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:11.183782 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-0a729d5d-3d2f-4c21-8c38-81768155527f None None] MFA Rules not processed for user `5d287c8e2ba6463ebe8e8bc93461ee9a`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:11.184910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-0a729d5d-3d2f-4c21-8c38-81768155527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:11.327382 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1135/2248] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:58:11.343609 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a945b-9d5b-4fdb-987f-1c33bfbc1ce6 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:11.345955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-047a945b-9d5b-4fdb-987f-1c33bfbc1ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:11.501305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a945b-9d5b-4fdb-987f-1c33bfbc1ce6 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:11.501305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde661d-a798-4803-b6d6-a9e5afafdc40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:11.501305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde661d-a798-4803-b6d6-a9e5afafdc40 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:11.501305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde661d-a798-4803-b6d6-a9e5afafdc40 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:11.507906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde661d-a798-4803-b6d6-a9e5afafdc40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:11.507906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde661d-a798-4803-b6d6-a9e5afafdc40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:11.507906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde661d-a798-4803-b6d6-a9e5afafdc40 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:11.507906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1114/2249] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:11.709711 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a729d5d-3d2f-4c21-8c38-81768155527f None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:11.710374 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde661d-a798-4803-b6d6-a9e5afafdc40 service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:11.711301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-0a729d5d-3d2f-4c21-8c38-81768155527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:11.712382 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-dcde661d-a798-4803-b6d6-a9e5afafdc40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:11.828326 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a729d5d-3d2f-4c21-8c38-81768155527f None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:11.836793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:11.838560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:11.839353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:11.840058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] PATH_INFO: `/v3/projects/ef976c55bb0f47f388578a110d0aff70` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:11.842018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef976c55bb0f47f388578a110d0aff70)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:11.844430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:11.867195 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde661d-a798-4803-b6d6-a9e5afafdc40 service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:11.872435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a328f95-d481-4309-a5ec-7c73f5743350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:11.873328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a328f95-d481-4309-a5ec-7c73f5743350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:11.874218 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a328f95-d481-4309-a5ec-7c73f5743350 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:11.874501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a328f95-d481-4309-a5ec-7c73f5743350 admin admin] PATH_INFO: `/v3/projects/d1b2211e247c4268870520a343a303ca` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:11.875883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a328f95-d481-4309-a5ec-7c73f5743350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b2211e247c4268870520a343a303ca)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:11.880335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a328f95-d481-4309-a5ec-7c73f5743350 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:12.070021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9a328f95-d481-4309-a5ec-7c73f5743350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b2211e247c4268870520a343a303ca', 'request_id': 'req-9a328f95-d481-4309-a5ec-7c73f5743350'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.072565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef976c55bb0f47f388578a110d0aff70', 'request_id': 'req-07a705ba-c769-4d30-893f-950802b16fa5'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.153173 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9a328f95-d481-4309-a5ec-7c73f5743350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b2211e247c4268870520a343a303ca', 'request_id': 'req-9a328f95-d481-4309-a5ec-7c73f5743350'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.161091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9a328f95-d481-4309-a5ec-7c73f5743350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b2211e247c4268870520a343a303ca', 'request_id': 'req-9a328f95-d481-4309-a5ec-7c73f5743350'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.172918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9a328f95-d481-4309-a5ec-7c73f5743350 admin admin] The token cache is being invalidate because project d1b2211e247c4268870520a343a303ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:58:12.173225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9a328f95-d481-4309-a5ec-7c73f5743350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.173893 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9a328f95-d481-4309-a5ec-7c73f5743350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.175805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1115/2250] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:58:11 2022] DELETE /identity/v3/projects/d1b2211e247c4268870520a343a303ca => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:12.176893 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d318a-edac-4b03-96a5-f1a1a1269e33 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:12.177186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d318a-edac-4b03-96a5-f1a1a1269e33 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:12.177472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d318a-edac-4b03-96a5-f1a1a1269e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:12.197762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-3a5d318a-edac-4b03-96a5-f1a1a1269e33 None None] MFA Rules not processed for user `0a019fdb84494ec294c16dbc936e7d99`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:12.199028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3a5d318a-edac-4b03-96a5-f1a1a1269e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:12.284843 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef976c55bb0f47f388578a110d0aff70', 'request_id': 'req-07a705ba-c769-4d30-893f-950802b16fa5'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.298847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef976c55bb0f47f388578a110d0aff70', 'request_id': 'req-07a705ba-c769-4d30-893f-950802b16fa5'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.304054 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1116/2251] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:12.319263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] The token cache is being invalidate because project ef976c55bb0f47f388578a110d0aff70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:58:12.320226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.321180 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.326684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1136/2252] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:58:11 2022] DELETE /identity/v3/projects/ef976c55bb0f47f388578a110d0aff70 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:12.328266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d318a-edac-4b03-96a5-f1a1a1269e33 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:12.329998 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3a5d318a-edac-4b03-96a5-f1a1a1269e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:12.437902 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d318a-edac-4b03-96a5-f1a1a1269e33 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:12.442971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46d56d-faff-4065-a25d-3318dc751289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:12.444028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46d56d-faff-4065-a25d-3318dc751289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:12.444382 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46d56d-faff-4065-a25d-3318dc751289 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:12.447583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46d56d-faff-4065-a25d-3318dc751289 admin admin] PATH_INFO: `/v3/users/620c625c52294f1ca63bb64b45934884` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:12.450123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46d56d-faff-4065-a25d-3318dc751289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=620c625c52294f1ca63bb64b45934884)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:12.453235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46d56d-faff-4065-a25d-3318dc751289 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:12.789086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fb46d56d-faff-4065-a25d-3318dc751289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620c625c52294f1ca63bb64b45934884'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.806157 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fb46d56d-faff-4065-a25d-3318dc751289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620c625c52294f1ca63bb64b45934884'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.816519 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fb46d56d-faff-4065-a25d-3318dc751289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620c625c52294f1ca63bb64b45934884'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.817266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fb46d56d-faff-4065-a25d-3318dc751289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620c625c52294f1ca63bb64b45934884'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.853381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:12.889010 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fb46d56d-faff-4065-a25d-3318dc751289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620c625c52294f1ca63bb64b45934884'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:12.901093 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1117/2253] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:58:12 2022] DELETE /identity/v3/users/620c625c52294f1ca63bb64b45934884 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:13.380594 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:13.382203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:13.403619 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a705ba-c769-4d30-893f-950802b16fa5 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:13.478210 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f5d35-99b9-4e6f-951b-d39fff0be495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:13.479690 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f5d35-99b9-4e6f-951b-d39fff0be495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:13.480386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f5d35-99b9-4e6f-951b-d39fff0be495 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:13.481092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f5d35-99b9-4e6f-951b-d39fff0be495 admin admin] PATH_INFO: `/v3/projects/6487afb5f64b4f1986a06fe5c5b939f7` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:13.482984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f5d35-99b9-4e6f-951b-d39fff0be495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6487afb5f64b4f1986a06fe5c5b939f7)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:13.487596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f5d35-99b9-4e6f-951b-d39fff0be495 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:13.514486 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:13.651935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3e8f5d35-99b9-4e6f-951b-d39fff0be495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6487afb5f64b4f1986a06fe5c5b939f7', 'request_id': 'req-3e8f5d35-99b9-4e6f-951b-d39fff0be495'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:13.715040 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3e8f5d35-99b9-4e6f-951b-d39fff0be495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6487afb5f64b4f1986a06fe5c5b939f7', 'request_id': 'req-3e8f5d35-99b9-4e6f-951b-d39fff0be495'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:13.722090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3e8f5d35-99b9-4e6f-951b-d39fff0be495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6487afb5f64b4f1986a06fe5c5b939f7', 'request_id': 'req-3e8f5d35-99b9-4e6f-951b-d39fff0be495'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:13.732773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3e8f5d35-99b9-4e6f-951b-d39fff0be495 admin admin] The token cache is being invalidate because project 6487afb5f64b4f1986a06fe5c5b939f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:58:13.733065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3e8f5d35-99b9-4e6f-951b-d39fff0be495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:13.733731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3e8f5d35-99b9-4e6f-951b-d39fff0be495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:13.735274 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1137/2254] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:58:13 2022] DELETE /identity/v3/projects/6487afb5f64b4f1986a06fe5c5b939f7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:13.740168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f828dd-7af9-483b-ab49-001c6d17842e None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:13.740463 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f828dd-7af9-483b-ab49-001c6d17842e None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:13.740746 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f828dd-7af9-483b-ab49-001c6d17842e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:13.761308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-d6f828dd-7af9-483b-ab49-001c6d17842e None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:13.763257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d6f828dd-7af9-483b-ab49-001c6d17842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:13.823988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1118/2255] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:58:13.833435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff9539-fcb0-4fd4-b559-c4115bec132f None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:13.834992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff9539-fcb0-4fd4-b559-c4115bec132f None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:13.834992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff9539-fcb0-4fd4-b559-c4115bec132f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:13.853192 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-6bff9539-fcb0-4fd4-b559-c4115bec132f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:13.854388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6bff9539-fcb0-4fd4-b559-c4115bec132f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:13.862352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1138/2256] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:13.866576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f828dd-7af9-483b-ab49-001c6d17842e None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:13.876902 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f828dd-7af9-483b-ab49-001c6d17842e None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:13.881933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b38b61-3052-4271-b3e1-52bd3cc2c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:13.886822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38b61-3052-4271-b3e1-52bd3cc2c5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:13.886822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38b61-3052-4271-b3e1-52bd3cc2c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:13.886822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38b61-3052-4271-b3e1-52bd3cc2c5f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:13.886822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b38b61-3052-4271-b3e1-52bd3cc2c5f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:58:13.886822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b38b61-3052-4271-b3e1-52bd3cc2c5f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:13.886822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b38b61-3052-4271-b3e1-52bd3cc2c5f0 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:13.898991 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1119/2257] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:58:13.903644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff9539-fcb0-4fd4-b559-c4115bec132f None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:13.918762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff9539-fcb0-4fd4-b559-c4115bec132f None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:13.926422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03258c-7e5f-49d8-91db-8e1c2101488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:13.926422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03258c-7e5f-49d8-91db-8e1c2101488e admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:13.926869 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03258c-7e5f-49d8-91db-8e1c2101488e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:13.927064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03258c-7e5f-49d8-91db-8e1c2101488e admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:13.927834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03258c-7e5f-49d8-91db-8e1c2101488e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:13.929836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03258c-7e5f-49d8-91db-8e1c2101488e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:14.048599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1139/2258] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:58:13 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:14.052387 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b38b61-3052-4271-b3e1-52bd3cc2c5f0 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:14.065848 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b38b61-3052-4271-b3e1-52bd3cc2c5f0 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:14.127087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d07236-11ec-4d0d-b3e2-dae219aacc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:14.128054 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d07236-11ec-4d0d-b3e2-dae219aacc12 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:14.128368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d07236-11ec-4d0d-b3e2-dae219aacc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:14.128643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d07236-11ec-4d0d-b3e2-dae219aacc12 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:14.129322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d07236-11ec-4d0d-b3e2-dae219aacc12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:14.131732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d07236-11ec-4d0d-b3e2-dae219aacc12 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:14.270346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1120/2259] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:58:14 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:14.275622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03258c-7e5f-49d8-91db-8e1c2101488e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:14.295083 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03258c-7e5f-49d8-91db-8e1c2101488e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:14.306963 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63632ea5-79a8-4ec9-88f1-41c20da0d5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:14.307151 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63632ea5-79a8-4ec9-88f1-41c20da0d5ad admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:14.307484 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63632ea5-79a8-4ec9-88f1-41c20da0d5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:14.307901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63632ea5-79a8-4ec9-88f1-41c20da0d5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:14.308656 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63632ea5-79a8-4ec9-88f1-41c20da0d5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:14.310992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63632ea5-79a8-4ec9-88f1-41c20da0d5ad admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:14.324658 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1140/2260] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:58:14.328620 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d07236-11ec-4d0d-b3e2-dae219aacc12 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:14.338581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d07236-11ec-4d0d-b3e2-dae219aacc12 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:14.343924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1be69-9f7a-48ab-a1f4-7faa8c7efca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:14.344591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1be69-9f7a-48ab-a1f4-7faa8c7efca7 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:14.344879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1be69-9f7a-48ab-a1f4-7faa8c7efca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:14.345189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1be69-9f7a-48ab-a1f4-7faa8c7efca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:14.345918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1be69-9f7a-48ab-a1f4-7faa8c7efca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:14.347583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1be69-9f7a-48ab-a1f4-7faa8c7efca7 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:14.361468 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1121/2261] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:14.362623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63632ea5-79a8-4ec9-88f1-41c20da0d5ad admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:14.372614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63632ea5-79a8-4ec9-88f1-41c20da0d5ad admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:14.377292 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d32874-f806-410e-ad31-d3570f71f1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:14.378432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d32874-f806-410e-ad31-d3570f71f1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:14.378714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d32874-f806-410e-ad31-d3570f71f1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:14.378988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d32874-f806-410e-ad31-d3570f71f1c5 admin admin] PATH_INFO: `/v3/projects/ff1be48c362f439da3848ddd59febe74/users/14f71a91017c4eefa7bf3378ded22396/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:14.394371 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d32874-f806-410e-ad31-d3570f71f1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1be48c362f439da3848ddd59febe74, user_id=14f71a91017c4eefa7bf3378ded22396, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:14.397063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d32874-f806-410e-ad31-d3570f71f1c5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:14.562552 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1141/2262] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:14 2022] PUT /identity/v3/projects/ff1be48c362f439da3848ddd59febe74/users/14f71a91017c4eefa7bf3378ded22396/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:14.566043 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039dc3b-2287-4ccd-a83f-ff390813113a None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:14.566481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039dc3b-2287-4ccd-a83f-ff390813113a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:14.566694 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039dc3b-2287-4ccd-a83f-ff390813113a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:14.595692 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-9039dc3b-2287-4ccd-a83f-ff390813113a None None] MFA Rules not processed for user `14f71a91017c4eefa7bf3378ded22396`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:14.596877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9039dc3b-2287-4ccd-a83f-ff390813113a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:14.661148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1122/2263] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:58:14.665689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d32874-f806-410e-ad31-d3570f71f1c5 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:14.730465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d32874-f806-410e-ad31-d3570f71f1c5 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:14.736592 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbe182-af55-4cdb-8c86-51f90aa6218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:14.737002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbe182-af55-4cdb-8c86-51f90aa6218a admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:14.737286 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbe182-af55-4cdb-8c86-51f90aa6218a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:14.737588 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbe182-af55-4cdb-8c86-51f90aa6218a admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:14.738268 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbe182-af55-4cdb-8c86-51f90aa6218a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:14.740265 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbe182-af55-4cdb-8c86-51f90aa6218a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:14.852751 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1142/2264] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:58:14 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:14.857230 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039dc3b-2287-4ccd-a83f-ff390813113a None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:14.869410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039dc3b-2287-4ccd-a83f-ff390813113a None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:14.930243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cebbe7-25db-437c-917b-36a68266cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:14.936535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cebbe7-25db-437c-917b-36a68266cff2 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:14.936535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cebbe7-25db-437c-917b-36a68266cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:14.936535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cebbe7-25db-437c-917b-36a68266cff2 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:14.936535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cebbe7-25db-437c-917b-36a68266cff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:14.936535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cebbe7-25db-437c-917b-36a68266cff2 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:15.058160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1123/2265] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:58:14 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:58:15.062767 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbe182-af55-4cdb-8c86-51f90aa6218a admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:15.073028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbe182-af55-4cdb-8c86-51f90aa6218a admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:15.080081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54499d5f-6c96-48a6-9272-3fbe047ebca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:15.085261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54499d5f-6c96-48a6-9272-3fbe047ebca8 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:15.085261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54499d5f-6c96-48a6-9272-3fbe047ebca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:15.085261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54499d5f-6c96-48a6-9272-3fbe047ebca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:15.085261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54499d5f-6c96-48a6-9272-3fbe047ebca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:15.085261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54499d5f-6c96-48a6-9272-3fbe047ebca8 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:15.098068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1143/2266] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:15.100926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cebbe7-25db-437c-917b-36a68266cff2 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:15.112366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cebbe7-25db-437c-917b-36a68266cff2 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:15.117219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530306-0114-4b79-b413-b3aca7679aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:15.118105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530306-0114-4b79-b413-b3aca7679aca admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:15.118390 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530306-0114-4b79-b413-b3aca7679aca admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:15.118697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530306-0114-4b79-b413-b3aca7679aca admin admin] PATH_INFO: `/v3/projects/d314e5bc8d104b74ae786af1598f7e65/users/eb45605b8de94d76805ca5b4a2a8a202/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:15.134070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03530306-0114-4b79-b413-b3aca7679aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d314e5bc8d104b74ae786af1598f7e65, user_id=eb45605b8de94d76805ca5b4a2a8a202, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:15.136774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03530306-0114-4b79-b413-b3aca7679aca admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:15.236663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1124/2267] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:15 2022] PUT /identity/v3/projects/d314e5bc8d104b74ae786af1598f7e65/users/eb45605b8de94d76805ca5b4a2a8a202/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:15.237804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54499d5f-6c96-48a6-9272-3fbe047ebca8 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:15.248938 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54499d5f-6c96-48a6-9272-3fbe047ebca8 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:15.325965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd4107-3631-499e-b2d1-982b39f66861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:15.326702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4107-3631-499e-b2d1-982b39f66861 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:15.327731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4107-3631-499e-b2d1-982b39f66861 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:15.328015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4107-3631-499e-b2d1-982b39f66861 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:15.329332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd4107-3631-499e-b2d1-982b39f66861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:15.331015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd4107-3631-499e-b2d1-982b39f66861 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:15.344865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1144/2268] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:15.346052 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530306-0114-4b79-b413-b3aca7679aca admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:15.358032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530306-0114-4b79-b413-b3aca7679aca admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:15.362818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d39fd2-1318-4dfa-b1ce-e5337780a93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:15.363738 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d39fd2-1318-4dfa-b1ce-e5337780a93f admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:15.364023 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d39fd2-1318-4dfa-b1ce-e5337780a93f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:15.364296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d39fd2-1318-4dfa-b1ce-e5337780a93f admin admin] PATH_INFO: `/v3/projects/d314e5bc8d104b74ae786af1598f7e65/users/eb45605b8de94d76805ca5b4a2a8a202/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:15.366481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d39fd2-1318-4dfa-b1ce-e5337780a93f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d314e5bc8d104b74ae786af1598f7e65, user_id=eb45605b8de94d76805ca5b4a2a8a202, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:15.369214 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d39fd2-1318-4dfa-b1ce-e5337780a93f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:15.386488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1125/2269] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:15 2022] PUT /identity/v3/projects/d314e5bc8d104b74ae786af1598f7e65/users/eb45605b8de94d76805ca5b4a2a8a202/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:58:15.391279 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba179c30-36c8-4f97-b1a4-7fcb8c563f72 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:15.391672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba179c30-36c8-4f97-b1a4-7fcb8c563f72 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:15.392027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba179c30-36c8-4f97-b1a4-7fcb8c563f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:15.420409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ba179c30-36c8-4f97-b1a4-7fcb8c563f72 None None] MFA Rules not processed for user `eb45605b8de94d76805ca5b4a2a8a202`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:15.421647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ba179c30-36c8-4f97-b1a4-7fcb8c563f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:15.493227 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1145/2270] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:58:15.505229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d39fd2-1318-4dfa-b1ce-e5337780a93f admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:15.507039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-90d39fd2-1318-4dfa-b1ce-e5337780a93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:15.570552 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d39fd2-1318-4dfa-b1ce-e5337780a93f admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:15.574247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924d9dc-d744-4a18-b2d7-d39027cd579d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:15.574932 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924d9dc-d744-4a18-b2d7-d39027cd579d service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:15.575215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924d9dc-d744-4a18-b2d7-d39027cd579d service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:15.575517 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924d9dc-d744-4a18-b2d7-d39027cd579d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:15.590992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924d9dc-d744-4a18-b2d7-d39027cd579d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:15.592500 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924d9dc-d744-4a18-b2d7-d39027cd579d service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:15.603340 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1126/2271] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:15.693028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:15.714200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba179c30-36c8-4f97-b1a4-7fcb8c563f72 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:15.724924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba179c30-36c8-4f97-b1a4-7fcb8c563f72 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:15.728615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33f5a6-e0b8-4bf8-b409-e44439fa9d0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:15.729252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33f5a6-e0b8-4bf8-b409-e44439fa9d0e service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:15.729532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33f5a6-e0b8-4bf8-b409-e44439fa9d0e service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:15.729828 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33f5a6-e0b8-4bf8-b409-e44439fa9d0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:15.786448 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33f5a6-e0b8-4bf8-b409-e44439fa9d0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:15.787938 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33f5a6-e0b8-4bf8-b409-e44439fa9d0e service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:15.796713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1146/2272] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:16.429869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:16.544813 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:18.264012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:18.329570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:19.315207 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:19.552618 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:20.236299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924d9dc-d744-4a18-b2d7-d39027cd579d service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:20.258743 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:20.309685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924d9dc-d744-4a18-b2d7-d39027cd579d service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:20.314719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667cc07-f695-4f36-94c7-9ed98aa39b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:20.315592 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667cc07-f695-4f36-94c7-9ed98aa39b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:20.315874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667cc07-f695-4f36-94c7-9ed98aa39b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:20.316148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667cc07-f695-4f36-94c7-9ed98aa39b9e admin admin] PATH_INFO: `/v3/users/14f71a91017c4eefa7bf3378ded22396` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:20.317349 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667cc07-f695-4f36-94c7-9ed98aa39b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f71a91017c4eefa7bf3378ded22396)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:20.319291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667cc07-f695-4f36-94c7-9ed98aa39b9e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:20.550136 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4667cc07-f695-4f36-94c7-9ed98aa39b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f71a91017c4eefa7bf3378ded22396'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:20.563620 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4667cc07-f695-4f36-94c7-9ed98aa39b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f71a91017c4eefa7bf3378ded22396'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:20.570698 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4667cc07-f695-4f36-94c7-9ed98aa39b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f71a91017c4eefa7bf3378ded22396'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:20.571362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4667cc07-f695-4f36-94c7-9ed98aa39b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f71a91017c4eefa7bf3378ded22396'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:20.748925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4667cc07-f695-4f36-94c7-9ed98aa39b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f71a91017c4eefa7bf3378ded22396'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:20.764998 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1127/2273] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:58:20 2022] DELETE /identity/v3/users/14f71a91017c4eefa7bf3378ded22396 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:20.765493 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfa3b1-b99e-4b8a-9162-c5a5066a8760 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:20.765793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfa3b1-b99e-4b8a-9162-c5a5066a8760 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:20.766078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfa3b1-b99e-4b8a-9162-c5a5066a8760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:20.827876 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-c9cfa3b1-b99e-4b8a-9162-c5a5066a8760 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:20.827876 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c9cfa3b1-b99e-4b8a-9162-c5a5066a8760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:20.920400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1147/2274] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:20.936216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667cc07-f695-4f36-94c7-9ed98aa39b9e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:20.937756 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4667cc07-f695-4f36-94c7-9ed98aa39b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:21.044822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667cc07-f695-4f36-94c7-9ed98aa39b9e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:21.048720 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa398b38-e81c-498c-9dd6-6570ab235330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:21.049777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398b38-e81c-498c-9dd6-6570ab235330 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:21.049777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398b38-e81c-498c-9dd6-6570ab235330 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:21.049993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398b38-e81c-498c-9dd6-6570ab235330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:21.061178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa398b38-e81c-498c-9dd6-6570ab235330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:21.063011 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa398b38-e81c-498c-9dd6-6570ab235330 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:21.073240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1128/2275] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:21.502893 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfa3b1-b99e-4b8a-9162-c5a5066a8760 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:21.504962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c9cfa3b1-b99e-4b8a-9162-c5a5066a8760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:21.519053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfa3b1-b99e-4b8a-9162-c5a5066a8760 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:21.523949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:21.524825 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:21.525322 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:21.525768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] PATH_INFO: `/v3/projects/ff1be48c362f439da3848ddd59febe74` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:21.527005 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1be48c362f439da3848ddd59febe74)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:21.529140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:21.723382 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1be48c362f439da3848ddd59febe74', 'request_id': 'req-88e488c5-cb78-4c29-9ad3-f544620e89ce'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:21.723883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:21.775038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1be48c362f439da3848ddd59febe74', 'request_id': 'req-88e488c5-cb78-4c29-9ad3-f544620e89ce'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:21.782964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1be48c362f439da3848ddd59febe74', 'request_id': 'req-88e488c5-cb78-4c29-9ad3-f544620e89ce'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:21.793946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] The token cache is being invalidate because project ff1be48c362f439da3848ddd59febe74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:58:21.794315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:21.794988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:21.796870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1148/2276] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:58:21 2022] DELETE /identity/v3/projects/ff1be48c362f439da3848ddd59febe74 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:21.800575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa398b38-e81c-498c-9dd6-6570ab235330 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:21.813147 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa398b38-e81c-498c-9dd6-6570ab235330 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:21.894538 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95333eef-c6ad-484f-9e12-460e48a1e33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:21.895480 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95333eef-c6ad-484f-9e12-460e48a1e33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:21.895951 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95333eef-c6ad-484f-9e12-460e48a1e33c admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:21.896267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95333eef-c6ad-484f-9e12-460e48a1e33c admin admin] PATH_INFO: `/v3/users/eb45605b8de94d76805ca5b4a2a8a202` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:21.897513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95333eef-c6ad-484f-9e12-460e48a1e33c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb45605b8de94d76805ca5b4a2a8a202)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:21.899491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95333eef-c6ad-484f-9e12-460e48a1e33c admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:21.924053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:21.964312 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:21.970443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:21.988237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e488c5-cb78-4c29-9ad3-f544620e89ce admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:21.993890 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4a15b-2c83-4f1f-addd-289e29c78230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:21.994917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a15b-2c83-4f1f-addd-289e29c78230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:21.995287 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a15b-2c83-4f1f-addd-289e29c78230 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:21.995644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a15b-2c83-4f1f-addd-289e29c78230 admin admin] PATH_INFO: `/v3/users/9d0edfde83a640d1875ea4924dd83dfc` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:21.997605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4a15b-2c83-4f1f-addd-289e29c78230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0edfde83a640d1875ea4924dd83dfc)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:21.999474 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4a15b-2c83-4f1f-addd-289e29c78230 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:22.197476 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-95333eef-c6ad-484f-9e12-460e48a1e33c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb45605b8de94d76805ca5b4a2a8a202'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:22.197476 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-95333eef-c6ad-484f-9e12-460e48a1e33c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb45605b8de94d76805ca5b4a2a8a202'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:22.197476 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-95333eef-c6ad-484f-9e12-460e48a1e33c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb45605b8de94d76805ca5b4a2a8a202'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:22.197476 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-95333eef-c6ad-484f-9e12-460e48a1e33c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb45605b8de94d76805ca5b4a2a8a202'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:22.305929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-95333eef-c6ad-484f-9e12-460e48a1e33c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb45605b8de94d76805ca5b4a2a8a202'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:22.313179 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1129/2277] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:58:21 2022] DELETE /identity/v3/users/eb45605b8de94d76805ca5b4a2a8a202 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:22.320310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-aea4a15b-2c83-4f1f-addd-289e29c78230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0edfde83a640d1875ea4924dd83dfc'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:22.426929 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-aea4a15b-2c83-4f1f-addd-289e29c78230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0edfde83a640d1875ea4924dd83dfc'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:22.440788 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-aea4a15b-2c83-4f1f-addd-289e29c78230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0edfde83a640d1875ea4924dd83dfc'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:22.441509 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-aea4a15b-2c83-4f1f-addd-289e29c78230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0edfde83a640d1875ea4924dd83dfc'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:22.448751 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-aea4a15b-2c83-4f1f-addd-289e29c78230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0edfde83a640d1875ea4924dd83dfc'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:22.455655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1149/2278] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:58:21 2022] DELETE /identity/v3/users/9d0edfde83a640d1875ea4924dd83dfc => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:22.460586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb31dc-3dd8-4711-bfe3-e8ab5a21e1dd None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:22.460877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb31dc-3dd8-4711-bfe3-e8ab5a21e1dd None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:22.463748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb31dc-3dd8-4711-bfe3-e8ab5a21e1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:22.480628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-a5bb31dc-3dd8-4711-bfe3-e8ab5a21e1dd None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:22.482132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a5bb31dc-3dd8-4711-bfe3-e8ab5a21e1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:22.552814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1130/2279] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:22.570279 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4a15b-2c83-4f1f-addd-289e29c78230 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:22.573152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-aea4a15b-2c83-4f1f-addd-289e29c78230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:22.660977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4a15b-2c83-4f1f-addd-289e29c78230 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:22.665169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fff22-bc05-45c5-a046-da81ce02161c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:22.666939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fff22-bc05-45c5-a046-da81ce02161c service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:22.667381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fff22-bc05-45c5-a046-da81ce02161c service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:22.667862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fff22-bc05-45c5-a046-da81ce02161c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:22.681767 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fff22-bc05-45c5-a046-da81ce02161c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:22.684335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fff22-bc05-45c5-a046-da81ce02161c service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:22.710603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1150/2280] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:22.918926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb31dc-3dd8-4711-bfe3-e8ab5a21e1dd None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:22.920663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a5bb31dc-3dd8-4711-bfe3-e8ab5a21e1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:22.934499 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb31dc-3dd8-4711-bfe3-e8ab5a21e1dd None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:22.942673 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe546e78-5d6e-4742-98d4-a8800ee3fab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:22.943618 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe546e78-5d6e-4742-98d4-a8800ee3fab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:22.943906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe546e78-5d6e-4742-98d4-a8800ee3fab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:22.944359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe546e78-5d6e-4742-98d4-a8800ee3fab8 admin admin] PATH_INFO: `/v3/projects/d314e5bc8d104b74ae786af1598f7e65` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:22.946089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe546e78-5d6e-4742-98d4-a8800ee3fab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d314e5bc8d104b74ae786af1598f7e65)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:22.948488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe546e78-5d6e-4742-98d4-a8800ee3fab8 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:23.224051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fe546e78-5d6e-4742-98d4-a8800ee3fab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd314e5bc8d104b74ae786af1598f7e65', 'request_id': 'req-fe546e78-5d6e-4742-98d4-a8800ee3fab8'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:23.303226 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fe546e78-5d6e-4742-98d4-a8800ee3fab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd314e5bc8d104b74ae786af1598f7e65', 'request_id': 'req-fe546e78-5d6e-4742-98d4-a8800ee3fab8'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:23.310185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fe546e78-5d6e-4742-98d4-a8800ee3fab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd314e5bc8d104b74ae786af1598f7e65', 'request_id': 'req-fe546e78-5d6e-4742-98d4-a8800ee3fab8'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:23.320819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fe546e78-5d6e-4742-98d4-a8800ee3fab8 admin admin] The token cache is being invalidate because project d314e5bc8d104b74ae786af1598f7e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:58:23.321119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fe546e78-5d6e-4742-98d4-a8800ee3fab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:23.322114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fe546e78-5d6e-4742-98d4-a8800ee3fab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:23.324599 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1131/2281] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:58:22 2022] DELETE /identity/v3/projects/d314e5bc8d104b74ae786af1598f7e65 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:23.329329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db233f-c3b8-454f-af25-c0065475f50a None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:23.329694 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db233f-c3b8-454f-af25-c0065475f50a None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:23.330048 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db233f-c3b8-454f-af25-c0065475f50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:23.351646 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-45db233f-c3b8-454f-af25-c0065475f50a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:23.352944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-45db233f-c3b8-454f-af25-c0065475f50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:23.423136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1151/2282] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:58:23.426940 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:23.432018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bd42d-0a37-4ad2-9a22-951c212028ac None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:23.433533 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bd42d-0a37-4ad2-9a22-951c212028ac None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:23.433670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bd42d-0a37-4ad2-9a22-951c212028ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:23.457774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-5a1bd42d-0a37-4ad2-9a22-951c212028ac None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:23.459028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5a1bd42d-0a37-4ad2-9a22-951c212028ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:23.469564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1132/2283] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:23.473609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db233f-c3b8-454f-af25-c0065475f50a None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:23.483629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db233f-c3b8-454f-af25-c0065475f50a None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:23.488406 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1c99c-efa6-46f3-a2de-98c371fc0701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:23.489162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1c99c-efa6-46f3-a2de-98c371fc0701 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:23.489517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1c99c-efa6-46f3-a2de-98c371fc0701 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:23.489869 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1c99c-efa6-46f3-a2de-98c371fc0701 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:23.490670 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1c99c-efa6-46f3-a2de-98c371fc0701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:58:23.491045 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1c99c-efa6-46f3-a2de-98c371fc0701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:23.492779 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1c99c-efa6-46f3-a2de-98c371fc0701 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:23.505622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1152/2284] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:58:23.510097 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bd42d-0a37-4ad2-9a22-951c212028ac None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:23.520198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bd42d-0a37-4ad2-9a22-951c212028ac None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:23.524920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2842a-1471-478f-8fe4-c52132fb2204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:23.525579 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2842a-1471-478f-8fe4-c52132fb2204 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:23.525860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2842a-1471-478f-8fe4-c52132fb2204 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:23.526137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2842a-1471-478f-8fe4-c52132fb2204 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:23.526830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2842a-1471-478f-8fe4-c52132fb2204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:23.528796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2842a-1471-478f-8fe4-c52132fb2204 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:23.604630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1c99c-efa6-46f3-a2de-98c371fc0701 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:23.606533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-67c1c99c-efa6-46f3-a2de-98c371fc0701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:23.627041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1c99c-efa6-46f3-a2de-98c371fc0701 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:23.628377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7270af-a421-4d37-81b8-5f2307cc1385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:23.629674 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7270af-a421-4d37-81b8-5f2307cc1385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:23.630109 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7270af-a421-4d37-81b8-5f2307cc1385 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:23.630510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7270af-a421-4d37-81b8-5f2307cc1385 admin admin] PATH_INFO: `/v3/projects/bd67a169bb5b461b991ca4da53ba0bf8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:23.632220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7270af-a421-4d37-81b8-5f2307cc1385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd67a169bb5b461b991ca4da53ba0bf8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:23.634503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7270af-a421-4d37-81b8-5f2307cc1385 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:23.641249 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1133/2285] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:58:23 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:23.653953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2842a-1471-478f-8fe4-c52132fb2204 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:23.748425 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2842a-1471-478f-8fe4-c52132fb2204 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:23.753834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5b7e2-20d0-4bf4-a59a-b04070628c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:23.754698 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5b7e2-20d0-4bf4-a59a-b04070628c7e admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:23.758322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5b7e2-20d0-4bf4-a59a-b04070628c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:23.758322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5b7e2-20d0-4bf4-a59a-b04070628c7e admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:23.758322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5b7e2-20d0-4bf4-a59a-b04070628c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:23.758322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5b7e2-20d0-4bf4-a59a-b04070628c7e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:23.806523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-7a7270af-a421-4d37-81b8-5f2307cc1385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd67a169bb5b461b991ca4da53ba0bf8', 'request_id': 'req-7a7270af-a421-4d37-81b8-5f2307cc1385'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:23.907976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1134/2286] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:58:23 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:23.913640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5b7e2-20d0-4bf4-a59a-b04070628c7e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:23.928297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5b7e2-20d0-4bf4-a59a-b04070628c7e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:23.969845 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-7a7270af-a421-4d37-81b8-5f2307cc1385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd67a169bb5b461b991ca4da53ba0bf8', 'request_id': 'req-7a7270af-a421-4d37-81b8-5f2307cc1385'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:23.978082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-7a7270af-a421-4d37-81b8-5f2307cc1385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd67a169bb5b461b991ca4da53ba0bf8', 'request_id': 'req-7a7270af-a421-4d37-81b8-5f2307cc1385'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:23.994316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-7a7270af-a421-4d37-81b8-5f2307cc1385 admin admin] The token cache is being invalidate because project bd67a169bb5b461b991ca4da53ba0bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:58:23.994616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-7a7270af-a421-4d37-81b8-5f2307cc1385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:23.995297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-7a7270af-a421-4d37-81b8-5f2307cc1385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:23.998100 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1153/2287] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:58:23 2022] DELETE /identity/v3/projects/bd67a169bb5b461b991ca4da53ba0bf8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:24.003303 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4decb-46dd-4b7c-a04e-9ab2b82db357 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.003512 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc149c-154c-43b6-9062-6509b5ba3551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:24.003627 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4decb-46dd-4b7c-a04e-9ab2b82db357 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.003832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4decb-46dd-4b7c-a04e-9ab2b82db357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.004004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc149c-154c-43b6-9062-6509b5ba3551 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.004240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc149c-154c-43b6-9062-6509b5ba3551 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.004520 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc149c-154c-43b6-9062-6509b5ba3551 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.005277 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc149c-154c-43b6-9062-6509b5ba3551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:24.007382 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc149c-154c-43b6-9062-6509b5ba3551 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:24.019502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1135/2288] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:24.022259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc149c-154c-43b6-9062-6509b5ba3551 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:24.023489 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-38a4decb-46dd-4b7c-a04e-9ab2b82db357 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:24.024675 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-38a4decb-46dd-4b7c-a04e-9ab2b82db357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:24.025082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-eefc149c-154c-43b6-9062-6509b5ba3551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:24.034351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1154/2289] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:24.040780 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc149c-154c-43b6-9062-6509b5ba3551 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:24.045630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25ffcc-588b-4c90-9386-366c67284a7f None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.045630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25ffcc-588b-4c90-9386-366c67284a7f None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.045630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25ffcc-588b-4c90-9386-366c67284a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.047172 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba3450-65d3-411b-a1d1-b9c410292fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:24.048122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba3450-65d3-411b-a1d1-b9c410292fdf admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.048617 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba3450-65d3-411b-a1d1-b9c410292fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.049082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba3450-65d3-411b-a1d1-b9c410292fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.050058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba3450-65d3-411b-a1d1-b9c410292fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:24.052129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba3450-65d3-411b-a1d1-b9c410292fdf admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:24.062992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-9b25ffcc-588b-4c90-9386-366c67284a7f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:24.064328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9b25ffcc-588b-4c90-9386-366c67284a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:24.066234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1136/2290] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:24.070159 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:24.071539 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba3450-65d3-411b-a1d1-b9c410292fdf admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:24.076261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1155/2291] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:24.081048 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25ffcc-588b-4c90-9386-366c67284a7f None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:24.087070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba3450-65d3-411b-a1d1-b9c410292fdf admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:24.093177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25ffcc-588b-4c90-9386-366c67284a7f None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:24.100281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cde488-7829-4d60-a79b-7dc83083dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:24.101195 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cde488-7829-4d60-a79b-7dc83083dcc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.101301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6439d2b-4603-4823-9f44-4c78f36f3541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:24.101511 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cde488-7829-4d60-a79b-7dc83083dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.101752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cde488-7829-4d60-a79b-7dc83083dcc8 admin admin] PATH_INFO: `/v3/projects/a8449c87f0ee4a9089eb6ada69e8fe4f/users/cd94cb3f331146739886b05831eb0d9a/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.101955 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6439d2b-4603-4823-9f44-4c78f36f3541 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.102589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6439d2b-4603-4823-9f44-4c78f36f3541 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.102880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6439d2b-4603-4823-9f44-4c78f36f3541 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.103736 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6439d2b-4603-4823-9f44-4c78f36f3541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:58:24.104045 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6439d2b-4603-4823-9f44-4c78f36f3541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:24.105856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6439d2b-4603-4823-9f44-4c78f36f3541 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:24.119275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1156/2292] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:58:24.123368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cde488-7829-4d60-a79b-7dc83083dcc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8449c87f0ee4a9089eb6ada69e8fe4f, user_id=cd94cb3f331146739886b05831eb0d9a, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:24.124445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6439d2b-4603-4823-9f44-4c78f36f3541 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:24.126169 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cde488-7829-4d60-a79b-7dc83083dcc8 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:24.133221 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:24.137774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6439d2b-4603-4823-9f44-4c78f36f3541 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:24.142528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60078b4-f1e0-48d4-8997-81c07db0dcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:24.143309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60078b4-f1e0-48d4-8997-81c07db0dcce admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.143642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60078b4-f1e0-48d4-8997-81c07db0dcce admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.143925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60078b4-f1e0-48d4-8997-81c07db0dcce admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.144619 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60078b4-f1e0-48d4-8997-81c07db0dcce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:24.146486 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60078b4-f1e0-48d4-8997-81c07db0dcce admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:24.282781 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1137/2293] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:24 2022] PUT /identity/v3/projects/a8449c87f0ee4a9089eb6ada69e8fe4f/users/cd94cb3f331146739886b05831eb0d9a/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:24.284169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1157/2294] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:58:24 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:24.288440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cde488-7829-4d60-a79b-7dc83083dcc8 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:24.294557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94cb2a-706c-40e6-901b-5bcc8d631a76 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.295798 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94cb2a-706c-40e6-901b-5bcc8d631a76 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.296325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94cb2a-706c-40e6-901b-5bcc8d631a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.329500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-bf94cb2a-706c-40e6-901b-5bcc8d631a76 None None] MFA Rules not processed for user `cd94cb3f331146739886b05831eb0d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:24.330827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-bf94cb2a-706c-40e6-901b-5bcc8d631a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:24.362683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cde488-7829-4d60-a79b-7dc83083dcc8 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:24.408898 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1158/2295] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:24.423560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94cb2a-706c-40e6-901b-5bcc8d631a76 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:24.428063 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070cece-6233-4599-9f78-e4dbae65c9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:24.428785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070cece-6233-4599-9f78-e4dbae65c9cc admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.429073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070cece-6233-4599-9f78-e4dbae65c9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.429398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070cece-6233-4599-9f78-e4dbae65c9cc admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.430091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070cece-6233-4599-9f78-e4dbae65c9cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:24.430852 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-bf94cb2a-706c-40e6-901b-5bcc8d631a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:24.432299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070cece-6233-4599-9f78-e4dbae65c9cc admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:24.499095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1138/2296] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:58:24 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:24.503740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070cece-6233-4599-9f78-e4dbae65c9cc admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:24.512390 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94cb2a-706c-40e6-901b-5bcc8d631a76 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:24.514717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070cece-6233-4599-9f78-e4dbae65c9cc admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:24.516281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a460ad9-bbd7-4bc7-812e-474630a32838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:24.516959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a460ad9-bbd7-4bc7-812e-474630a32838 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.517243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a460ad9-bbd7-4bc7-812e-474630a32838 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.517523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a460ad9-bbd7-4bc7-812e-474630a32838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.519766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335b484-3cd4-434b-b0b1-caf4f8b58080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:24.520529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b484-3cd4-434b-b0b1-caf4f8b58080 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.520883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b484-3cd4-434b-b0b1-caf4f8b58080 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.521230 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b484-3cd4-434b-b0b1-caf4f8b58080 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.522165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335b484-3cd4-434b-b0b1-caf4f8b58080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:24.524251 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335b484-3cd4-434b-b0b1-caf4f8b58080 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:24.527873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a460ad9-bbd7-4bc7-812e-474630a32838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:24.529342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a460ad9-bbd7-4bc7-812e-474630a32838 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:24.540183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1139/2297] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:24.540384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1159/2298] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:24.541318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335b484-3cd4-434b-b0b1-caf4f8b58080 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:24.552016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335b484-3cd4-434b-b0b1-caf4f8b58080 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:24.560832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a460ad9-bbd7-4bc7-812e-474630a32838 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:24.561378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c2d73-99ac-46a2-a0b6-76d43d726043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:24.562074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c2d73-99ac-46a2-a0b6-76d43d726043 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.562357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c2d73-99ac-46a2-a0b6-76d43d726043 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.562628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c2d73-99ac-46a2-a0b6-76d43d726043 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.563537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c2d73-99ac-46a2-a0b6-76d43d726043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:24.565447 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c2d73-99ac-46a2-a0b6-76d43d726043 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:24.571923 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a460ad9-bbd7-4bc7-812e-474630a32838 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:24.578028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a4e9c-6cdd-47b1-934f-c47ad77de9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:24.578248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1140/2299] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:58:24.579037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a4e9c-6cdd-47b1-934f-c47ad77de9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.579302 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a4e9c-6cdd-47b1-934f-c47ad77de9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.579623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a4e9c-6cdd-47b1-934f-c47ad77de9ed admin admin] PATH_INFO: `/v3/users/cd94cb3f331146739886b05831eb0d9a` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.580894 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a4e9c-6cdd-47b1-934f-c47ad77de9ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd94cb3f331146739886b05831eb0d9a)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:24.582858 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a4e9c-6cdd-47b1-934f-c47ad77de9ed admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:24.582975 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c2d73-99ac-46a2-a0b6-76d43d726043 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:24.596223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c2d73-99ac-46a2-a0b6-76d43d726043 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:24.604021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694bbe0-bb34-43a7-ac36-c69b4bbc4aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:24.605251 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694bbe0-bb34-43a7-ac36-c69b4bbc4aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.605559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694bbe0-bb34-43a7-ac36-c69b4bbc4aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.605961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694bbe0-bb34-43a7-ac36-c69b4bbc4aa0 admin admin] PATH_INFO: `/v3/projects/84be36f03f2e428c889ab7080baa9171/users/294ba02ef580469aa7c31a70dc50b9f1/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.622666 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694bbe0-bb34-43a7-ac36-c69b4bbc4aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84be36f03f2e428c889ab7080baa9171, user_id=294ba02ef580469aa7c31a70dc50b9f1, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:24.625394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694bbe0-bb34-43a7-ac36-c69b4bbc4aa0 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:24.715648 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1141/2300] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:24 2022] PUT /identity/v3/projects/84be36f03f2e428c889ab7080baa9171/users/294ba02ef580469aa7c31a70dc50b9f1/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:24.726960 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca075458-b63b-40dd-a804-128cdec41fb2 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.727479 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca075458-b63b-40dd-a804-128cdec41fb2 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.727918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca075458-b63b-40dd-a804-128cdec41fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.756661 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-ca075458-b63b-40dd-a804-128cdec41fb2 None None] MFA Rules not processed for user `294ba02ef580469aa7c31a70dc50b9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:24.757891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ca075458-b63b-40dd-a804-128cdec41fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:24.793136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-ce7a4e9c-6cdd-47b1-934f-c47ad77de9ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd94cb3f331146739886b05831eb0d9a'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:24.836482 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1142/2301] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:24.847628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca075458-b63b-40dd-a804-128cdec41fb2 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:24.849569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ca075458-b63b-40dd-a804-128cdec41fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:24.857391 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-ce7a4e9c-6cdd-47b1-934f-c47ad77de9ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd94cb3f331146739886b05831eb0d9a'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:24.881272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-ce7a4e9c-6cdd-47b1-934f-c47ad77de9ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd94cb3f331146739886b05831eb0d9a'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:24.882837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-ce7a4e9c-6cdd-47b1-934f-c47ad77de9ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd94cb3f331146739886b05831eb0d9a'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:24.898859 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-ce7a4e9c-6cdd-47b1-934f-c47ad77de9ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd94cb3f331146739886b05831eb0d9a'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:24.907122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1160/2302] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:58:24 2022] DELETE /identity/v3/users/cd94cb3f331146739886b05831eb0d9a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:58:24.913294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7289917-b74c-4397-bdc3-a78c761ab7f4 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.913609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7289917-b74c-4397-bdc3-a78c761ab7f4 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.913906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7289917-b74c-4397-bdc3-a78c761ab7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.926630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca075458-b63b-40dd-a804-128cdec41fb2 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:24.938378 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-c7289917-b74c-4397-bdc3-a78c761ab7f4 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:24.940297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c7289917-b74c-4397-bdc3-a78c761ab7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:24.982667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62998d-d257-467d-8b60-a1056f07f84c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:24.983466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62998d-d257-467d-8b60-a1056f07f84c service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:24.983845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62998d-d257-467d-8b60-a1056f07f84c service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:24.984220 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62998d-d257-467d-8b60-a1056f07f84c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:24.986206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0d62998d-d257-467d-8b60-a1056f07f84c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:25.021743 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1161/2303] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:25.033094 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7289917-b74c-4397-bdc3-a78c761ab7f4 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:25.034557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c7289917-b74c-4397-bdc3-a78c761ab7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:25.057049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62998d-d257-467d-8b60-a1056f07f84c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:25.058596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62998d-d257-467d-8b60-a1056f07f84c service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:25.068973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1143/2304] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:58:25.107013 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7289917-b74c-4397-bdc3-a78c761ab7f4 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:25.116221 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eea5e5-ade3-4bc0-b754-f3e1ac327586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:25.117118 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eea5e5-ade3-4bc0-b754-f3e1ac327586 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:25.117403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eea5e5-ade3-4bc0-b754-f3e1ac327586 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:25.120196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eea5e5-ade3-4bc0-b754-f3e1ac327586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:25.141239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eea5e5-ade3-4bc0-b754-f3e1ac327586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:25.143363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eea5e5-ade3-4bc0-b754-f3e1ac327586 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:25.157338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1162/2305] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:58:25.733219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62998d-d257-467d-8b60-a1056f07f84c service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:25.735151 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0d62998d-d257-467d-8b60-a1056f07f84c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:25.773869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62998d-d257-467d-8b60-a1056f07f84c service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:25.778775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c0b9d-f566-4781-a707-ce7182056f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:25.779675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c0b9d-f566-4781-a707-ce7182056f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:25.779962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c0b9d-f566-4781-a707-ce7182056f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:25.780290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c0b9d-f566-4781-a707-ce7182056f35 admin admin] PATH_INFO: `/v3/projects/a8449c87f0ee4a9089eb6ada69e8fe4f` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:25.781494 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c0b9d-f566-4781-a707-ce7182056f35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8449c87f0ee4a9089eb6ada69e8fe4f)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:25.783463 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c0b9d-f566-4781-a707-ce7182056f35 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:25.986677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-177c0b9d-f566-4781-a707-ce7182056f35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8449c87f0ee4a9089eb6ada69e8fe4f', 'request_id': 'req-177c0b9d-f566-4781-a707-ce7182056f35'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:26.084994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-177c0b9d-f566-4781-a707-ce7182056f35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8449c87f0ee4a9089eb6ada69e8fe4f', 'request_id': 'req-177c0b9d-f566-4781-a707-ce7182056f35'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:26.100361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-177c0b9d-f566-4781-a707-ce7182056f35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8449c87f0ee4a9089eb6ada69e8fe4f', 'request_id': 'req-177c0b9d-f566-4781-a707-ce7182056f35'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:26.115780 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-177c0b9d-f566-4781-a707-ce7182056f35 admin admin] The token cache is being invalidate because project a8449c87f0ee4a9089eb6ada69e8fe4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:58:26.116472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-177c0b9d-f566-4781-a707-ce7182056f35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:26.117438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-177c0b9d-f566-4781-a707-ce7182056f35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:26.119629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1144/2306] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:58:25 2022] DELETE /identity/v3/projects/a8449c87f0ee4a9089eb6ada69e8fe4f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:26.124774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda2ee2-2c72-41cf-a213-bf0e9bd7871c None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:26.125262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda2ee2-2c72-41cf-a213-bf0e9bd7871c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:26.125344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda2ee2-2c72-41cf-a213-bf0e9bd7871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:26.169817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:26.180623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-3eda2ee2-2c72-41cf-a213-bf0e9bd7871c None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:26.181541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3eda2ee2-2c72-41cf-a213-bf0e9bd7871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:26.244684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1163/2307] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:26.254539 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac71549-765b-46b7-8aa5-d0d3733894ef None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:26.254835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac71549-765b-46b7-8aa5-d0d3733894ef None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:26.255992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac71549-765b-46b7-8aa5-d0d3733894ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:26.280495 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-cac71549-765b-46b7-8aa5-d0d3733894ef None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:26.282048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-cac71549-765b-46b7-8aa5-d0d3733894ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:26.290542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1145/2308] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:26.294731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda2ee2-2c72-41cf-a213-bf0e9bd7871c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:26.305308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda2ee2-2c72-41cf-a213-bf0e9bd7871c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:26.310706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867adfe-0db0-4177-a507-68d90440b88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:26.311881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867adfe-0db0-4177-a507-68d90440b88e admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:26.311881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867adfe-0db0-4177-a507-68d90440b88e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:26.312079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867adfe-0db0-4177-a507-68d90440b88e admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:26.312781 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867adfe-0db0-4177-a507-68d90440b88e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:58:26.313086 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867adfe-0db0-4177-a507-68d90440b88e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:26.314697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867adfe-0db0-4177-a507-68d90440b88e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:26.326967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1164/2309] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:58:26.331369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac71549-765b-46b7-8aa5-d0d3733894ef None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:26.340664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac71549-765b-46b7-8aa5-d0d3733894ef None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:26.345428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6a9a0-5216-4022-9d92-47cff63303d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:26.346081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6a9a0-5216-4022-9d92-47cff63303d9 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:26.346365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6a9a0-5216-4022-9d92-47cff63303d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:26.346643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6a9a0-5216-4022-9d92-47cff63303d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:26.347331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6a9a0-5216-4022-9d92-47cff63303d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:26.349376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6a9a0-5216-4022-9d92-47cff63303d9 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:26.429800 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1146/2310] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:58:26 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:26.434562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867adfe-0db0-4177-a507-68d90440b88e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:26.444605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867adfe-0db0-4177-a507-68d90440b88e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:26.502538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa886fb8-3fcb-4271-9b18-81a0662f9b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:26.503212 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa886fb8-3fcb-4271-9b18-81a0662f9b22 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:26.503527 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa886fb8-3fcb-4271-9b18-81a0662f9b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:26.503806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa886fb8-3fcb-4271-9b18-81a0662f9b22 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:26.504503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa886fb8-3fcb-4271-9b18-81a0662f9b22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:26.506441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa886fb8-3fcb-4271-9b18-81a0662f9b22 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:26.671859 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1165/2311] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:58:26 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:26.675119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6a9a0-5216-4022-9d92-47cff63303d9 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:26.687939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6a9a0-5216-4022-9d92-47cff63303d9 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:26.693655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1131f54-ca06-44e1-b4f7-1a45a8dc2259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:26.694646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1131f54-ca06-44e1-b4f7-1a45a8dc2259 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:26.694646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1131f54-ca06-44e1-b4f7-1a45a8dc2259 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:26.694876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1131f54-ca06-44e1-b4f7-1a45a8dc2259 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:26.695714 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1131f54-ca06-44e1-b4f7-1a45a8dc2259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:26.697415 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1131f54-ca06-44e1-b4f7-1a45a8dc2259 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:26.711485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1147/2312] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:26.714692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa886fb8-3fcb-4271-9b18-81a0662f9b22 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:26.727008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa886fb8-3fcb-4271-9b18-81a0662f9b22 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:26.732616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bcf16-3948-4609-9dbc-e685a027259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:26.733352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bcf16-3948-4609-9dbc-e685a027259f admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:26.733660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bcf16-3948-4609-9dbc-e685a027259f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:26.733973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bcf16-3948-4609-9dbc-e685a027259f admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:26.734562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bcf16-3948-4609-9dbc-e685a027259f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:26.736375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bcf16-3948-4609-9dbc-e685a027259f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:26.749497 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1166/2313] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:26.753833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1131f54-ca06-44e1-b4f7-1a45a8dc2259 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:26.769265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1131f54-ca06-44e1-b4f7-1a45a8dc2259 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:26.773851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc6c9e-1027-46f7-b180-cfca3ed92ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:26.774873 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc6c9e-1027-46f7-b180-cfca3ed92ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:26.775220 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc6c9e-1027-46f7-b180-cfca3ed92ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:26.775598 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc6c9e-1027-46f7-b180-cfca3ed92ecf admin admin] PATH_INFO: `/v3/projects/5d153e50ec244b8298ea39574cc45faa/users/81e07f9327dc4de78bbe6812474ff9cb/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:26.798137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc6c9e-1027-46f7-b180-cfca3ed92ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d153e50ec244b8298ea39574cc45faa, user_id=81e07f9327dc4de78bbe6812474ff9cb, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:26.801150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc6c9e-1027-46f7-b180-cfca3ed92ecf admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:26.984341 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1148/2314] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:26 2022] PUT /identity/v3/projects/5d153e50ec244b8298ea39574cc45faa/users/81e07f9327dc4de78bbe6812474ff9cb/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:26.994443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc465b7-a633-4bf3-9306-144cbf9b60d1 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:26.994739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc465b7-a633-4bf3-9306-144cbf9b60d1 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:26.995020 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc465b7-a633-4bf3-9306-144cbf9b60d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:27.027650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-ecc465b7-a633-4bf3-9306-144cbf9b60d1 None None] MFA Rules not processed for user `81e07f9327dc4de78bbe6812474ff9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:27.027650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ecc465b7-a633-4bf3-9306-144cbf9b60d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:27.111211 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1167/2315] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:27.113310 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc6c9e-1027-46f7-b180-cfca3ed92ecf admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:27.177234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc6c9e-1027-46f7-b180-cfca3ed92ecf admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:27.182312 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641809bf-95a8-41b3-9ed4-4a4a24636625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:27.183023 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641809bf-95a8-41b3-9ed4-4a4a24636625 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:27.183310 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641809bf-95a8-41b3-9ed4-4a4a24636625 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:27.183637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641809bf-95a8-41b3-9ed4-4a4a24636625 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:27.184397 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641809bf-95a8-41b3-9ed4-4a4a24636625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:27.186510 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641809bf-95a8-41b3-9ed4-4a4a24636625 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:27.333178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1149/2316] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:58:27 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:58:27.337389 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc465b7-a633-4bf3-9306-144cbf9b60d1 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:27.348570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc465b7-a633-4bf3-9306-144cbf9b60d1 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:27.406259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcda17-1d16-4e15-a11a-f13f6aff2b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:27.406929 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcda17-1d16-4e15-a11a-f13f6aff2b1b admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:27.407215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcda17-1d16-4e15-a11a-f13f6aff2b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:27.407533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcda17-1d16-4e15-a11a-f13f6aff2b1b admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:27.408223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcda17-1d16-4e15-a11a-f13f6aff2b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:27.410219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcda17-1d16-4e15-a11a-f13f6aff2b1b admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:27.485945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:27.492042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1168/2317] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:58:27 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:27.496161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641809bf-95a8-41b3-9ed4-4a4a24636625 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:27.506957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641809bf-95a8-41b3-9ed4-4a4a24636625 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:27.512599 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37e2ad-6fe1-4e80-9d85-0a209853a54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:27.513258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37e2ad-6fe1-4e80-9d85-0a209853a54f admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:27.513543 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37e2ad-6fe1-4e80-9d85-0a209853a54f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:27.513819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37e2ad-6fe1-4e80-9d85-0a209853a54f admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:27.514591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37e2ad-6fe1-4e80-9d85-0a209853a54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:27.516227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37e2ad-6fe1-4e80-9d85-0a209853a54f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:27.527397 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1150/2318] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:27.531393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcda17-1d16-4e15-a11a-f13f6aff2b1b admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:27.541334 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcda17-1d16-4e15-a11a-f13f6aff2b1b admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:27.546089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85217ec5-a389-4573-ad3f-d495c4ff6ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:27.546820 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217ec5-a389-4573-ad3f-d495c4ff6ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:27.547126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217ec5-a389-4573-ad3f-d495c4ff6ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:27.547434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217ec5-a389-4573-ad3f-d495c4ff6ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:27.548239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85217ec5-a389-4573-ad3f-d495c4ff6ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:27.549999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85217ec5-a389-4573-ad3f-d495c4ff6ba2 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:27.560428 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1169/2319] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:27.564462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37e2ad-6fe1-4e80-9d85-0a209853a54f admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:27.576505 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37e2ad-6fe1-4e80-9d85-0a209853a54f admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:27.581421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3199147-1a54-48f7-9309-c4ebf579c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:27.582311 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3199147-1a54-48f7-9309-c4ebf579c471 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:27.582594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3199147-1a54-48f7-9309-c4ebf579c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:27.582869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3199147-1a54-48f7-9309-c4ebf579c471 admin admin] PATH_INFO: `/v3/projects/56c9e34f63e843d2be9546db60123ad8/users/345b1f52c1814d768f2b24819534147b/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:27.598006 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3199147-1a54-48f7-9309-c4ebf579c471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c9e34f63e843d2be9546db60123ad8, user_id=345b1f52c1814d768f2b24819534147b, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:27.600702 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3199147-1a54-48f7-9309-c4ebf579c471 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:27.844327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1151/2320] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:27 2022] PUT /identity/v3/projects/56c9e34f63e843d2be9546db60123ad8/users/345b1f52c1814d768f2b24819534147b/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:27.861848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc68a-1bcd-4f5a-9072-9b7c14b4b87d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:27.862134 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc68a-1bcd-4f5a-9072-9b7c14b4b87d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:27.862409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc68a-1bcd-4f5a-9072-9b7c14b4b87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:27.890516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-2aefc68a-1bcd-4f5a-9072-9b7c14b4b87d None None] MFA Rules not processed for user `345b1f52c1814d768f2b24819534147b`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:27.891736 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2aefc68a-1bcd-4f5a-9072-9b7c14b4b87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:27.955124 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1170/2321] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:27.959792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3199147-1a54-48f7-9309-c4ebf579c471 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:28.050989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3199147-1a54-48f7-9309-c4ebf579c471 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:28.056120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fb575-edb4-4153-b36f-48898ee8555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:28.056785 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fb575-edb4-4153-b36f-48898ee8555e admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:28.057073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fb575-edb4-4153-b36f-48898ee8555e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:28.057347 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fb575-edb4-4153-b36f-48898ee8555e admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:28.058107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fb575-edb4-4153-b36f-48898ee8555e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:28.060088 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fb575-edb4-4153-b36f-48898ee8555e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:28.138374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd21ba-a56a-4fae-824f-0eca4527ad5a None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:28.138576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd21ba-a56a-4fae-824f-0eca4527ad5a None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:28.138857 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd21ba-a56a-4fae-824f-0eca4527ad5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:28.157076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-f1fd21ba-a56a-4fae-824f-0eca4527ad5a None None] MFA Rules not processed for user `294ba02ef580469aa7c31a70dc50b9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:28.158479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f1fd21ba-a56a-4fae-824f-0eca4527ad5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:28.219859 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1171/2322] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:58:28.224740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1152/2323] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:58:27 2022] POST /identity/v3/projects => generated 377 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:58:28.229923 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd21ba-a56a-4fae-824f-0eca4527ad5a None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:28.241142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd21ba-a56a-4fae-824f-0eca4527ad5a None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:28.304995 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a911c-5e77-4ae9-b1bd-7dafb5028e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:28.305763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a911c-5e77-4ae9-b1bd-7dafb5028e33 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:28.306048 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a911c-5e77-4ae9-b1bd-7dafb5028e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:28.306418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a911c-5e77-4ae9-b1bd-7dafb5028e33 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:28.307005 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a911c-5e77-4ae9-b1bd-7dafb5028e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:28.309054 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a911c-5e77-4ae9-b1bd-7dafb5028e33 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:28.412380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1172/2324] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:58:28 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:58:28.414100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fb575-edb4-4153-b36f-48898ee8555e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:28.424409 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fb575-edb4-4153-b36f-48898ee8555e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:28.429035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebc0b8-98b4-4921-974c-6adf041bbb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:28.429699 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebc0b8-98b4-4921-974c-6adf041bbb6a admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:28.429982 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebc0b8-98b4-4921-974c-6adf041bbb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:28.430256 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebc0b8-98b4-4921-974c-6adf041bbb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:28.430983 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebc0b8-98b4-4921-974c-6adf041bbb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:28.432613 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebc0b8-98b4-4921-974c-6adf041bbb6a admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:28.443302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1153/2325] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:28.448219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a911c-5e77-4ae9-b1bd-7dafb5028e33 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:28.459780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a911c-5e77-4ae9-b1bd-7dafb5028e33 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:28.465032 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f7f53-2ff8-4680-a21a-cd99dfa29367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:28.465914 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f7f53-2ff8-4680-a21a-cd99dfa29367 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:28.466191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f7f53-2ff8-4680-a21a-cd99dfa29367 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:28.466463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f7f53-2ff8-4680-a21a-cd99dfa29367 admin admin] PATH_INFO: `/v3/projects/9374994072f54f0ab1f4e080c4c92b65/users/850eb43a190f4ba090522bc5dd62656d/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:28.491115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f7f53-2ff8-4680-a21a-cd99dfa29367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9374994072f54f0ab1f4e080c4c92b65, user_id=850eb43a190f4ba090522bc5dd62656d, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:28.491115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f7f53-2ff8-4680-a21a-cd99dfa29367 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:28.615351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:28.622186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1173/2326] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:28 2022] PUT /identity/v3/projects/9374994072f54f0ab1f4e080c4c92b65/users/850eb43a190f4ba090522bc5dd62656d/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:28.626241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebc0b8-98b4-4921-974c-6adf041bbb6a admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:28.640281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebc0b8-98b4-4921-974c-6adf041bbb6a admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:28.700443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95bf12-814c-40e2-bf78-3938f446dec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:28.701113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95bf12-814c-40e2-bf78-3938f446dec1 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:28.701398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95bf12-814c-40e2-bf78-3938f446dec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:28.701699 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95bf12-814c-40e2-bf78-3938f446dec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:28.702448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95bf12-814c-40e2-bf78-3938f446dec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:28.704080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95bf12-814c-40e2-bf78-3938f446dec1 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:28.714748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1154/2327] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:58:28.718957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f7f53-2ff8-4680-a21a-cd99dfa29367 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:28.729308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f7f53-2ff8-4680-a21a-cd99dfa29367 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:28.734452 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab4e7a-cb54-462a-a07c-70b4a21151ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:28.735336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab4e7a-cb54-462a-a07c-70b4a21151ea admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:28.735649 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab4e7a-cb54-462a-a07c-70b4a21151ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:28.735924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab4e7a-cb54-462a-a07c-70b4a21151ea admin admin] PATH_INFO: `/v3/projects/9374994072f54f0ab1f4e080c4c92b65/users/850eb43a190f4ba090522bc5dd62656d/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:28.737877 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab4e7a-cb54-462a-a07c-70b4a21151ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9374994072f54f0ab1f4e080c4c92b65, user_id=850eb43a190f4ba090522bc5dd62656d, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:28.740582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab4e7a-cb54-462a-a07c-70b4a21151ea admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:28.750801 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1174/2328] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:58:28 2022] PUT /identity/v3/projects/9374994072f54f0ab1f4e080c4c92b65/users/850eb43a190f4ba090522bc5dd62656d/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:28.822804 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c547e-4474-48c4-ab30-ac179fcffed8 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:28.823101 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c547e-4474-48c4-ab30-ac179fcffed8 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:28.823641 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c547e-4474-48c4-ab30-ac179fcffed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:28.860164 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-8d6c547e-4474-48c4-ab30-ac179fcffed8 None None] MFA Rules not processed for user `850eb43a190f4ba090522bc5dd62656d`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:28.862510 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8d6c547e-4474-48c4-ab30-ac179fcffed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:28.946738 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1155/2329] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:28.958544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab4e7a-cb54-462a-a07c-70b4a21151ea admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:28.960345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3fab4e7a-cb54-462a-a07c-70b4a21151ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:29.019609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab4e7a-cb54-462a-a07c-70b4a21151ea admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:29.023118 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507b6aa-88dd-4b27-bc98-91c29a1a6c95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:29.023814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507b6aa-88dd-4b27-bc98-91c29a1a6c95 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:29.024148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507b6aa-88dd-4b27-bc98-91c29a1a6c95 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:29.024428 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507b6aa-88dd-4b27-bc98-91c29a1a6c95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:29.067166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:29.085659 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507b6aa-88dd-4b27-bc98-91c29a1a6c95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:29.087331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507b6aa-88dd-4b27-bc98-91c29a1a6c95 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:29.096785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1175/2330] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:29.753977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:31.152051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:31.811614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:32.403539 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c547e-4474-48c4-ab30-ac179fcffed8 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:32.405146 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8d6c547e-4474-48c4-ab30-ac179fcffed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:32.417715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c547e-4474-48c4-ab30-ac179fcffed8 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:32.421551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a99a8-00bf-499f-83a7-775173d4d6c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:32.422200 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a99a8-00bf-499f-83a7-775173d4d6c4 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:32.422491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a99a8-00bf-499f-83a7-775173d4d6c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:32.422753 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a99a8-00bf-499f-83a7-775173d4d6c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:32.491765 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a99a8-00bf-499f-83a7-775173d4d6c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:32.493232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a99a8-00bf-499f-83a7-775173d4d6c4 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:32.504667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1156/2331] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:58:32.845510 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:34.693648 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:34.695215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507b6aa-88dd-4b27-bc98-91c29a1a6c95 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:34.695215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507b6aa-88dd-4b27-bc98-91c29a1a6c95 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:34.695215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e10c0-0e7a-4dd4-b12b-249b8c22ce80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:34.695215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e10c0-0e7a-4dd4-b12b-249b8c22ce80 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:34.696465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e10c0-0e7a-4dd4-b12b-249b8c22ce80 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:34.696465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e10c0-0e7a-4dd4-b12b-249b8c22ce80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:34.696465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e10c0-0e7a-4dd4-b12b-249b8c22ce80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:34.696465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e10c0-0e7a-4dd4-b12b-249b8c22ce80 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:34.696465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1176/2332] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:34.722837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:35.259622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:35.602979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:36.155282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:36.319643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:37.125208 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:37.212348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:37.695557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:38.031351 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:38.220441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:38.650652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:38.680910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:38.849133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:38.873867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:39.268056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:39.700319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:40.639674 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:40.715359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a99a8-00bf-499f-83a7-775173d4d6c4 service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:40.784498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a99a8-00bf-499f-83a7-775173d4d6c4 service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:40.789250 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36185444-ab4c-492e-aace-087a41014d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:40.790273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36185444-ab4c-492e-aace-087a41014d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:40.790572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36185444-ab4c-492e-aace-087a41014d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:40.790850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36185444-ab4c-492e-aace-087a41014d46 admin admin] PATH_INFO: `/v3/users/81e07f9327dc4de78bbe6812474ff9cb` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:40.792070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36185444-ab4c-492e-aace-087a41014d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e07f9327dc4de78bbe6812474ff9cb)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:40.794057 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36185444-ab4c-492e-aace-087a41014d46 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:40.938613 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-36185444-ab4c-492e-aace-087a41014d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e07f9327dc4de78bbe6812474ff9cb'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:40.951701 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-36185444-ab4c-492e-aace-087a41014d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e07f9327dc4de78bbe6812474ff9cb'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:40.958530 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-36185444-ab4c-492e-aace-087a41014d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e07f9327dc4de78bbe6812474ff9cb'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:40.959298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-36185444-ab4c-492e-aace-087a41014d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e07f9327dc4de78bbe6812474ff9cb'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:41.032659 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-36185444-ab4c-492e-aace-087a41014d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e07f9327dc4de78bbe6812474ff9cb'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:41.042577 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1157/2333] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:58:40 2022] DELETE /identity/v3/users/81e07f9327dc4de78bbe6812474ff9cb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:41.043464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772c9b6-5f1b-4b7a-82ec-d437f929bcb5 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:41.044439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772c9b6-5f1b-4b7a-82ec-d437f929bcb5 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:41.044534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772c9b6-5f1b-4b7a-82ec-d437f929bcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:41.062365 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-9772c9b6-5f1b-4b7a-82ec-d437f929bcb5 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:41.063588 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9772c9b6-5f1b-4b7a-82ec-d437f929bcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:41.123293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1177/2334] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:41.125154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:41.133244 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36185444-ab4c-492e-aace-087a41014d46 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:41.134735 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-36185444-ab4c-492e-aace-087a41014d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:41.195811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36185444-ab4c-492e-aace-087a41014d46 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:41.200198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36775b31-0498-4f3e-bf1a-71007a5cea54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:41.200853 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36775b31-0498-4f3e-bf1a-71007a5cea54 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:41.201139 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36775b31-0498-4f3e-bf1a-71007a5cea54 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:41.201427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36775b31-0498-4f3e-bf1a-71007a5cea54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:41.210834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36775b31-0498-4f3e-bf1a-71007a5cea54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:41.212305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36775b31-0498-4f3e-bf1a-71007a5cea54 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:41.222256 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1158/2335] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:41.489677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:41.583177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:41.748635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772c9b6-5f1b-4b7a-82ec-d437f929bcb5 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:41.748635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9772c9b6-5f1b-4b7a-82ec-d437f929bcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:41.760307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772c9b6-5f1b-4b7a-82ec-d437f929bcb5 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:41.766251 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:41.767780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:41.767780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:41.767780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] PATH_INFO: `/v3/projects/5d153e50ec244b8298ea39574cc45faa` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:41.769161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d153e50ec244b8298ea39574cc45faa)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:41.771481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:41.822017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:41.913340 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:41.926776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d153e50ec244b8298ea39574cc45faa', 'request_id': 'req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:41.992977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d153e50ec244b8298ea39574cc45faa', 'request_id': 'req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:42.000221 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d153e50ec244b8298ea39574cc45faa', 'request_id': 'req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:42.010946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] The token cache is being invalidate because project 5d153e50ec244b8298ea39574cc45faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:58:42.011237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:42.011912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:42.014068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1178/2336] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:58:41 2022] DELETE /identity/v3/projects/5d153e50ec244b8298ea39574cc45faa => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:42.018606 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36775b31-0498-4f3e-bf1a-71007a5cea54 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:42.029539 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36775b31-0498-4f3e-bf1a-71007a5cea54 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:42.085826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0283501-2f13-49a7-b2d9-64e309c3d470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:42.086742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0283501-2f13-49a7-b2d9-64e309c3d470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:42.087020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0283501-2f13-49a7-b2d9-64e309c3d470 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:42.087369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0283501-2f13-49a7-b2d9-64e309c3d470 admin admin] PATH_INFO: `/v3/users/345b1f52c1814d768f2b24819534147b` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:42.088673 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0283501-2f13-49a7-b2d9-64e309c3d470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=345b1f52c1814d768f2b24819534147b)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:42.091233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0283501-2f13-49a7-b2d9-64e309c3d470 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:42.156934 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:42.190780 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:42.291950 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b0283501-2f13-49a7-b2d9-64e309c3d470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345b1f52c1814d768f2b24819534147b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:42.303506 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b0283501-2f13-49a7-b2d9-64e309c3d470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345b1f52c1814d768f2b24819534147b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:42.310915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b0283501-2f13-49a7-b2d9-64e309c3d470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345b1f52c1814d768f2b24819534147b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:42.312015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b0283501-2f13-49a7-b2d9-64e309c3d470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345b1f52c1814d768f2b24819534147b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:42.693330 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b0283501-2f13-49a7-b2d9-64e309c3d470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345b1f52c1814d768f2b24819534147b'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:42.700304 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1159/2337] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:58:42 2022] DELETE /identity/v3/users/345b1f52c1814d768f2b24819534147b => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:42.985402 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:43.077161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:43.232777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:43.234870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:43.259000 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8d0af-d571-4b2f-aaab-80b1cbc91c2b admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:43.317285 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:43.318142 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:43.318423 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:43.318698 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] PATH_INFO: `/v3/projects/56c9e34f63e843d2be9546db60123ad8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:43.319914 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c9e34f63e843d2be9546db60123ad8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:43.321833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:43.452266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c9e34f63e843d2be9546db60123ad8', 'request_id': 'req-5973e768-8bd9-485a-a92d-1b6a206a02eb'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:43.518605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c9e34f63e843d2be9546db60123ad8', 'request_id': 'req-5973e768-8bd9-485a-a92d-1b6a206a02eb'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:43.525666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c9e34f63e843d2be9546db60123ad8', 'request_id': 'req-5973e768-8bd9-485a-a92d-1b6a206a02eb'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:43.530056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:43.536280 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] The token cache is being invalidate because project 56c9e34f63e843d2be9546db60123ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:58:43.536577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:43.537209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:43.538746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1179/2338] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:58:43 2022] DELETE /identity/v3/projects/56c9e34f63e843d2be9546db60123ad8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:43.542713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0283501-2f13-49a7-b2d9-64e309c3d470 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:43.544196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-b0283501-2f13-49a7-b2d9-64e309c3d470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:43.558557 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0283501-2f13-49a7-b2d9-64e309c3d470 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:43.610396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:43.614544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1899-b5d8-4124-b845-e5fc64849ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:43.618133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1899-b5d8-4124-b845-e5fc64849ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:43.618133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1899-b5d8-4124-b845-e5fc64849ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:43.618133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1899-b5d8-4124-b845-e5fc64849ea1 admin admin] PATH_INFO: `/v3/users/850eb43a190f4ba090522bc5dd62656d` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:43.618133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a1899-b5d8-4124-b845-e5fc64849ea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=850eb43a190f4ba090522bc5dd62656d)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:43.619135 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a1899-b5d8-4124-b845-e5fc64849ea1 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:43.819118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-cd2a1899-b5d8-4124-b845-e5fc64849ea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '850eb43a190f4ba090522bc5dd62656d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:43.831393 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-cd2a1899-b5d8-4124-b845-e5fc64849ea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '850eb43a190f4ba090522bc5dd62656d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:43.838503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-cd2a1899-b5d8-4124-b845-e5fc64849ea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '850eb43a190f4ba090522bc5dd62656d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:43.839332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-cd2a1899-b5d8-4124-b845-e5fc64849ea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '850eb43a190f4ba090522bc5dd62656d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:43.922007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-cd2a1899-b5d8-4124-b845-e5fc64849ea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '850eb43a190f4ba090522bc5dd62656d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:43.928640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1160/2339] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:58:43 2022] DELETE /identity/v3/users/850eb43a190f4ba090522bc5dd62656d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:44.071019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:44.198853 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:44.495362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:44.497198 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:44.511645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973e768-8bd9-485a-a92d-1b6a206a02eb admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:44.522474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:44.580068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:44.580845 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:44.581129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:44.581429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] PATH_INFO: `/v3/projects/9374994072f54f0ab1f4e080c4c92b65` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:44.582579 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9374994072f54f0ab1f4e080c4c92b65)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:44.584524 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:44.722215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9374994072f54f0ab1f4e080c4c92b65', 'request_id': 'req-c06520c8-7ce2-4440-ae05-d103ed90d371'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:44.816211 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9374994072f54f0ab1f4e080c4c92b65', 'request_id': 'req-c06520c8-7ce2-4440-ae05-d103ed90d371'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:44.823192 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9374994072f54f0ab1f4e080c4c92b65', 'request_id': 'req-c06520c8-7ce2-4440-ae05-d103ed90d371'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:44.833726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] The token cache is being invalidate because project 9374994072f54f0ab1f4e080c4c92b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:58:44.833963 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:44.834635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:44.836228 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1180/2340] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:58:44 2022] DELETE /identity/v3/projects/9374994072f54f0ab1f4e080c4c92b65 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:58:44.982485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:45.090003 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:45.190391 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:45.296039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:45.470636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:45.579124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:45.607834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:45.800475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:45.828120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:45.936848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:45.958971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:46.027566 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:46.108310 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:46.147387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:46.284626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:46.318537 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:46.448039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:46.590804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:46.616034 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:46.745086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:46.768008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:46.793234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:46.842826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:46.890853 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:46.919331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:47.004737 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:47.033239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:47.061694 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:47.202726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:47.238802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:47.562809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:47.590518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:47.664502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:47.756582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:47.838411 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:47.924320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:48.007432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:48.035963 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:48.162153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:48.190371 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:48.299072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:48.404317 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:48.430146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:48.595994 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:48.624501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:48.698986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:48.727338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:48.841620 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:48.958471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:49.038665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:49.073457 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:58.870070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:59.158712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=74,keystone:DELETE=19,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:18.964741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93cce0-2e21-4993-ab9e-f91f33d528b6 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:18.965402 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93cce0-2e21-4993-ab9e-f91f33d528b6 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:18.965402 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93cce0-2e21-4993-ab9e-f91f33d528b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:19.024792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-8b93cce0-2e21-4993-ab9e-f91f33d528b6 None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:19.025990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8b93cce0-2e21-4993-ab9e-f91f33d528b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:19.097225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1161/2341] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 13:59:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:19.140232 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:19.141746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:19.246287 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06520c8-7ce2-4440-ae05-d103ed90d371 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:19.259157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8918ca-ff4d-409b-9b8b-fa746900794d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:19.259349 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8918ca-ff4d-409b-9b8b-fa746900794d service swift] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:19.259665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8918ca-ff4d-409b-9b8b-fa746900794d service swift] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:19.259948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8918ca-ff4d-409b-9b8b-fa746900794d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:19.268970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8918ca-ff4d-409b-9b8b-fa746900794d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:19.270553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8918ca-ff4d-409b-9b8b-fa746900794d service swift] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:19.278929 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1181/2342] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 13:59:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:59:20.278563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3ab96-1b73-4151-99dd-793507ee2b0e None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:20.279114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3ab96-1b73-4151-99dd-793507ee2b0e None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:20.279114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3ab96-1b73-4151-99dd-793507ee2b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:20.305396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-05c3ab96-1b73-4151-99dd-793507ee2b0e None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:20.306505 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-05c3ab96-1b73-4151-99dd-793507ee2b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:20.315700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1162/2343] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 2 13:59:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:20.330378 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8918ca-ff4d-409b-9b8b-fa746900794d service swift] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:20.341574 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8918ca-ff4d-409b-9b8b-fa746900794d service swift] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:20.346884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a4a89-35b7-431b-a809-ebd013b0042b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:20.347722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a4a89-35b7-431b-a809-ebd013b0042b service swift] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:20.348108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a4a89-35b7-431b-a809-ebd013b0042b service swift] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:20.348576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a4a89-35b7-431b-a809-ebd013b0042b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:20.357744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a4a89-35b7-431b-a809-ebd013b0042b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:20.361241 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a4a89-35b7-431b-a809-ebd013b0042b service swift] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:20.370762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1182/2344] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 13:59:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:59:20.681625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67705a-df91-4ef2-8c0f-2a3e9840a435 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:20.681945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67705a-df91-4ef2-8c0f-2a3e9840a435 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:20.682229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67705a-df91-4ef2-8c0f-2a3e9840a435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:20.701802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-4c67705a-df91-4ef2-8c0f-2a3e9840a435 None None] MFA Rules not processed for user `b839f3c96b7d4893ae4a7500865ad760`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:20.701802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4c67705a-df91-4ef2-8c0f-2a3e9840a435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:20.756488 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1163/2345] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:59:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:21.193123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe73c2a-6da0-40ed-97f2-35acdc80ccfc None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:21.193421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe73c2a-6da0-40ed-97f2-35acdc80ccfc None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:21.193707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe73c2a-6da0-40ed-97f2-35acdc80ccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:21.215479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-efe73c2a-6da0-40ed-97f2-35acdc80ccfc None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:21.216724 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-efe73c2a-6da0-40ed-97f2-35acdc80ccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:21.224897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1183/2346] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 13:59:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:21.236704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67705a-df91-4ef2-8c0f-2a3e9840a435 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:21.249662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67705a-df91-4ef2-8c0f-2a3e9840a435 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:21.261775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8900c8e-6c76-4e9b-bf77-1b4049ce8a90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:21.262441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8900c8e-6c76-4e9b-bf77-1b4049ce8a90 service swift] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:21.264372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8900c8e-6c76-4e9b-bf77-1b4049ce8a90 service swift] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:21.264372 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8900c8e-6c76-4e9b-bf77-1b4049ce8a90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:21.280988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8900c8e-6c76-4e9b-bf77-1b4049ce8a90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:21.283317 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8900c8e-6c76-4e9b-bf77-1b4049ce8a90 service swift] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:21.292038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1164/2347] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 13:59:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:59:21.859924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1a6db-f5f6-42b3-bd7b-05ebbedb62d1 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:21.860376 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1a6db-f5f6-42b3-bd7b-05ebbedb62d1 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:21.860562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1a6db-f5f6-42b3-bd7b-05ebbedb62d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:21.896416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-25d1a6db-f5f6-42b3-bd7b-05ebbedb62d1 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:21.897846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-25d1a6db-f5f6-42b3-bd7b-05ebbedb62d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:21.920083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3975cf-9245-4e22-988d-4877f7667369 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:21.923108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3975cf-9245-4e22-988d-4877f7667369 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:21.923108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3975cf-9245-4e22-988d-4877f7667369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:21.938531 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-7c3975cf-9245-4e22-988d-4877f7667369 None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:21.939997 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7c3975cf-9245-4e22-988d-4877f7667369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:21.947427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1165/2348] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 2 13:59:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:59:21.960787 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3975cf-9245-4e22-988d-4877f7667369 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:21.964160 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1184/2349] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Jun 2 13:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:59:21.973535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3975cf-9245-4e22-988d-4877f7667369 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:21.978606 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62bcaa-6809-4ae8-8694-351ddf34aa6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:21.980752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62bcaa-6809-4ae8-8694-351ddf34aa6e service swift] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:21.980752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62bcaa-6809-4ae8-8694-351ddf34aa6e service swift] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:21.980752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62bcaa-6809-4ae8-8694-351ddf34aa6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:21.987012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1a6db-f5f6-42b3-bd7b-05ebbedb62d1 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:21.988657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-25d1a6db-f5f6-42b3-bd7b-05ebbedb62d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:21.989256 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62bcaa-6809-4ae8-8694-351ddf34aa6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:21.990827 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62bcaa-6809-4ae8-8694-351ddf34aa6e service swift] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:21.999703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1166/2350] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 13:59:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:59:22.047356 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:22.098617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1a6db-f5f6-42b3-bd7b-05ebbedb62d1 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:22.104275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872d4ed-07b3-42e1-99aa-0c297a784bb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:22.104922 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872d4ed-07b3-42e1-99aa-0c297a784bb4 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:22.105205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872d4ed-07b3-42e1-99aa-0c297a784bb4 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:22.105479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872d4ed-07b3-42e1-99aa-0c297a784bb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:22.113532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872d4ed-07b3-42e1-99aa-0c297a784bb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:22.116225 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872d4ed-07b3-42e1-99aa-0c297a784bb4 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:22.127004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1185/2351] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:22.297605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62bcaa-6809-4ae8-8694-351ddf34aa6e service swift] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:22.299777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7f62bcaa-6809-4ae8-8694-351ddf34aa6e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:22.312972 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62bcaa-6809-4ae8-8694-351ddf34aa6e service swift] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:22.317489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22f290-b8f0-4b35-bfbc-b0b46446980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:22.318351 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22f290-b8f0-4b35-bfbc-b0b46446980f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:22.318628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22f290-b8f0-4b35-bfbc-b0b46446980f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:22.318904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22f290-b8f0-4b35-bfbc-b0b46446980f admin admin] PATH_INFO: `/v3/users/5d287c8e2ba6463ebe8e8bc93461ee9a` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:22.320107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22f290-b8f0-4b35-bfbc-b0b46446980f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d287c8e2ba6463ebe8e8bc93461ee9a)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:22.322020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22f290-b8f0-4b35-bfbc-b0b46446980f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:22.338582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:22.578461 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2c22f290-b8f0-4b35-bfbc-b0b46446980f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d287c8e2ba6463ebe8e8bc93461ee9a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:22.593060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2c22f290-b8f0-4b35-bfbc-b0b46446980f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d287c8e2ba6463ebe8e8bc93461ee9a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:22.602068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2c22f290-b8f0-4b35-bfbc-b0b46446980f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d287c8e2ba6463ebe8e8bc93461ee9a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:22.604179 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2c22f290-b8f0-4b35-bfbc-b0b46446980f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d287c8e2ba6463ebe8e8bc93461ee9a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:22.687765 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2c22f290-b8f0-4b35-bfbc-b0b46446980f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d287c8e2ba6463ebe8e8bc93461ee9a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:22.698314 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1167/2352] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:59:22 2022] DELETE /identity/v3/users/5d287c8e2ba6463ebe8e8bc93461ee9a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:59:22.703392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83419b-339a-43ea-b17a-4b53dbbec45c None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:22.703717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83419b-339a-43ea-b17a-4b53dbbec45c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:22.704520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83419b-339a-43ea-b17a-4b53dbbec45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:22.728488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-9f83419b-339a-43ea-b17a-4b53dbbec45c None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:22.729722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9f83419b-339a-43ea-b17a-4b53dbbec45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:22.792213 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1186/2353] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:22.801777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22f290-b8f0-4b35-bfbc-b0b46446980f admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:22.803179 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2c22f290-b8f0-4b35-bfbc-b0b46446980f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:22.863701 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22f290-b8f0-4b35-bfbc-b0b46446980f admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:22.867295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e61ec0-50eb-4771-b1dc-b37702da47ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:22.867977 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e61ec0-50eb-4771-b1dc-b37702da47ad service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:22.871283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e61ec0-50eb-4771-b1dc-b37702da47ad service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:22.871283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e61ec0-50eb-4771-b1dc-b37702da47ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:22.878609 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e61ec0-50eb-4771-b1dc-b37702da47ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:22.880083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e61ec0-50eb-4771-b1dc-b37702da47ad service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:22.889469 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1168/2354] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:23.295399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83419b-339a-43ea-b17a-4b53dbbec45c None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:23.296862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9f83419b-339a-43ea-b17a-4b53dbbec45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:23.311413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83419b-339a-43ea-b17a-4b53dbbec45c None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:23.317162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddd15e-2ad1-40f7-b097-071d3483f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:23.318028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd15e-2ad1-40f7-b097-071d3483f1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:23.318311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd15e-2ad1-40f7-b097-071d3483f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:23.318586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd15e-2ad1-40f7-b097-071d3483f1b5 admin admin] PATH_INFO: `/v3/projects/32fbca63162f47cea7ca24b3a9fcf62b` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:23.320379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddd15e-2ad1-40f7-b097-071d3483f1b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fbca63162f47cea7ca24b3a9fcf62b)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:23.321758 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddd15e-2ad1-40f7-b097-071d3483f1b5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:23.429933 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0bddd15e-2ad1-40f7-b097-071d3483f1b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fbca63162f47cea7ca24b3a9fcf62b', 'request_id': 'req-0bddd15e-2ad1-40f7-b097-071d3483f1b5'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:23.499340 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0bddd15e-2ad1-40f7-b097-071d3483f1b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fbca63162f47cea7ca24b3a9fcf62b', 'request_id': 'req-0bddd15e-2ad1-40f7-b097-071d3483f1b5'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:23.506655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0bddd15e-2ad1-40f7-b097-071d3483f1b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fbca63162f47cea7ca24b3a9fcf62b', 'request_id': 'req-0bddd15e-2ad1-40f7-b097-071d3483f1b5'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:23.517245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0bddd15e-2ad1-40f7-b097-071d3483f1b5 admin admin] The token cache is being invalidate because project 32fbca63162f47cea7ca24b3a9fcf62b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:59:23.517529 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0bddd15e-2ad1-40f7-b097-071d3483f1b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:23.518424 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-0bddd15e-2ad1-40f7-b097-071d3483f1b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:23.520161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1187/2355] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:59:23 2022] DELETE /identity/v3/projects/32fbca63162f47cea7ca24b3a9fcf62b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:59:23.525077 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c7bc5-aaa2-4ccb-a7eb-e4da8298cf22 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:23.525946 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c7bc5-aaa2-4ccb-a7eb-e4da8298cf22 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:23.526307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c7bc5-aaa2-4ccb-a7eb-e4da8298cf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:23.544734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-881c7bc5-aaa2-4ccb-a7eb-e4da8298cf22 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:23.545882 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-881c7bc5-aaa2-4ccb-a7eb-e4da8298cf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:23.608125 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1169/2356] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:23.616314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda0aaa-bef6-401f-808e-16570cd9dbe1 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:23.616661 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda0aaa-bef6-401f-808e-16570cd9dbe1 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:23.616946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda0aaa-bef6-401f-808e-16570cd9dbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:23.635789 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-eeda0aaa-bef6-401f-808e-16570cd9dbe1 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:23.636990 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-eeda0aaa-bef6-401f-808e-16570cd9dbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:23.645605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1188/2357] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:23.650015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c7bc5-aaa2-4ccb-a7eb-e4da8298cf22 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:23.660538 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c7bc5-aaa2-4ccb-a7eb-e4da8298cf22 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:23.665184 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ae526-d7ae-45bc-9a82-d14d185a9882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:23.665835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ae526-d7ae-45bc-9a82-d14d185a9882 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:23.666119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ae526-d7ae-45bc-9a82-d14d185a9882 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:23.666395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ae526-d7ae-45bc-9a82-d14d185a9882 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:23.667213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ae526-d7ae-45bc-9a82-d14d185a9882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:59:23.667553 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ae526-d7ae-45bc-9a82-d14d185a9882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:23.669314 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ae526-d7ae-45bc-9a82-d14d185a9882 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:23.681664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1170/2358] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:59:23.686362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda0aaa-bef6-401f-808e-16570cd9dbe1 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:23.696082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda0aaa-bef6-401f-808e-16570cd9dbe1 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:23.700807 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befbb2e-f51d-4221-adc4-f4fc10b0db27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:23.701438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befbb2e-f51d-4221-adc4-f4fc10b0db27 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:23.701718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befbb2e-f51d-4221-adc4-f4fc10b0db27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:23.701992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befbb2e-f51d-4221-adc4-f4fc10b0db27 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:23.702703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befbb2e-f51d-4221-adc4-f4fc10b0db27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:23.704645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befbb2e-f51d-4221-adc4-f4fc10b0db27 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:23.847154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1189/2359] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:59:23 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:59:23.851419 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ae526-d7ae-45bc-9a82-d14d185a9882 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:23.861966 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ae526-d7ae-45bc-9a82-d14d185a9882 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:23.883431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:23.918956 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724b5e9-e782-47d2-8fc0-0e73ac4a27f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:23.919670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724b5e9-e782-47d2-8fc0-0e73ac4a27f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:23.919959 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724b5e9-e782-47d2-8fc0-0e73ac4a27f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:23.920246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724b5e9-e782-47d2-8fc0-0e73ac4a27f6 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:23.920937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724b5e9-e782-47d2-8fc0-0e73ac4a27f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:23.923396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724b5e9-e782-47d2-8fc0-0e73ac4a27f6 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:24.039556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1171/2360] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:59:23 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:59:24.043784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befbb2e-f51d-4221-adc4-f4fc10b0db27 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:24.049825 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:24.055077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befbb2e-f51d-4221-adc4-f4fc10b0db27 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:24.059727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c584d7f-872c-4999-b236-4d792a480011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:24.060392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c584d7f-872c-4999-b236-4d792a480011 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:24.060668 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c584d7f-872c-4999-b236-4d792a480011 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:24.060948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c584d7f-872c-4999-b236-4d792a480011 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:24.061786 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c584d7f-872c-4999-b236-4d792a480011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:24.064090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c584d7f-872c-4999-b236-4d792a480011 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:24.074767 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1190/2361] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:59:24.079126 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724b5e9-e782-47d2-8fc0-0e73ac4a27f6 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:24.089189 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724b5e9-e782-47d2-8fc0-0e73ac4a27f6 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:24.093953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd330-6600-4f29-a206-d8e62ba97ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:24.094656 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd330-6600-4f29-a206-d8e62ba97ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:24.094939 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd330-6600-4f29-a206-d8e62ba97ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:24.095209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd330-6600-4f29-a206-d8e62ba97ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:24.095978 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cd330-6600-4f29-a206-d8e62ba97ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:24.097622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cd330-6600-4f29-a206-d8e62ba97ac4 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:24.107259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1172/2362] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:59:24.115316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c584d7f-872c-4999-b236-4d792a480011 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:24.125391 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c584d7f-872c-4999-b236-4d792a480011 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:24.130525 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fcc42-f425-44ed-9300-1a80ce315d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:24.131428 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fcc42-f425-44ed-9300-1a80ce315d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:24.131769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fcc42-f425-44ed-9300-1a80ce315d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:24.132041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fcc42-f425-44ed-9300-1a80ce315d1b admin admin] PATH_INFO: `/v3/projects/c29c5c8254e546ffa4bde6e309d9c60e/users/111ed63321f549e89fe8fb56080a6d30/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:24.145995 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fcc42-f425-44ed-9300-1a80ce315d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29c5c8254e546ffa4bde6e309d9c60e, user_id=111ed63321f549e89fe8fb56080a6d30, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:24.148656 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fcc42-f425-44ed-9300-1a80ce315d1b admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:24.256400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1191/2363] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:59:24 2022] PUT /identity/v3/projects/c29c5c8254e546ffa4bde6e309d9c60e/users/111ed63321f549e89fe8fb56080a6d30/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:59:24.266544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a90701-ff4f-4f5c-a494-5bf24c4616a8 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:24.266836 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a90701-ff4f-4f5c-a494-5bf24c4616a8 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:24.267119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a90701-ff4f-4f5c-a494-5bf24c4616a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:24.294231 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-89a90701-ff4f-4f5c-a494-5bf24c4616a8 None None] MFA Rules not processed for user `111ed63321f549e89fe8fb56080a6d30`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:24.295427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-89a90701-ff4f-4f5c-a494-5bf24c4616a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:24.359845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1173/2364] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:59:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:24.370969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fcc42-f425-44ed-9300-1a80ce315d1b admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:24.372750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-cd7fcc42-f425-44ed-9300-1a80ce315d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:24.452229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fcc42-f425-44ed-9300-1a80ce315d1b admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:24.455957 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b97e5-00f8-4b46-923e-d4a595d9c837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:24.456597 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b97e5-00f8-4b46-923e-d4a595d9c837 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:24.456882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b97e5-00f8-4b46-923e-d4a595d9c837 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:24.457158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b97e5-00f8-4b46-923e-d4a595d9c837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:24.465532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b97e5-00f8-4b46-923e-d4a595d9c837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:24.466985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b97e5-00f8-4b46-923e-d4a595d9c837 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:24.476164 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1192/2365] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:24.801606 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a90701-ff4f-4f5c-a494-5bf24c4616a8 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:24.803041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-89a90701-ff4f-4f5c-a494-5bf24c4616a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:24.870374 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a90701-ff4f-4f5c-a494-5bf24c4616a8 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:24.875121 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b4ba2-cc9b-4f0d-97aa-e168ce25caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:24.876051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b4ba2-cc9b-4f0d-97aa-e168ce25caef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:24.876327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b4ba2-cc9b-4f0d-97aa-e168ce25caef admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:24.876626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b4ba2-cc9b-4f0d-97aa-e168ce25caef admin admin] PATH_INFO: `/v3/users/294ba02ef580469aa7c31a70dc50b9f1` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:24.877848 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b4ba2-cc9b-4f0d-97aa-e168ce25caef admin admin] RBAC: Authorizing `identity:delete_user(user_id=294ba02ef580469aa7c31a70dc50b9f1)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:24.880075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b4ba2-cc9b-4f0d-97aa-e168ce25caef admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:25.058301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:25.067679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-550b4ba2-cc9b-4f0d-97aa-e168ce25caef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294ba02ef580469aa7c31a70dc50b9f1'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:25.079776 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-550b4ba2-cc9b-4f0d-97aa-e168ce25caef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294ba02ef580469aa7c31a70dc50b9f1'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:25.086370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-550b4ba2-cc9b-4f0d-97aa-e168ce25caef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294ba02ef580469aa7c31a70dc50b9f1'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:25.087038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-550b4ba2-cc9b-4f0d-97aa-e168ce25caef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294ba02ef580469aa7c31a70dc50b9f1'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:25.176638 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-550b4ba2-cc9b-4f0d-97aa-e168ce25caef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294ba02ef580469aa7c31a70dc50b9f1'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:25.183900 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1174/2366] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:59:24 2022] DELETE /identity/v3/users/294ba02ef580469aa7c31a70dc50b9f1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:59:25.188865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4f268-3d3f-4803-a551-9e75fb24f8d8 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:25.189151 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4f268-3d3f-4803-a551-9e75fb24f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:25.189455 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4f268-3d3f-4803-a551-9e75fb24f8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:25.209332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-42d4f268-3d3f-4803-a551-9e75fb24f8d8 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:25.211393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-42d4f268-3d3f-4803-a551-9e75fb24f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:25.277805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1193/2367] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:25.287342 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b4ba2-cc9b-4f0d-97aa-e168ce25caef admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:25.288761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-550b4ba2-cc9b-4f0d-97aa-e168ce25caef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:25.344876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b4ba2-cc9b-4f0d-97aa-e168ce25caef admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:25.348817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd89f7a-6ecd-457c-bc25-1fc626e3ac57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:25.349475 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89f7a-6ecd-457c-bc25-1fc626e3ac57 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:25.349764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89f7a-6ecd-457c-bc25-1fc626e3ac57 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:25.350049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89f7a-6ecd-457c-bc25-1fc626e3ac57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:25.359355 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd89f7a-6ecd-457c-bc25-1fc626e3ac57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:25.361460 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd89f7a-6ecd-457c-bc25-1fc626e3ac57 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:25.370922 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1175/2368] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:25.666079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4f268-3d3f-4803-a551-9e75fb24f8d8 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:25.667538 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-42d4f268-3d3f-4803-a551-9e75fb24f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:25.681071 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4f268-3d3f-4803-a551-9e75fb24f8d8 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:25.685811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15486372-b5eb-4d66-ab06-66d5adece706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:25.686743 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15486372-b5eb-4d66-ab06-66d5adece706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:25.687029 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15486372-b5eb-4d66-ab06-66d5adece706 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:25.687301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15486372-b5eb-4d66-ab06-66d5adece706 admin admin] PATH_INFO: `/v3/projects/84be36f03f2e428c889ab7080baa9171` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:25.688543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15486372-b5eb-4d66-ab06-66d5adece706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84be36f03f2e428c889ab7080baa9171)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:25.690609 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15486372-b5eb-4d66-ab06-66d5adece706 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:25.789350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:25.792319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-15486372-b5eb-4d66-ab06-66d5adece706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84be36f03f2e428c889ab7080baa9171', 'request_id': 'req-15486372-b5eb-4d66-ab06-66d5adece706'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:25.893240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-15486372-b5eb-4d66-ab06-66d5adece706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84be36f03f2e428c889ab7080baa9171', 'request_id': 'req-15486372-b5eb-4d66-ab06-66d5adece706'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:25.900380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-15486372-b5eb-4d66-ab06-66d5adece706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84be36f03f2e428c889ab7080baa9171', 'request_id': 'req-15486372-b5eb-4d66-ab06-66d5adece706'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:25.925622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-15486372-b5eb-4d66-ab06-66d5adece706 admin admin] The token cache is being invalidate because project 84be36f03f2e428c889ab7080baa9171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:59:25.925622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-15486372-b5eb-4d66-ab06-66d5adece706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:25.926845 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-15486372-b5eb-4d66-ab06-66d5adece706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:25.929403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1194/2369] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:59:25 2022] DELETE /identity/v3/projects/84be36f03f2e428c889ab7080baa9171 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:59:25.934117 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f317e50-c9a7-4f87-ba81-dc86fe23713d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:25.934506 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f317e50-c9a7-4f87-ba81-dc86fe23713d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:25.934724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f317e50-c9a7-4f87-ba81-dc86fe23713d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:25.959995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-5f317e50-c9a7-4f87-ba81-dc86fe23713d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:25.961411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5f317e50-c9a7-4f87-ba81-dc86fe23713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:26.043984 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1176/2370] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:26.057263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f28444-7df7-40e9-a325-2a516157e75d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:26.057263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f28444-7df7-40e9-a325-2a516157e75d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:26.057263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f28444-7df7-40e9-a325-2a516157e75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:26.072087 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-86f28444-7df7-40e9-a325-2a516157e75d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:26.073295 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-86f28444-7df7-40e9-a325-2a516157e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:26.082173 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1195/2371] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:26.086473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f317e50-c9a7-4f87-ba81-dc86fe23713d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:26.096596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f317e50-c9a7-4f87-ba81-dc86fe23713d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:26.101283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d3be3-8a8e-413e-a1ab-39b9464b44ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:26.101932 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d3be3-8a8e-413e-a1ab-39b9464b44ca admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:26.102218 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d3be3-8a8e-413e-a1ab-39b9464b44ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:26.102495 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d3be3-8a8e-413e-a1ab-39b9464b44ca admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:26.103212 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d3be3-8a8e-413e-a1ab-39b9464b44ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:59:26.103550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d3be3-8a8e-413e-a1ab-39b9464b44ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:26.105148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d3be3-8a8e-413e-a1ab-39b9464b44ca admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:26.116656 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1177/2372] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 13:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:59:26.120884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f28444-7df7-40e9-a325-2a516157e75d None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:26.130561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f28444-7df7-40e9-a325-2a516157e75d None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:26.135344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad43a3-8570-466f-94da-25e0f81d4596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:26.136032 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad43a3-8570-466f-94da-25e0f81d4596 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:26.136338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad43a3-8570-466f-94da-25e0f81d4596 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:26.136594 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad43a3-8570-466f-94da-25e0f81d4596 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:26.137441 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad43a3-8570-466f-94da-25e0f81d4596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:26.139348 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad43a3-8570-466f-94da-25e0f81d4596 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:26.227215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1196/2373] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 13:59:26 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:59:26.231241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d3be3-8a8e-413e-a1ab-39b9464b44ca admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:26.242343 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d3be3-8a8e-413e-a1ab-39b9464b44ca admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:26.286892 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:26.303327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acae66-d3d4-4ab2-a4e4-2a2b40ca047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:26.304045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acae66-d3d4-4ab2-a4e4-2a2b40ca047f admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:26.304347 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acae66-d3d4-4ab2-a4e4-2a2b40ca047f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:26.304629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acae66-d3d4-4ab2-a4e4-2a2b40ca047f admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:26.305366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acae66-d3d4-4ab2-a4e4-2a2b40ca047f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:26.307343 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acae66-d3d4-4ab2-a4e4-2a2b40ca047f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:26.453753 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1178/2374] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 13:59:26 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:59:26.458301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad43a3-8570-466f-94da-25e0f81d4596 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:26.468763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad43a3-8570-466f-94da-25e0f81d4596 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:26.473302 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc4644-5bf8-4c26-bd76-4500222ae73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:26.473965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc4644-5bf8-4c26-bd76-4500222ae73e admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:26.474260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc4644-5bf8-4c26-bd76-4500222ae73e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:26.474616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc4644-5bf8-4c26-bd76-4500222ae73e admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:26.475371 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc4644-5bf8-4c26-bd76-4500222ae73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:26.477017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc4644-5bf8-4c26-bd76-4500222ae73e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:26.489211 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1197/2375] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:59:26.493132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acae66-d3d4-4ab2-a4e4-2a2b40ca047f admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:26.503838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acae66-d3d4-4ab2-a4e4-2a2b40ca047f admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:26.508560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aa481-1574-4eb7-b6d5-e173b599a92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:26.509237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aa481-1574-4eb7-b6d5-e173b599a92b admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:26.509523 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aa481-1574-4eb7-b6d5-e173b599a92b admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:26.509920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aa481-1574-4eb7-b6d5-e173b599a92b admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:26.510648 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19aa481-1574-4eb7-b6d5-e173b599a92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:26.512279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19aa481-1574-4eb7-b6d5-e173b599a92b admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:26.524608 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1179/2376] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 13:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:59:26.528926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc4644-5bf8-4c26-bd76-4500222ae73e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:26.538912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc4644-5bf8-4c26-bd76-4500222ae73e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:26.543865 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178fa2a-761f-42d3-8992-0bdf87cb2a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:26.544794 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178fa2a-761f-42d3-8992-0bdf87cb2a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:26.545079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178fa2a-761f-42d3-8992-0bdf87cb2a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:26.545354 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178fa2a-761f-42d3-8992-0bdf87cb2a2a admin admin] PATH_INFO: `/v3/projects/90c6938b58ce43d8bfc5507748a255a6/users/682f4bfb0b1b4a54958da7cc35c86821/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:26.560010 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178fa2a-761f-42d3-8992-0bdf87cb2a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c6938b58ce43d8bfc5507748a255a6, user_id=682f4bfb0b1b4a54958da7cc35c86821, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:26.562724 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178fa2a-761f-42d3-8992-0bdf87cb2a2a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:26.671579 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1198/2377] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 13:59:26 2022] PUT /identity/v3/projects/90c6938b58ce43d8bfc5507748a255a6/users/682f4bfb0b1b4a54958da7cc35c86821/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:59:26.681910 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45605-a65f-4675-ac95-21871415ec85 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:26.682496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45605-a65f-4675-ac95-21871415ec85 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:26.682866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45605-a65f-4675-ac95-21871415ec85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:26.712276 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-b5a45605-a65f-4675-ac95-21871415ec85 None None] MFA Rules not processed for user `682f4bfb0b1b4a54958da7cc35c86821`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:26.713594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-b5a45605-a65f-4675-ac95-21871415ec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:26.785221 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1180/2378] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:59:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:26.796660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178fa2a-761f-42d3-8992-0bdf87cb2a2a admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:26.798457 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-7178fa2a-761f-42d3-8992-0bdf87cb2a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:26.869294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178fa2a-761f-42d3-8992-0bdf87cb2a2a admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:26.874297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214b418-7552-4a07-8782-f0055606afdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:26.874297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214b418-7552-4a07-8782-f0055606afdd service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:26.874297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214b418-7552-4a07-8782-f0055606afdd service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:26.874595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214b418-7552-4a07-8782-f0055606afdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:26.883910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214b418-7552-4a07-8782-f0055606afdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:26.885358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214b418-7552-4a07-8782-f0055606afdd service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:26.894930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1199/2379] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:28.333237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fd644-6754-4f0d-85cb-ed671c42c9e4 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:28.333774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fd644-6754-4f0d-85cb-ed671c42c9e4 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:28.333899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fd644-6754-4f0d-85cb-ed671c42c9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:28.352548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-4c8fd644-6754-4f0d-85cb-ed671c42c9e4 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:28.353749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4c8fd644-6754-4f0d-85cb-ed671c42c9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:28.433237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1181/2380] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Jun 2 13:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:28.454135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214b418-7552-4a07-8782-f0055606afdd service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:28.455599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-5214b418-7552-4a07-8782-f0055606afdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:28.530306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214b418-7552-4a07-8782-f0055606afdd service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:28.535941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4f86e-c277-4d24-8e97-a97bcbe05fb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:28.536531 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4f86e-c277-4d24-8e97-a97bcbe05fb1 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:28.536814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4f86e-c277-4d24-8e97-a97bcbe05fb1 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:28.537087 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4f86e-c277-4d24-8e97-a97bcbe05fb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:28.545605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4f86e-c277-4d24-8e97-a97bcbe05fb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:28.547212 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4f86e-c277-4d24-8e97-a97bcbe05fb1 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:28.552006 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:28.558338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1200/2381] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:38.408133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:38.634795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712b767-32a3-4ce2-9d81-539195adcd55 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:38.635085 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712b767-32a3-4ce2-9d81-539195adcd55 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:38.635366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712b767-32a3-4ce2-9d81-539195adcd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:38.655037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f712b767-32a3-4ce2-9d81-539195adcd55 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:38.656349 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f712b767-32a3-4ce2-9d81-539195adcd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:38.664950 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1182/2382] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Jun 2 13:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:38.687398 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4f86e-c277-4d24-8e97-a97bcbe05fb1 service nova] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:38.698750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4f86e-c277-4d24-8e97-a97bcbe05fb1 service nova] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:38.704345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041ddce-409c-4a65-a4e9-0782e6161d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:38.704981 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041ddce-409c-4a65-a4e9-0782e6161d7a service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:38.711891 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041ddce-409c-4a65-a4e9-0782e6161d7a service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:38.711891 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041ddce-409c-4a65-a4e9-0782e6161d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:38.716027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041ddce-409c-4a65-a4e9-0782e6161d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:38.717816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041ddce-409c-4a65-a4e9-0782e6161d7a service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:38.728089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1201/2383] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:41.048089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712b767-32a3-4ce2-9d81-539195adcd55 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:41.049683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f712b767-32a3-4ce2-9d81-539195adcd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:41.062896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712b767-32a3-4ce2-9d81-539195adcd55 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:41.067601 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f737567-42e0-4cbc-bb77-e1cfef33ae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:41.068494 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f737567-42e0-4cbc-bb77-e1cfef33ae19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:41.068771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f737567-42e0-4cbc-bb77-e1cfef33ae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:41.069039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f737567-42e0-4cbc-bb77-e1cfef33ae19 admin admin] PATH_INFO: `/v3/users/111ed63321f549e89fe8fb56080a6d30` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:41.070233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f737567-42e0-4cbc-bb77-e1cfef33ae19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=111ed63321f549e89fe8fb56080a6d30)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:41.072199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f737567-42e0-4cbc-bb77-e1cfef33ae19 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:41.283961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2f737567-42e0-4cbc-bb77-e1cfef33ae19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111ed63321f549e89fe8fb56080a6d30'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:41.298809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2f737567-42e0-4cbc-bb77-e1cfef33ae19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111ed63321f549e89fe8fb56080a6d30'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:41.306071 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2f737567-42e0-4cbc-bb77-e1cfef33ae19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111ed63321f549e89fe8fb56080a6d30'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:41.306777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2f737567-42e0-4cbc-bb77-e1cfef33ae19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111ed63321f549e89fe8fb56080a6d30'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:41.383696 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2f737567-42e0-4cbc-bb77-e1cfef33ae19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111ed63321f549e89fe8fb56080a6d30'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:41.390201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1183/2384] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:59:41 2022] DELETE /identity/v3/users/111ed63321f549e89fe8fb56080a6d30 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:59:41.395278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5b950-e59c-4189-9146-c07b51addbd4 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:41.395774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5b950-e59c-4189-9146-c07b51addbd4 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:41.395882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5b950-e59c-4189-9146-c07b51addbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:41.414051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-c1c5b950-e59c-4189-9146-c07b51addbd4 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:41.415253 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c1c5b950-e59c-4189-9146-c07b51addbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:41.475468 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1202/2385] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:41.485076 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f737567-42e0-4cbc-bb77-e1cfef33ae19 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:41.486574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2f737567-42e0-4cbc-bb77-e1cfef33ae19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:41.545800 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f737567-42e0-4cbc-bb77-e1cfef33ae19 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:41.549537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e07e1-9619-450f-bcb3-e2b64168a9ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:41.550188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e07e1-9619-450f-bcb3-e2b64168a9ff service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:41.550474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e07e1-9619-450f-bcb3-e2b64168a9ff service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:41.550750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e07e1-9619-450f-bcb3-e2b64168a9ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:41.560430 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e07e1-9619-450f-bcb3-e2b64168a9ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:41.561964 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e07e1-9619-450f-bcb3-e2b64168a9ff service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:41.572029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1184/2386] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:42.298880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5b950-e59c-4189-9146-c07b51addbd4 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:42.301028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c1c5b950-e59c-4189-9146-c07b51addbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:42.315654 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5b950-e59c-4189-9146-c07b51addbd4 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:42.322395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:42.323511 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:42.323639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:42.323887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] PATH_INFO: `/v3/projects/c29c5c8254e546ffa4bde6e309d9c60e` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:42.325216 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29c5c8254e546ffa4bde6e309d9c60e)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:42.327211 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:42.442717 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29c5c8254e546ffa4bde6e309d9c60e', 'request_id': 'req-c8f2e792-b83d-48a1-bb08-b893dd25cb72'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:42.512681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29c5c8254e546ffa4bde6e309d9c60e', 'request_id': 'req-c8f2e792-b83d-48a1-bb08-b893dd25cb72'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:42.520108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29c5c8254e546ffa4bde6e309d9c60e', 'request_id': 'req-c8f2e792-b83d-48a1-bb08-b893dd25cb72'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:42.532795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] The token cache is being invalidate because project c29c5c8254e546ffa4bde6e309d9c60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:59:42.533089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:42.534429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:42.547483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1203/2387] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:59:42 2022] DELETE /identity/v3/projects/c29c5c8254e546ffa4bde6e309d9c60e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:59:45.070906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c51f94-b6a8-49a5-885d-9437b0a134b1 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:45.071349 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c51f94-b6a8-49a5-885d-9437b0a134b1 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:45.071508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c51f94-b6a8-49a5-885d-9437b0a134b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:45.089735 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-d9c51f94-b6a8-49a5-885d-9437b0a134b1 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:45.090926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d9c51f94-b6a8-49a5-885d-9437b0a134b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:45.151157 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1185/2388] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Jun 2 13:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:45.172316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:45.187905 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:45.246686 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2e792-b83d-48a1-bb08-b893dd25cb72 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:45.252470 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ca6d7-5603-4935-9acb-3169e2dd2e4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:45.253129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ca6d7-5603-4935-9acb-3169e2dd2e4a service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:45.253414 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ca6d7-5603-4935-9acb-3169e2dd2e4a service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:45.253804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ca6d7-5603-4935-9acb-3169e2dd2e4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:45.259774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:45.264078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ca6d7-5603-4935-9acb-3169e2dd2e4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:45.265650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ca6d7-5603-4935-9acb-3169e2dd2e4a service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:45.275723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1204/2389] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:45.470871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c51f94-b6a8-49a5-885d-9437b0a134b1 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:45.472633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d9c51f94-b6a8-49a5-885d-9437b0a134b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:45.484177 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c51f94-b6a8-49a5-885d-9437b0a134b1 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:45.488742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0793be0-b30e-4cc2-8ddf-c5f733aecd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:45.489604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0793be0-b30e-4cc2-8ddf-c5f733aecd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:45.489889 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0793be0-b30e-4cc2-8ddf-c5f733aecd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:45.490168 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0793be0-b30e-4cc2-8ddf-c5f733aecd5f admin admin] PATH_INFO: `/v3/users/682f4bfb0b1b4a54958da7cc35c86821` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:45.492095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0793be0-b30e-4cc2-8ddf-c5f733aecd5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=682f4bfb0b1b4a54958da7cc35c86821)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:45.495566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0793be0-b30e-4cc2-8ddf-c5f733aecd5f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:45.496342 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:45.733566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c0793be0-b30e-4cc2-8ddf-c5f733aecd5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682f4bfb0b1b4a54958da7cc35c86821'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:45.745616 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c0793be0-b30e-4cc2-8ddf-c5f733aecd5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682f4bfb0b1b4a54958da7cc35c86821'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:45.752486 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c0793be0-b30e-4cc2-8ddf-c5f733aecd5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682f4bfb0b1b4a54958da7cc35c86821'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:45.753147 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c0793be0-b30e-4cc2-8ddf-c5f733aecd5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682f4bfb0b1b4a54958da7cc35c86821'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:45.814562 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c0793be0-b30e-4cc2-8ddf-c5f733aecd5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682f4bfb0b1b4a54958da7cc35c86821'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:45.821094 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1186/2390] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 13:59:45 2022] DELETE /identity/v3/users/682f4bfb0b1b4a54958da7cc35c86821 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:59:45.825752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523d05e-a45a-4227-93e5-3915e739147f None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:45.825888 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523d05e-a45a-4227-93e5-3915e739147f None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:45.826154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523d05e-a45a-4227-93e5-3915e739147f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:45.844055 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d523d05e-a45a-4227-93e5-3915e739147f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:45.845253 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d523d05e-a45a-4227-93e5-3915e739147f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:45.903212 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1205/2391] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 13:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:45.913285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0793be0-b30e-4cc2-8ddf-c5f733aecd5f admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:45.914904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c0793be0-b30e-4cc2-8ddf-c5f733aecd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:45.972166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0793be0-b30e-4cc2-8ddf-c5f733aecd5f admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:45.976723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef52bb-18d3-4956-a24d-089d936a75da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:45.977589 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef52bb-18d3-4956-a24d-089d936a75da service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:45.977870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef52bb-18d3-4956-a24d-089d936a75da service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:45.978143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef52bb-18d3-4956-a24d-089d936a75da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:45.987124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef52bb-18d3-4956-a24d-089d936a75da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:45.988525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef52bb-18d3-4956-a24d-089d936a75da service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:45.998699 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1187/2392] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:46.390509 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523d05e-a45a-4227-93e5-3915e739147f None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:46.392088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d523d05e-a45a-4227-93e5-3915e739147f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:46.404484 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523d05e-a45a-4227-93e5-3915e739147f None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:46.409273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:46.410134 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:46.410425 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:46.410703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] PATH_INFO: `/v3/projects/90c6938b58ce43d8bfc5507748a255a6` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:46.411927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c6938b58ce43d8bfc5507748a255a6)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:46.414496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:46.521303 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c6938b58ce43d8bfc5507748a255a6', 'request_id': 'req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:46.594812 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c6938b58ce43d8bfc5507748a255a6', 'request_id': 'req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:46.601225 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c6938b58ce43d8bfc5507748a255a6', 'request_id': 'req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:46.611732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] The token cache is being invalidate because project 90c6938b58ce43d8bfc5507748a255a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:59:46.612015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:46.612634 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:59:46.614227 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1206/2393] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 13:59:46 2022] DELETE /identity/v3/projects/90c6938b58ce43d8bfc5507748a255a6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:59:50.323837 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743128c-266d-4855-ba1a-dfe66256198a None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:50.324323 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743128c-266d-4855-ba1a-dfe66256198a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:50.324436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743128c-266d-4855-ba1a-dfe66256198a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:50.341717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-0743128c-266d-4855-ba1a-dfe66256198a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:50.342927 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0743128c-266d-4855-ba1a-dfe66256198a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:50.401164 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1188/2394] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Jun 2 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:50.423203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:50.424633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:50.496960 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f3cac-cb2f-43b0-a6d3-1f679d366dd2 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:50.502697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6df5f-d7cb-49a7-be44-e051d7f49b78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:50.503337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6df5f-d7cb-49a7-be44-e051d7f49b78 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:50.503654 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6df5f-d7cb-49a7-be44-e051d7f49b78 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:50.503934 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6df5f-d7cb-49a7-be44-e051d7f49b78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:50.512075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6df5f-d7cb-49a7-be44-e051d7f49b78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:50.513658 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6df5f-d7cb-49a7-be44-e051d7f49b78 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:50.522939 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1207/2395] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:54.635863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d02f7-6409-4bbc-8253-86aad7cd2003 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:54.636354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d02f7-6409-4bbc-8253-86aad7cd2003 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:54.636474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d02f7-6409-4bbc-8253-86aad7cd2003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:54.655913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-957d02f7-6409-4bbc-8253-86aad7cd2003 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:54.657106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-957d02f7-6409-4bbc-8253-86aad7cd2003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:54.664997 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1189/2396] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Jun 2 13:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:54.689792 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6df5f-d7cb-49a7-be44-e051d7f49b78 service nova] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:54.691157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-bec6df5f-d7cb-49a7-be44-e051d7f49b78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:54.700917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:54.706679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6df5f-d7cb-49a7-be44-e051d7f49b78 service nova] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:54.712172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44554bc7-db7d-497a-b11b-f7da28a09c73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:54.712797 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44554bc7-db7d-497a-b11b-f7da28a09c73 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:54.713079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44554bc7-db7d-497a-b11b-f7da28a09c73 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:54.713352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44554bc7-db7d-497a-b11b-f7da28a09c73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:54.721448 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44554bc7-db7d-497a-b11b-f7da28a09c73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:54.723017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44554bc7-db7d-497a-b11b-f7da28a09c73 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:54.732339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1208/2397] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:00:04.649258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=81,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:00:04.896702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:00:09.387188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d02f7-6409-4bbc-8253-86aad7cd2003 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:00:09.388635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-957d02f7-6409-4bbc-8253-86aad7cd2003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:00:09.476425 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d02f7-6409-4bbc-8253-86aad7cd2003 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:00:09.481772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4496f-9e45-44ab-a614-e302cbab8cc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:00:09.482416 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4496f-9e45-44ab-a614-e302cbab8cc7 service placement] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:09.482701 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4496f-9e45-44ab-a614-e302cbab8cc7 service placement] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:09.483006 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4496f-9e45-44ab-a614-e302cbab8cc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:09.484863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-b9a4496f-9e45-44ab-a614-e302cbab8cc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:00:09.497259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4496f-9e45-44ab-a614-e302cbab8cc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:00:09.498965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4496f-9e45-44ab-a614-e302cbab8cc7 service placement] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:00:09.509628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1190/2398] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:00:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:00:17.015121 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32183c0b-5e28-403f-8240-5d8ef23ebd2b None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:17.015643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32183c0b-5e28-403f-8240-5d8ef23ebd2b None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:17.015756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32183c0b-5e28-403f-8240-5d8ef23ebd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:17.032914 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-32183c0b-5e28-403f-8240-5d8ef23ebd2b None None] MFA Rules not processed for user `35355d654eee4e0eb81c6d4d334a22e7`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:00:17.034083 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-32183c0b-5e28-403f-8240-5d8ef23ebd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:00:17.088188 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1209/2399] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:00:19.504712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=41 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:00:27.081703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=25 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:00:38.756273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a850e-1626-4a91-b812-a2411bd48713 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:38.756716 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a850e-1626-4a91-b812-a2411bd48713 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:38.756871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a850e-1626-4a91-b812-a2411bd48713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:38.775503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-cb0a850e-1626-4a91-b812-a2411bd48713 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:00:38.778449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-cb0a850e-1626-4a91-b812-a2411bd48713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:00:38.784756 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1191/2400] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Jun 2 14:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:00:38.805108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32183c0b-5e28-403f-8240-5d8ef23ebd2b None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:00:38.818261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32183c0b-5e28-403f-8240-5d8ef23ebd2b None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:00:38.823699 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0158d-0ba9-4e4b-9719-f65642093b55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:00:38.824340 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0158d-0ba9-4e4b-9719-f65642093b55 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:38.824634 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0158d-0ba9-4e4b-9719-f65642093b55 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:38.824901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0158d-0ba9-4e4b-9719-f65642093b55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:38.832980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0158d-0ba9-4e4b-9719-f65642093b55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:00:38.834563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0158d-0ba9-4e4b-9719-f65642093b55 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:00:38.843998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1210/2401] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:00:42.237718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c6004-a824-483a-9633-b3dc22d0a748 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:42.238187 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c6004-a824-483a-9633-b3dc22d0a748 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:42.238925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c6004-a824-483a-9633-b3dc22d0a748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:42.256746 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-1c4c6004-a824-483a-9633-b3dc22d0a748 None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:00:42.258504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1c4c6004-a824-483a-9633-b3dc22d0a748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:00:42.314216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1192/2402] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 14:00:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:00:42.444586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0158d-0ba9-4e4b-9719-f65642093b55 service nova] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:00:42.446012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-13d0158d-0ba9-4e4b-9719-f65642093b55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:00:42.515304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0158d-0ba9-4e4b-9719-f65642093b55 service nova] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:00:42.520916 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37e400-33c1-4f7c-bbb8-b0b2f090723b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:00:42.521580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37e400-33c1-4f7c-bbb8-b0b2f090723b service swift] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:42.521867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37e400-33c1-4f7c-bbb8-b0b2f090723b service swift] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:42.522145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37e400-33c1-4f7c-bbb8-b0b2f090723b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:42.530113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37e400-33c1-4f7c-bbb8-b0b2f090723b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:00:42.531726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37e400-33c1-4f7c-bbb8-b0b2f090723b service swift] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:00:42.540206 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1211/2403] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 14:00:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:00:44.376391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546713-2f3a-4bbc-b94b-28d5ac25232d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:44.376954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546713-2f3a-4bbc-b94b-28d5ac25232d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:44.376954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546713-2f3a-4bbc-b94b-28d5ac25232d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:44.398824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-df546713-2f3a-4bbc-b94b-28d5ac25232d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:00:44.400349 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-df546713-2f3a-4bbc-b94b-28d5ac25232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:00:44.409011 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1193/2404] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Jun 2 14:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:00:44.430295 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37e400-33c1-4f7c-bbb8-b0b2f090723b service swift] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:00:44.443651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37e400-33c1-4f7c-bbb8-b0b2f090723b service swift] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:00:44.449236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1aaec-436c-45a6-9945-1613d4d6da82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:00:44.449887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1aaec-436c-45a6-9945-1613d4d6da82 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:44.450171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1aaec-436c-45a6-9945-1613d4d6da82 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:44.450443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1aaec-436c-45a6-9945-1613d4d6da82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:44.459217 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1aaec-436c-45a6-9945-1613d4d6da82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:00:44.460842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1aaec-436c-45a6-9945-1613d4d6da82 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:00:44.470398 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1212/2405] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:00:49.250597 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d992b-dfab-4758-909b-5cd2eb9039b7 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:49.251193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d992b-dfab-4758-909b-5cd2eb9039b7 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:49.251193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d992b-dfab-4758-909b-5cd2eb9039b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:49.270902 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-ac9d992b-dfab-4758-909b-5cd2eb9039b7 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:00:49.272266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ac9d992b-dfab-4758-909b-5cd2eb9039b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:00:49.280255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1194/2406] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Jun 2 14:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:00:49.302750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1aaec-436c-45a6-9945-1613d4d6da82 service nova] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:00:49.314344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1aaec-436c-45a6-9945-1613d4d6da82 service nova] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:00:49.321979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811af0f-ea2c-456a-920f-3cfd188bb43b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:00:49.323493 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811af0f-ea2c-456a-920f-3cfd188bb43b service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:49.324519 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811af0f-ea2c-456a-920f-3cfd188bb43b service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:49.325021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811af0f-ea2c-456a-920f-3cfd188bb43b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:49.335693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811af0f-ea2c-456a-920f-3cfd188bb43b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:00:49.337321 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811af0f-ea2c-456a-920f-3cfd188bb43b service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:00:49.348045 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1213/2407] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:00:54.601722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a743b-f2eb-44c5-9652-94e9377b135f None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:54.606803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a743b-f2eb-44c5-9652-94e9377b135f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:54.606803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a743b-f2eb-44c5-9652-94e9377b135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:54.630277 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-3a2a743b-f2eb-44c5-9652-94e9377b135f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:00:54.635750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3a2a743b-f2eb-44c5-9652-94e9377b135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:00:54.641970 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1195/2408] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Jun 2 14:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:00:54.678806 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811af0f-ea2c-456a-920f-3cfd188bb43b service nova] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:00:54.699499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811af0f-ea2c-456a-920f-3cfd188bb43b service nova] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:00:54.708165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c28760-9613-4db0-a6a4-effc14f141d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:00:54.708861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c28760-9613-4db0-a6a4-effc14f141d8 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:54.709150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c28760-9613-4db0-a6a4-effc14f141d8 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:54.709422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c28760-9613-4db0-a6a4-effc14f141d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:54.720798 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c28760-9613-4db0-a6a4-effc14f141d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:00:54.722440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c28760-9613-4db0-a6a4-effc14f141d8 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:00:54.749934 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1214/2409] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:00:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:00:59.881573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde3a0b-4d7e-46ff-bcf8-cf4d5c01c52d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:59.882127 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde3a0b-4d7e-46ff-bcf8-cf4d5c01c52d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:59.882230 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde3a0b-4d7e-46ff-bcf8-cf4d5c01c52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:59.888703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=38 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:00:59.901150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-efde3a0b-4d7e-46ff-bcf8-cf4d5c01c52d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:00:59.902973 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-efde3a0b-4d7e-46ff-bcf8-cf4d5c01c52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:00:59.910360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1196/2410] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Jun 2 14:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:00:59.932871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c28760-9613-4db0-a6a4-effc14f141d8 service nova] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:00:59.943979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c28760-9613-4db0-a6a4-effc14f141d8 service nova] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:00:59.949830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105a65f-e33f-4f5d-be00-3fc67f325e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:00:59.950454 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105a65f-e33f-4f5d-be00-3fc67f325e49 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:59.950735 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105a65f-e33f-4f5d-be00-3fc67f325e49 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:59.951008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105a65f-e33f-4f5d-be00-3fc67f325e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:59.959380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105a65f-e33f-4f5d-be00-3fc67f325e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:00:59.961001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105a65f-e33f-4f5d-be00-3fc67f325e49 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:00:59.971154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1215/2411] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:01:07.082576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e1132-4720-43d7-8d45-63d1b92dff42 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:07.083076 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e1132-4720-43d7-8d45-63d1b92dff42 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:07.084218 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e1132-4720-43d7-8d45-63d1b92dff42 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:07.084570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1197/2412] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 2 14:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:01:07.091178 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c8c6a-721d-452d-b133-e9cd70396524 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:07.091681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c8c6a-721d-452d-b133-e9cd70396524 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:07.091774 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c8c6a-721d-452d-b133-e9cd70396524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:07.130722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-1c7c8c6a-721d-452d-b133-e9cd70396524 None None] MFA Rules not processed for user `b9971f2bf0f2400b90168f6032a0e226`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:01:07.132236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1c7c8c6a-721d-452d-b133-e9cd70396524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:07.144841 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1216/2413] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 2 14:01:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:01:07.157362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e1132-4720-43d7-8d45-63d1b92dff42 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:01:07.159216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8c7e1132-4720-43d7-8d45-63d1b92dff42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:07.245631 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e1132-4720-43d7-8d45-63d1b92dff42 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:01:07.249412 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c602d-8d36-4732-896e-aef6dee19c8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be4de0fa80784de1acfcd47a2b77d9ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:01:07.250057 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c602d-8d36-4732-896e-aef6dee19c8f service glance] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:07.250345 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c602d-8d36-4732-896e-aef6dee19c8f service glance] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:07.250625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c602d-8d36-4732-896e-aef6dee19c8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:07.267664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c602d-8d36-4732-896e-aef6dee19c8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:01:07.269316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c602d-8d36-4732-896e-aef6dee19c8f service glance] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:01:07.282736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1198/2414] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:01:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:01:07.463852 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9eebe-ef08-4312-b0dc-cd8c9c8deb03 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:07.464153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9eebe-ef08-4312-b0dc-cd8c9c8deb03 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:07.464444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9eebe-ef08-4312-b0dc-cd8c9c8deb03 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:07.466446 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1217/2415] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 2 14:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:01:07.471353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba1a2-8d4d-422b-a26e-bdebdb845f91 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:07.471686 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba1a2-8d4d-422b-a26e-bdebdb845f91 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:07.472106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba1a2-8d4d-422b-a26e-bdebdb845f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:07.491009 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-7a8ba1a2-8d4d-422b-a26e-bdebdb845f91 None None] MFA Rules not processed for user `d95c75980e114aa488424fb115add647`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:01:07.492254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7a8ba1a2-8d4d-422b-a26e-bdebdb845f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:07.543590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1199/2416] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 2 14:01:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:01:07.555249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9eebe-ef08-4312-b0dc-cd8c9c8deb03 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:01:07.557009 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-28b9eebe-ef08-4312-b0dc-cd8c9c8deb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:07.565369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=72 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:07.571390 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9eebe-ef08-4312-b0dc-cd8c9c8deb03 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:01:07.575520 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c161d-8e83-4103-b971-4b4680040950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:01:07.576204 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c161d-8e83-4103-b971-4b4680040950 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:07.576485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c161d-8e83-4103-b971-4b4680040950 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:07.576827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c161d-8e83-4103-b971-4b4680040950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:07.583919 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c161d-8e83-4103-b971-4b4680040950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:01:07.585535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c161d-8e83-4103-b971-4b4680040950 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:01:07.594046 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1218/2417] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:01:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:01:07.675569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ed954-1d9d-49cc-bb18-59650a9333f1 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:07.675867 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ed954-1d9d-49cc-bb18-59650a9333f1 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:07.676147 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ed954-1d9d-49cc-bb18-59650a9333f1 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:07.677531 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1200/2418] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 2 14:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:01:07.683311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445221-ffdf-4155-b76d-4cd3ffba34b4 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:07.683634 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445221-ffdf-4155-b76d-4cd3ffba34b4 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:07.683916 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445221-ffdf-4155-b76d-4cd3ffba34b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:07.703003 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d1445221-ffdf-4155-b76d-4cd3ffba34b4 None None] MFA Rules not processed for user `b9971f2bf0f2400b90168f6032a0e226`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:01:07.706498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d1445221-ffdf-4155-b76d-4cd3ffba34b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:07.713359 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1219/2419] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 2 14:01:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:01:07.724420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ed954-1d9d-49cc-bb18-59650a9333f1 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:01:07.726195 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e54ed954-1d9d-49cc-bb18-59650a9333f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:07.739688 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ed954-1d9d-49cc-bb18-59650a9333f1 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:01:07.743367 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11a6c1-652d-4b57-8756-3ccecb649aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:01:07.744237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11a6c1-652d-4b57-8756-3ccecb649aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:07.744522 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11a6c1-652d-4b57-8756-3ccecb649aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:07.744802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11a6c1-652d-4b57-8756-3ccecb649aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:07.755768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11a6c1-652d-4b57-8756-3ccecb649aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:01:07.757268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11a6c1-652d-4b57-8756-3ccecb649aa4 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:01:07.768798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1201/2420] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:01:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:01:16.655412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e31ce8-e5fa-408b-b07f-295ed366686b None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:16.655902 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e31ce8-e5fa-408b-b07f-295ed366686b None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:16.656015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e31ce8-e5fa-408b-b07f-295ed366686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:16.673715 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-26e31ce8-e5fa-408b-b07f-295ed366686b None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:01:16.674917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-26e31ce8-e5fa-408b-b07f-295ed366686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:16.682440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1220/2421] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 14:01:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:01:16.695739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11a6c1-652d-4b57-8756-3ccecb649aa4 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:01:16.707797 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11a6c1-652d-4b57-8756-3ccecb649aa4 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:01:16.712810 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa231b-8870-46c7-9419-e968892c59c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:01:16.713453 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa231b-8870-46c7-9419-e968892c59c3 service swift] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:16.713761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa231b-8870-46c7-9419-e968892c59c3 service swift] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:16.714111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa231b-8870-46c7-9419-e968892c59c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:16.722857 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa231b-8870-46c7-9419-e968892c59c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:01:16.724477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa231b-8870-46c7-9419-e968892c59c3 service swift] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:01:16.732652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1202/2422] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 14:01:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:01:26.668362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=11 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:26.729249 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=72 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:41.230595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e31ce8-e5fa-408b-b07f-295ed366686b None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:01:41.239903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e31ce8-e5fa-408b-b07f-295ed366686b None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:01:41.243712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8b350-df7a-4a77-8a3a-35df752679e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:01:41.244344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8b350-df7a-4a77-8a3a-35df752679e2 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:41.244627 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8b350-df7a-4a77-8a3a-35df752679e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:41.244902 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8b350-df7a-4a77-8a3a-35df752679e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:41.247321 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-12d8b350-df7a-4a77-8a3a-35df752679e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:41.261157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8b350-df7a-4a77-8a3a-35df752679e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:01:41.262614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8b350-df7a-4a77-8a3a-35df752679e2 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:01:41.273961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1221/2423] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:01:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:01:42.418055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa231b-8870-46c7-9419-e968892c59c3 service swift] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:01:42.419563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-69aa231b-8870-46c7-9419-e968892c59c3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:42.479633 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa231b-8870-46c7-9419-e968892c59c3 service swift] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:01:42.483825 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb8684-2d2b-44ad-aad1-a21483755c1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:01:42.484474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb8684-2d2b-44ad-aad1-a21483755c1d service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:42.484761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb8684-2d2b-44ad-aad1-a21483755c1d service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:42.485041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb8684-2d2b-44ad-aad1-a21483755c1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:42.486831 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6ceb8684-2d2b-44ad-aad1-a21483755c1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:42.501286 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb8684-2d2b-44ad-aad1-a21483755c1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:01:42.502755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb8684-2d2b-44ad-aad1-a21483755c1d service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:01:42.514155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1203/2424] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:01:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:01:42.787802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe693349-ee23-4da1-a5a2-2b7ba4838b60 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:42.787802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe693349-ee23-4da1-a5a2-2b7ba4838b60 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:42.787802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe693349-ee23-4da1-a5a2-2b7ba4838b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:42.805184 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-fe693349-ee23-4da1-a5a2-2b7ba4838b60 None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:01:42.806375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-fe693349-ee23-4da1-a5a2-2b7ba4838b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:42.813486 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1222/2425] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 2 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:01:42.835163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb8684-2d2b-44ad-aad1-a21483755c1d service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:01:42.846764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb8684-2d2b-44ad-aad1-a21483755c1d service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:01:42.851746 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba66cea-4916-4ec6-94bc-23145eeae4f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:01:42.852397 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba66cea-4916-4ec6-94bc-23145eeae4f4 service swift] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:42.852724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba66cea-4916-4ec6-94bc-23145eeae4f4 service swift] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:42.852977 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba66cea-4916-4ec6-94bc-23145eeae4f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:42.861235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba66cea-4916-4ec6-94bc-23145eeae4f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:01:42.862780 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba66cea-4916-4ec6-94bc-23145eeae4f4 service swift] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:01:42.872084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1204/2426] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 14:01:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:01:52.799610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=9 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:52.868669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=32 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:53.911038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe693349-ee23-4da1-a5a2-2b7ba4838b60 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:01:53.924375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe693349-ee23-4da1-a5a2-2b7ba4838b60 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:01:53.929778 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec501a-bc4b-476e-8301-d40563fdd989 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:01:53.930414 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec501a-bc4b-476e-8301-d40563fdd989 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:53.930702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec501a-bc4b-476e-8301-d40563fdd989 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:53.930980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec501a-bc4b-476e-8301-d40563fdd989 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:53.932776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-54ec501a-bc4b-476e-8301-d40563fdd989 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:53.989706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec501a-bc4b-476e-8301-d40563fdd989 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:01:53.991348 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec501a-bc4b-476e-8301-d40563fdd989 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:01:54.001215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1223/2427] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:01:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:02:03.996457 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=28 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:04.176805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9064c0-9ebe-4baf-b2f9-1019957c2f65 None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:04.177318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9064c0-9ebe-4baf-b2f9-1019957c2f65 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:04.177424 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9064c0-9ebe-4baf-b2f9-1019957c2f65 None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:04.178711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1205/2428] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 2 14:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:02:04.188224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79328-5d54-4857-8952-5d31fc2b8c12 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:04.188613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79328-5d54-4857-8952-5d31fc2b8c12 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:04.188965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79328-5d54-4857-8952-5d31fc2b8c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:04.225395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-73c79328-5d54-4857-8952-5d31fc2b8c12 None None] MFA Rules not processed for user `b387ad13a6c843d0b9a43bc8f5f7fa13`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:02:04.226604 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-73c79328-5d54-4857-8952-5d31fc2b8c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:04.235932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1224/2429] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 2 14:02:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:02:04.246690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9064c0-9ebe-4baf-b2f9-1019957c2f65 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:04.248596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2c9064c0-9ebe-4baf-b2f9-1019957c2f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:04.265486 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9064c0-9ebe-4baf-b2f9-1019957c2f65 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:04.270497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60220132-95c7-4d70-844b-35154d7977f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:04.271131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60220132-95c7-4d70-844b-35154d7977f2 service placement] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:04.271413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60220132-95c7-4d70-844b-35154d7977f2 service placement] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:04.271795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60220132-95c7-4d70-844b-35154d7977f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:04.280712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60220132-95c7-4d70-844b-35154d7977f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:04.282342 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60220132-95c7-4d70-844b-35154d7977f2 service placement] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:04.292194 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1206/2430] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:02:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:02:04.318547 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c79328-5d54-4857-8952-5d31fc2b8c12 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:04.319958 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-73c79328-5d54-4857-8952-5d31fc2b8c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:04.337293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c79328-5d54-4857-8952-5d31fc2b8c12 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:04.341941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622ef27-bd96-44aa-8540-c18ed09c5941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:04.343131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622ef27-bd96-44aa-8540-c18ed09c5941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:04.343412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622ef27-bd96-44aa-8540-c18ed09c5941 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:04.343754 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622ef27-bd96-44aa-8540-c18ed09c5941 admin admin] PATH_INFO: `/v3/users/35355d654eee4e0eb81c6d4d334a22e7` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:04.344948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622ef27-bd96-44aa-8540-c18ed09c5941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35355d654eee4e0eb81c6d4d334a22e7)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:04.346872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622ef27-bd96-44aa-8540-c18ed09c5941 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:04.549510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b622ef27-bd96-44aa-8540-c18ed09c5941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35355d654eee4e0eb81c6d4d334a22e7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:04.647564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b622ef27-bd96-44aa-8540-c18ed09c5941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35355d654eee4e0eb81c6d4d334a22e7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:04.659958 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b622ef27-bd96-44aa-8540-c18ed09c5941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35355d654eee4e0eb81c6d4d334a22e7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:04.664730 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b622ef27-bd96-44aa-8540-c18ed09c5941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35355d654eee4e0eb81c6d4d334a22e7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:04.667671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b622ef27-bd96-44aa-8540-c18ed09c5941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35355d654eee4e0eb81c6d4d334a22e7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:04.673591 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1225/2431] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:02:04 2022] DELETE /identity/v3/users/35355d654eee4e0eb81c6d4d334a22e7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:02:05.017154 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60220132-95c7-4d70-844b-35154d7977f2 service placement] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:05.028546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60220132-95c7-4d70-844b-35154d7977f2 service placement] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:05.086927 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54c45c-8c0c-4b08-b180-826d202b49ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:05.087752 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54c45c-8c0c-4b08-b180-826d202b49ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:05.088041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54c45c-8c0c-4b08-b180-826d202b49ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:05.088320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54c45c-8c0c-4b08-b180-826d202b49ff admin admin] PATH_INFO: `/v3/projects/60c20c3dbd654dc8aea02e3bdf50a53a` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:05.089583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54c45c-8c0c-4b08-b180-826d202b49ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c20c3dbd654dc8aea02e3bdf50a53a)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:05.091572 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54c45c-8c0c-4b08-b180-826d202b49ff admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:05.195964 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-8b54c45c-8c0c-4b08-b180-826d202b49ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c20c3dbd654dc8aea02e3bdf50a53a', 'request_id': 'req-8b54c45c-8c0c-4b08-b180-826d202b49ff'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:05.270649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-8b54c45c-8c0c-4b08-b180-826d202b49ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c20c3dbd654dc8aea02e3bdf50a53a', 'request_id': 'req-8b54c45c-8c0c-4b08-b180-826d202b49ff'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:05.277543 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-8b54c45c-8c0c-4b08-b180-826d202b49ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c20c3dbd654dc8aea02e3bdf50a53a', 'request_id': 'req-8b54c45c-8c0c-4b08-b180-826d202b49ff'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:05.288739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-8b54c45c-8c0c-4b08-b180-826d202b49ff admin admin] The token cache is being invalidate because project 60c20c3dbd654dc8aea02e3bdf50a53a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:02:05.289026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-8b54c45c-8c0c-4b08-b180-826d202b49ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:05.289699 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-8b54c45c-8c0c-4b08-b180-826d202b49ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:05.291243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1207/2432] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:02:05 2022] DELETE /identity/v3/projects/60c20c3dbd654dc8aea02e3bdf50a53a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:02:05.296628 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c7689-1067-416a-a852-28b53b676fb8 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:05.297108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c7689-1067-416a-a852-28b53b676fb8 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:05.297214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c7689-1067-416a-a852-28b53b676fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:05.315647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-609c7689-1067-416a-a852-28b53b676fb8 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:02:05.316834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-609c7689-1067-416a-a852-28b53b676fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:05.375862 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1226/2433] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:02:05.383438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94f61f-6c75-4065-887a-c490fe462440 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:05.383796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94f61f-6c75-4065-887a-c490fe462440 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:05.384449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94f61f-6c75-4065-887a-c490fe462440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:05.404380 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-6f94f61f-6c75-4065-887a-c490fe462440 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:02:05.405591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6f94f61f-6c75-4065-887a-c490fe462440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:05.413673 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1208/2434] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:02:05.416344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c7689-1067-416a-a852-28b53b676fb8 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:05.416344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-609c7689-1067-416a-a852-28b53b676fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:05.419140 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94f61f-6c75-4065-887a-c490fe462440 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:05.428676 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94f61f-6c75-4065-887a-c490fe462440 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:05.433545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10a38f-eead-46e7-906a-6867a6d6e8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:05.434235 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10a38f-eead-46e7-906a-6867a6d6e8ed admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:05.434523 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10a38f-eead-46e7-906a-6867a6d6e8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:05.434806 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10a38f-eead-46e7-906a-6867a6d6e8ed admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:05.435649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10a38f-eead-46e7-906a-6867a6d6e8ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:02:05.436033 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10a38f-eead-46e7-906a-6867a6d6e8ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:05.437604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10a38f-eead-46e7-906a-6867a6d6e8ed admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:05.450019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1209/2435] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:02:05.455041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10a38f-eead-46e7-906a-6867a6d6e8ed admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:05.464925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10a38f-eead-46e7-906a-6867a6d6e8ed admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:05.470261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2445f-30ab-4fae-9d4f-e16014f0d5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:05.470897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2445f-30ab-4fae-9d4f-e16014f0d5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:05.471177 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2445f-30ab-4fae-9d4f-e16014f0d5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:05.471470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2445f-30ab-4fae-9d4f-e16014f0d5d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:05.472152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2445f-30ab-4fae-9d4f-e16014f0d5d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:05.474048 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2445f-30ab-4fae-9d4f-e16014f0d5d6 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:05.478257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c7689-1067-416a-a852-28b53b676fb8 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:05.482517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45411a-c4e0-49ad-8ae3-6ce95f300853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:05.483158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45411a-c4e0-49ad-8ae3-6ce95f300853 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:05.483491 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45411a-c4e0-49ad-8ae3-6ce95f300853 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:05.483742 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45411a-c4e0-49ad-8ae3-6ce95f300853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:05.485542 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9d45411a-c4e0-49ad-8ae3-6ce95f300853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:05.493177 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:05.495485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45411a-c4e0-49ad-8ae3-6ce95f300853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:05.496929 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45411a-c4e0-49ad-8ae3-6ce95f300853 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:05.504787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1227/2436] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:02:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:02:05.580945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1210/2437] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:02:05 2022] POST /identity/v3/projects => generated 399 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:02:05.582217 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45411a-c4e0-49ad-8ae3-6ce95f300853 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:05.593931 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45411a-c4e0-49ad-8ae3-6ce95f300853 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:05.651043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52bbe5-8069-40c5-b8ff-8e29f5154784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:05.651663 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52bbe5-8069-40c5-b8ff-8e29f5154784 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:05.651953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52bbe5-8069-40c5-b8ff-8e29f5154784 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:05.652427 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52bbe5-8069-40c5-b8ff-8e29f5154784 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:05.653765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52bbe5-8069-40c5-b8ff-8e29f5154784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:05.656279 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52bbe5-8069-40c5-b8ff-8e29f5154784 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:05.762457 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1228/2438] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:02:05 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:02:05.766524 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2445f-30ab-4fae-9d4f-e16014f0d5d6 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:05.776829 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2445f-30ab-4fae-9d4f-e16014f0d5d6 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:05.781478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170659cf-7f4c-488d-bbc5-833ee2c4ed6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:05.782129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170659cf-7f4c-488d-bbc5-833ee2c4ed6b admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:05.782414 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170659cf-7f4c-488d-bbc5-833ee2c4ed6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:05.782691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170659cf-7f4c-488d-bbc5-833ee2c4ed6b admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:05.783410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170659cf-7f4c-488d-bbc5-833ee2c4ed6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:05.785032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170659cf-7f4c-488d-bbc5-833ee2c4ed6b admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:05.795358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1211/2439] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:02:05.799294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52bbe5-8069-40c5-b8ff-8e29f5154784 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:05.809740 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52bbe5-8069-40c5-b8ff-8e29f5154784 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:05.814307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa10e52-47d3-4545-baaf-42d7fdd8d2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:05.814956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa10e52-47d3-4545-baaf-42d7fdd8d2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:05.815237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa10e52-47d3-4545-baaf-42d7fdd8d2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:05.815543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa10e52-47d3-4545-baaf-42d7fdd8d2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:05.816261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa10e52-47d3-4545-baaf-42d7fdd8d2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:05.817845 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa10e52-47d3-4545-baaf-42d7fdd8d2c7 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:05.827697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1229/2440] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:02:05.831433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170659cf-7f4c-488d-bbc5-833ee2c4ed6b admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:05.841113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170659cf-7f4c-488d-bbc5-833ee2c4ed6b admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:05.845711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ac539-2fc6-4994-8648-34bc67852ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:05.846580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ac539-2fc6-4994-8648-34bc67852ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:05.846864 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ac539-2fc6-4994-8648-34bc67852ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:05.847141 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ac539-2fc6-4994-8648-34bc67852ea2 admin admin] PATH_INFO: `/v3/projects/2939bcdf91c2416a840b08000a3f9c78/users/3def754abb5c4da28f5b4c46e4a88ccf/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:05.861745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ac539-2fc6-4994-8648-34bc67852ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2939bcdf91c2416a840b08000a3f9c78, user_id=3def754abb5c4da28f5b4c46e4a88ccf, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:05.864501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ac539-2fc6-4994-8648-34bc67852ea2 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:05.929121 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:05.942858 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1212/2441] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:02:05 2022] PUT /identity/v3/projects/2939bcdf91c2416a840b08000a3f9c78/users/3def754abb5c4da28f5b4c46e4a88ccf/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:02:05.944643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bcdad-e2fd-4f76-9dc1-7c95f198b92b None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:05.949063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bcdad-e2fd-4f76-9dc1-7c95f198b92b None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:05.949063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bcdad-e2fd-4f76-9dc1-7c95f198b92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:05.972494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-e76bcdad-e2fd-4f76-9dc1-7c95f198b92b None None] MFA Rules not processed for user `3def754abb5c4da28f5b4c46e4a88ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:02:05.973709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e76bcdad-e2fd-4f76-9dc1-7c95f198b92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:06.040115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1230/2442] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:02:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:02:06.052441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ac539-2fc6-4994-8648-34bc67852ea2 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:06.055014 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-af5ac539-2fc6-4994-8648-34bc67852ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:06.110725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ac539-2fc6-4994-8648-34bc67852ea2 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:06.114357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e63ed-68b2-4833-947e-67a574b25a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:06.114993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e63ed-68b2-4833-947e-67a574b25a80 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:06.115272 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e63ed-68b2-4833-947e-67a574b25a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:06.115575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e63ed-68b2-4833-947e-67a574b25a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:06.124452 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e63ed-68b2-4833-947e-67a574b25a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:06.125860 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e63ed-68b2-4833-947e-67a574b25a80 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:06.134649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1213/2443] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:02:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:02:08.412131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045cbeb-9c4b-46cd-8a11-725d41ad2aee None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:08.412642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045cbeb-9c4b-46cd-8a11-725d41ad2aee None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:08.412755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045cbeb-9c4b-46cd-8a11-725d41ad2aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:08.429828 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-c045cbeb-9c4b-46cd-8a11-725d41ad2aee None None] MFA Rules not processed for user `b839f3c96b7d4893ae4a7500865ad760`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:02:08.431005 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c045cbeb-9c4b-46cd-8a11-725d41ad2aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:08.484731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1231/2444] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:02:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:02:13.185415 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e63ed-68b2-4833-947e-67a574b25a80 service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:13.247113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e63ed-68b2-4833-947e-67a574b25a80 service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:13.251663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d003e2-277e-4aed-9a09-e6f47002f6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:13.252538 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d003e2-277e-4aed-9a09-e6f47002f6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:13.255386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d003e2-277e-4aed-9a09-e6f47002f6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:13.255386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d003e2-277e-4aed-9a09-e6f47002f6a6 admin admin] PATH_INFO: `/v3/users/3def754abb5c4da28f5b4c46e4a88ccf` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:13.255386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d003e2-277e-4aed-9a09-e6f47002f6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3def754abb5c4da28f5b4c46e4a88ccf)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:13.256180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d003e2-277e-4aed-9a09-e6f47002f6a6 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:13.427913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-89d003e2-277e-4aed-9a09-e6f47002f6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3def754abb5c4da28f5b4c46e4a88ccf'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:13.439666 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-89d003e2-277e-4aed-9a09-e6f47002f6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3def754abb5c4da28f5b4c46e4a88ccf'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:13.446418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-89d003e2-277e-4aed-9a09-e6f47002f6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3def754abb5c4da28f5b4c46e4a88ccf'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:13.447085 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-89d003e2-277e-4aed-9a09-e6f47002f6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3def754abb5c4da28f5b4c46e4a88ccf'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:13.530535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-89d003e2-277e-4aed-9a09-e6f47002f6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3def754abb5c4da28f5b4c46e4a88ccf'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:13.539516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1214/2445] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:02:13 2022] DELETE /identity/v3/users/3def754abb5c4da28f5b4c46e4a88ccf => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:02:13.544002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4eecd-fda3-4b2f-b721-558ed3840b03 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:13.544557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4eecd-fda3-4b2f-b721-558ed3840b03 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:13.544557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4eecd-fda3-4b2f-b721-558ed3840b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:13.561933 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-4ab4eecd-fda3-4b2f-b721-558ed3840b03 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:02:13.563679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4ab4eecd-fda3-4b2f-b721-558ed3840b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:13.567734 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:13.625796 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1232/2446] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:02:13.635712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d003e2-277e-4aed-9a09-e6f47002f6a6 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:13.637108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-89d003e2-277e-4aed-9a09-e6f47002f6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:13.666122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:13.697825 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d003e2-277e-4aed-9a09-e6f47002f6a6 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:13.702498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd030a-e3f3-4670-b2da-7788ae5f3914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:13.703753 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd030a-e3f3-4670-b2da-7788ae5f3914 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:13.704045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd030a-e3f3-4670-b2da-7788ae5f3914 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:13.704326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd030a-e3f3-4670-b2da-7788ae5f3914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:13.714045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd030a-e3f3-4670-b2da-7788ae5f3914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:13.716275 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd030a-e3f3-4670-b2da-7788ae5f3914 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:13.726035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1215/2447] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:02:14.299278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4eecd-fda3-4b2f-b721-558ed3840b03 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:14.300831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4ab4eecd-fda3-4b2f-b721-558ed3840b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:14.313047 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4eecd-fda3-4b2f-b721-558ed3840b03 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:14.318841 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:14.319760 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:14.323664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:14.323664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] PATH_INFO: `/v3/projects/2939bcdf91c2416a840b08000a3f9c78` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:14.323664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2939bcdf91c2416a840b08000a3f9c78)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:14.323664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:14.445129 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2939bcdf91c2416a840b08000a3f9c78', 'request_id': 'req-afc5496f-dc17-4215-ba69-32843fb623e1'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:14.535711 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2939bcdf91c2416a840b08000a3f9c78', 'request_id': 'req-afc5496f-dc17-4215-ba69-32843fb623e1'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:14.542396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2939bcdf91c2416a840b08000a3f9c78', 'request_id': 'req-afc5496f-dc17-4215-ba69-32843fb623e1'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:14.556387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] The token cache is being invalidate because project 2939bcdf91c2416a840b08000a3f9c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:02:14.556387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:14.556387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:14.557145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1233/2448] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:02:14 2022] DELETE /identity/v3/projects/2939bcdf91c2416a840b08000a3f9c78 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:02:14.760429 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd030a-e3f3-4670-b2da-7788ae5f3914 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:14.761917 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-74cd030a-e3f3-4670-b2da-7788ae5f3914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:14.842814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd030a-e3f3-4670-b2da-7788ae5f3914 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:14.906071 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa89286-3e29-4460-bfda-b558f73862d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:14.907289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa89286-3e29-4460-bfda-b558f73862d5 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:14.907602 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa89286-3e29-4460-bfda-b558f73862d5 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:14.907876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa89286-3e29-4460-bfda-b558f73862d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:14.909660 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6fa89286-3e29-4460-bfda-b558f73862d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:14.921949 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa89286-3e29-4460-bfda-b558f73862d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:14.923575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa89286-3e29-4460-bfda-b558f73862d5 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:14.934352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1216/2449] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:02:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:02:24.550904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:24.929636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=78 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:02.796915 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:02.798886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:02.816038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5496f-dc17-4215-ba69-32843fb623e1 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:02.821550 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53138a8-80b9-4fe4-bcd0-d9756f47facb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:02.822196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53138a8-80b9-4fe4-bcd0-d9756f47facb service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:02.822482 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53138a8-80b9-4fe4-bcd0-d9756f47facb service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:02.822762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53138a8-80b9-4fe4-bcd0-d9756f47facb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:02.824750 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f53138a8-80b9-4fe4-bcd0-d9756f47facb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:02.884859 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53138a8-80b9-4fe4-bcd0-d9756f47facb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:02.886484 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53138a8-80b9-4fe4-bcd0-d9756f47facb service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:02.896077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1234/2450] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:03:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:03:07.450120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa89286-3e29-4460-bfda-b558f73862d5 service nova] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:07.461286 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa89286-3e29-4460-bfda-b558f73862d5 service nova] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:07.466790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf1133-36c6-4444-90a6-3739ef9a4576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:07.467419 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1133-36c6-4444-90a6-3739ef9a4576 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:07.467729 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1133-36c6-4444-90a6-3739ef9a4576 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:07.468010 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1133-36c6-4444-90a6-3739ef9a4576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:07.469760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-eedf1133-36c6-4444-90a6-3739ef9a4576 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:07.528316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf1133-36c6-4444-90a6-3739ef9a4576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:07.529937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf1133-36c6-4444-90a6-3739ef9a4576 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:07.539350 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1217/2451] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:03:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:03:12.891651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=28 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:14.477961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53b176-2e39-41c1-9e9d-30e30757a955 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:14.478645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53b176-2e39-41c1-9e9d-30e30757a955 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:14.478645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53b176-2e39-41c1-9e9d-30e30757a955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:14.496731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-3f53b176-2e39-41c1-9e9d-30e30757a955 None None] MFA Rules not processed for user `199a0c82abd34b5f88063d79d89da19d`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:03:14.497970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3f53b176-2e39-41c1-9e9d-30e30757a955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:14.505090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1235/2452] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:03:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:03:14.801046 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf1133-36c6-4444-90a6-3739ef9a4576 service nova] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:14.802485 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-eedf1133-36c6-4444-90a6-3739ef9a4576 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:14.857045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf1133-36c6-4444-90a6-3739ef9a4576 service nova] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:14.860604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401d538-d1d7-4294-80bc-842c984a3df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:14.861236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401d538-d1d7-4294-80bc-842c984a3df2 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:14.861516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401d538-d1d7-4294-80bc-842c984a3df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:14.861788 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401d538-d1d7-4294-80bc-842c984a3df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:14.863545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1401d538-d1d7-4294-80bc-842c984a3df2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:14.872805 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401d538-d1d7-4294-80bc-842c984a3df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:14.874213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401d538-d1d7-4294-80bc-842c984a3df2 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:14.881903 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1218/2453] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:03:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:03:17.278960 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53b176-2e39-41c1-9e9d-30e30757a955 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:17.280353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3f53b176-2e39-41c1-9e9d-30e30757a955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:17.351629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53b176-2e39-41c1-9e9d-30e30757a955 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:17.356769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5ed4b-789f-4323-ac97-92dd03019869 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:17.357422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5ed4b-789f-4323-ac97-92dd03019869 service placement] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:17.357709 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5ed4b-789f-4323-ac97-92dd03019869 service placement] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:17.357991 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5ed4b-789f-4323-ac97-92dd03019869 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:17.359953 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-0ba5ed4b-789f-4323-ac97-92dd03019869 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:17.373326 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5ed4b-789f-4323-ac97-92dd03019869 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:17.375018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5ed4b-789f-4323-ac97-92dd03019869 service placement] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:17.385686 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1236/2454] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:03:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:03:24.878472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=54 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:27.381168 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=35 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:30.655039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401d538-d1d7-4294-80bc-842c984a3df2 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:30.656584 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1401d538-d1d7-4294-80bc-842c984a3df2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:30.672935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401d538-d1d7-4294-80bc-842c984a3df2 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:30.679376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee1c47-4875-44a0-a4f7-4bc4270535e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:30.680038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee1c47-4875-44a0-a4f7-4bc4270535e4 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:30.680324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee1c47-4875-44a0-a4f7-4bc4270535e4 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:30.680600 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee1c47-4875-44a0-a4f7-4bc4270535e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:30.682441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3cee1c47-4875-44a0-a4f7-4bc4270535e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:30.694435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee1c47-4875-44a0-a4f7-4bc4270535e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:30.696149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee1c47-4875-44a0-a4f7-4bc4270535e4 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:30.707338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1219/2455] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:03:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:03:40.702423 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=6 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:53.967686 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5ed4b-789f-4323-ac97-92dd03019869 service placement] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:53.969088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-0ba5ed4b-789f-4323-ac97-92dd03019869 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:53.980395 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5ed4b-789f-4323-ac97-92dd03019869 service placement] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:53.983936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd783056-1424-4b30-8f83-5ffc0ff68335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:53.984567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783056-1424-4b30-8f83-5ffc0ff68335 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:53.984850 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783056-1424-4b30-8f83-5ffc0ff68335 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:53.985126 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783056-1424-4b30-8f83-5ffc0ff68335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:53.986820 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-cd783056-1424-4b30-8f83-5ffc0ff68335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:54.048873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd783056-1424-4b30-8f83-5ffc0ff68335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:54.050309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd783056-1424-4b30-8f83-5ffc0ff68335 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:54.059913 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1237/2456] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:03:57.645554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee1c47-4875-44a0-a4f7-4bc4270535e4 service nova] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:57.656886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee1c47-4875-44a0-a4f7-4bc4270535e4 service nova] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:57.662564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab394680-493c-4cfc-8efc-3239f2a52650 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:57.663200 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab394680-493c-4cfc-8efc-3239f2a52650 service placement] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:57.663503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab394680-493c-4cfc-8efc-3239f2a52650 service placement] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:57.663784 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab394680-493c-4cfc-8efc-3239f2a52650 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:57.665543 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ab394680-493c-4cfc-8efc-3239f2a52650 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:57.680334 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab394680-493c-4cfc-8efc-3239f2a52650 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:57.681926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab394680-493c-4cfc-8efc-3239f2a52650 service placement] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:57.692259 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1220/2457] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:03:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:03:57.754150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd783056-1424-4b30-8f83-5ffc0ff68335 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:57.755647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-cd783056-1424-4b30-8f83-5ffc0ff68335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:57.767710 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd783056-1424-4b30-8f83-5ffc0ff68335 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:57.772366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f372d5e-1546-43ee-ba29-5af4c7c3f6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:57.773282 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f372d5e-1546-43ee-ba29-5af4c7c3f6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:57.773572 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f372d5e-1546-43ee-ba29-5af4c7c3f6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:57.773851 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f372d5e-1546-43ee-ba29-5af4c7c3f6cf admin admin] PATH_INFO: `/v3/users/b839f3c96b7d4893ae4a7500865ad760` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:57.775117 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f372d5e-1546-43ee-ba29-5af4c7c3f6cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b839f3c96b7d4893ae4a7500865ad760)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:57.777152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f372d5e-1546-43ee-ba29-5af4c7c3f6cf admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:57.979399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2f372d5e-1546-43ee-ba29-5af4c7c3f6cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b839f3c96b7d4893ae4a7500865ad760'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:58.056560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2f372d5e-1546-43ee-ba29-5af4c7c3f6cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b839f3c96b7d4893ae4a7500865ad760'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:58.068937 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2f372d5e-1546-43ee-ba29-5af4c7c3f6cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b839f3c96b7d4893ae4a7500865ad760'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:58.069595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2f372d5e-1546-43ee-ba29-5af4c7c3f6cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b839f3c96b7d4893ae4a7500865ad760'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:58.076337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2f372d5e-1546-43ee-ba29-5af4c7c3f6cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b839f3c96b7d4893ae4a7500865ad760'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:58.082165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1238/2458] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:03:57 2022] DELETE /identity/v3/users/b839f3c96b7d4893ae4a7500865ad760 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:03:58.339310 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab394680-493c-4cfc-8efc-3239f2a52650 service placement] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:58.350029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab394680-493c-4cfc-8efc-3239f2a52650 service placement] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:58.411800 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:58.412674 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:58.412945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:58.413221 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4 admin admin] PATH_INFO: `/v3/projects/d3e081cce4504edaa2ab083c5f2a82d4` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:58.414407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e081cce4504edaa2ab083c5f2a82d4)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:58.416356 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:58.517232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e081cce4504edaa2ab083c5f2a82d4', 'request_id': 'req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:58.571009 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e081cce4504edaa2ab083c5f2a82d4', 'request_id': 'req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:58.577219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e081cce4504edaa2ab083c5f2a82d4', 'request_id': 'req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:58.588123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4 admin admin] The token cache is being invalidate because project d3e081cce4504edaa2ab083c5f2a82d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:03:58.588413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:58.589045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b0fa9723-0c5a-47d0-8f2d-02f9c7ff4ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:58.590643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1221/2459] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:03:58 2022] DELETE /identity/v3/projects/d3e081cce4504edaa2ab083c5f2a82d4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:03:58.595731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df88ec-ae0b-419c-9f48-f5f356baa959 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:58.596092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df88ec-ae0b-419c-9f48-f5f356baa959 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:58.596379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df88ec-ae0b-419c-9f48-f5f356baa959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:58.613925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-72df88ec-ae0b-419c-9f48-f5f356baa959 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:03:58.615109 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-72df88ec-ae0b-419c-9f48-f5f356baa959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:58.675027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1239/2460] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:03:58.682989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6550c0-d3ef-469c-926a-9830857c46cb None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:58.683501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6550c0-d3ef-469c-926a-9830857c46cb None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:58.683501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6550c0-d3ef-469c-926a-9830857c46cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:58.702041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-5c6550c0-d3ef-469c-926a-9830857c46cb None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:03:58.703223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5c6550c0-d3ef-469c-926a-9830857c46cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:58.711030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1222/2461] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:03:58.715017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df88ec-ae0b-419c-9f48-f5f356baa959 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:58.724522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df88ec-ae0b-419c-9f48-f5f356baa959 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:58.728977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a762f-b0c8-4ef6-9692-a942c1d9c7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:58.729615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a762f-b0c8-4ef6-9692-a942c1d9c7de admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:58.729894 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a762f-b0c8-4ef6-9692-a942c1d9c7de admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:58.730167 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a762f-b0c8-4ef6-9692-a942c1d9c7de admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:58.730884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a762f-b0c8-4ef6-9692-a942c1d9c7de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:03:58.731186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a762f-b0c8-4ef6-9692-a942c1d9c7de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:58.732835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a762f-b0c8-4ef6-9692-a942c1d9c7de admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:58.734241 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:58.745444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1240/2462] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:03:58.749565 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6550c0-d3ef-469c-926a-9830857c46cb None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:58.759161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6550c0-d3ef-469c-926a-9830857c46cb None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:58.764006 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b331b-a004-4f68-83e8-599f5eb2419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:58.764650 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b331b-a004-4f68-83e8-599f5eb2419c admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:58.764928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b331b-a004-4f68-83e8-599f5eb2419c admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:58.765223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b331b-a004-4f68-83e8-599f5eb2419c admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:58.765910 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b331b-a004-4f68-83e8-599f5eb2419c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:58.767901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b331b-a004-4f68-83e8-599f5eb2419c admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:58.896443 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1223/2463] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:03:58 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:03:58.900342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a762f-b0c8-4ef6-9692-a942c1d9c7de admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:58.910881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a762f-b0c8-4ef6-9692-a942c1d9c7de admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:58.967093 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a0061-23e1-408c-b054-409ff3747ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:58.967789 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a0061-23e1-408c-b054-409ff3747ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:58.968081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a0061-23e1-408c-b054-409ff3747ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:58.968356 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a0061-23e1-408c-b054-409ff3747ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:58.969034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a0061-23e1-408c-b054-409ff3747ca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:58.970954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a0061-23e1-408c-b054-409ff3747ca4 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:59.071666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1241/2464] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:03:58 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:03:59.075728 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b331b-a004-4f68-83e8-599f5eb2419c admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:59.086041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b331b-a004-4f68-83e8-599f5eb2419c admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:59.090663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b6759-8044-45b0-bd87-2bc3a1d3337a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:59.091313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b6759-8044-45b0-bd87-2bc3a1d3337a admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:59.091636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b6759-8044-45b0-bd87-2bc3a1d3337a admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:59.091920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b6759-8044-45b0-bd87-2bc3a1d3337a admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:59.092639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b6759-8044-45b0-bd87-2bc3a1d3337a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:59.094228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b6759-8044-45b0-bd87-2bc3a1d3337a admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:59.104562 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1224/2465] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:03:59.108306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a0061-23e1-408c-b054-409ff3747ca4 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:59.118993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a0061-23e1-408c-b054-409ff3747ca4 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:59.123583 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e03efb-72e5-4055-921b-7a4fcef962a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:59.124228 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e03efb-72e5-4055-921b-7a4fcef962a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:59.124514 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e03efb-72e5-4055-921b-7a4fcef962a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:59.124792 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e03efb-72e5-4055-921b-7a4fcef962a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:59.125510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e03efb-72e5-4055-921b-7a4fcef962a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:59.127088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e03efb-72e5-4055-921b-7a4fcef962a4 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:59.136811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1242/2466] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:03:59.140678 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b6759-8044-45b0-bd87-2bc3a1d3337a admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:59.150318 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b6759-8044-45b0-bd87-2bc3a1d3337a admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:59.155073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3be12-be33-4f2b-bb51-345ea7a14611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:59.155984 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3be12-be33-4f2b-bb51-345ea7a14611 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:59.156271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3be12-be33-4f2b-bb51-345ea7a14611 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:59.156574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3be12-be33-4f2b-bb51-345ea7a14611 admin admin] PATH_INFO: `/v3/projects/5d257724aef24f6dbc5ac428c151ce77/users/1f544b708f8f437dbc40def8b06de9cc/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:59.171492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3be12-be33-4f2b-bb51-345ea7a14611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d257724aef24f6dbc5ac428c151ce77, user_id=1f544b708f8f437dbc40def8b06de9cc, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:59.174148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3be12-be33-4f2b-bb51-345ea7a14611 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:59.271795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1225/2467] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:03:59 2022] PUT /identity/v3/projects/5d257724aef24f6dbc5ac428c151ce77/users/1f544b708f8f437dbc40def8b06de9cc/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:03:59.276817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb98d72-373f-4b3f-b8a2-72e10d3009aa None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:59.277108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb98d72-373f-4b3f-b8a2-72e10d3009aa None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:59.277389 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb98d72-373f-4b3f-b8a2-72e10d3009aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:59.295361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-deb98d72-373f-4b3f-b8a2-72e10d3009aa None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:03:59.296580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-deb98d72-373f-4b3f-b8a2-72e10d3009aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:59.355049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1243/2468] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:03:59.365290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3be12-be33-4f2b-bb51-345ea7a14611 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:59.367100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2ad3be12-be33-4f2b-bb51-345ea7a14611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:59.373605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:59.423058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3be12-be33-4f2b-bb51-345ea7a14611 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:59.427918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e50cb-40eb-48b1-ae1c-399066029a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:59.428561 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e50cb-40eb-48b1-ae1c-399066029a7f service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:59.428840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e50cb-40eb-48b1-ae1c-399066029a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:59.429110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e50cb-40eb-48b1-ae1c-399066029a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:59.438115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e50cb-40eb-48b1-ae1c-399066029a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:59.441875 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e50cb-40eb-48b1-ae1c-399066029a7f service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:59.448951 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1226/2469] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:04:04.849108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4af6c-e4fc-4587-ae23-19b7052acdac None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:04.849625 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4af6c-e4fc-4587-ae23-19b7052acdac None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:04.849731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4af6c-e4fc-4587-ae23-19b7052acdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:04.887136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-9dc4af6c-e4fc-4587-ae23-19b7052acdac None None] MFA Rules not processed for user `1f544b708f8f437dbc40def8b06de9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:04:04.888624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9dc4af6c-e4fc-4587-ae23-19b7052acdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:04.964429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1244/2470] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:04:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:04:04.976587 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e50cb-40eb-48b1-ae1c-399066029a7f service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:04.978049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-795e50cb-40eb-48b1-ae1c-399066029a7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:05.066161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e50cb-40eb-48b1-ae1c-399066029a7f service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:05.072901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e33b8-586e-4bc8-9382-195d599c2401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:05.073796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e33b8-586e-4bc8-9382-195d599c2401 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:05.074087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e33b8-586e-4bc8-9382-195d599c2401 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:05.074371 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e33b8-586e-4bc8-9382-195d599c2401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:05.083926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e33b8-586e-4bc8-9382-195d599c2401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:05.086140 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e33b8-586e-4bc8-9382-195d599c2401 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:05.096901 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1227/2471] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:04:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:04:07.523749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9998b4-e8dd-4e8f-998f-d9027f1f8c8e None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:07.524241 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9998b4-e8dd-4e8f-998f-d9027f1f8c8e None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:07.524362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9998b4-e8dd-4e8f-998f-d9027f1f8c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:07.530358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:07.542984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-5f9998b4-e8dd-4e8f-998f-d9027f1f8c8e None None] MFA Rules not processed for user `1f544b708f8f437dbc40def8b06de9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:04:07.544245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-5f9998b4-e8dd-4e8f-998f-d9027f1f8c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:07.551392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1245/2472] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:04:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:04:07.933214 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e33b8-586e-4bc8-9382-195d599c2401 service nova] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:07.934688 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-486e33b8-586e-4bc8-9382-195d599c2401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:07.947241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e33b8-586e-4bc8-9382-195d599c2401 service nova] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:07.950953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4f1e2-bb0e-47ff-9adb-854b211a4665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:07.951626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4f1e2-bb0e-47ff-9adb-854b211a4665 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:07.951908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4f1e2-bb0e-47ff-9adb-854b211a4665 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:07.952180 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4f1e2-bb0e-47ff-9adb-854b211a4665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:07.954142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-64a4f1e2-bb0e-47ff-9adb-854b211a4665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:07.965368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4f1e2-bb0e-47ff-9adb-854b211a4665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:07.966793 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4f1e2-bb0e-47ff-9adb-854b211a4665 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:07.975373 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1228/2473] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:04:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:04:17.971367 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=64 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:17.993921 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:29.804192 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78163944-1270-4eeb-8262-d72f02c8132e None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:29.804829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78163944-1270-4eeb-8262-d72f02c8132e None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:29.804829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78163944-1270-4eeb-8262-d72f02c8132e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:29.822759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-78163944-1270-4eeb-8262-d72f02c8132e None None] MFA Rules not processed for user `0a019fdb84494ec294c16dbc936e7d99`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:04:29.824002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-78163944-1270-4eeb-8262-d72f02c8132e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:29.878768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1246/2474] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:04:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:04:39.872028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=25 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:29.182929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0ab4-a3ba-484a-a7a5-dbebd8291805 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:05:29.183420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0ab4-a3ba-484a-a7a5-dbebd8291805 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:05:29.183551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0ab4-a3ba-484a-a7a5-dbebd8291805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:05:29.200448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-8dde0ab4-a3ba-484a-a7a5-dbebd8291805 None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:05:29.201666 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8dde0ab4-a3ba-484a-a7a5-dbebd8291805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:29.256271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1229/2475] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 14:05:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:05:29.386983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78163944-1270-4eeb-8262-d72f02c8132e None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:05:29.388419 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-78163944-1270-4eeb-8262-d72f02c8132e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:29.456815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78163944-1270-4eeb-8262-d72f02c8132e None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:05:29.461754 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf0d11-6965-45f9-aee8-3674f6992bb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:05:29.462397 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0d11-6965-45f9-aee8-3674f6992bb0 service swift] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:05:29.462682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0d11-6965-45f9-aee8-3674f6992bb0 service swift] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:05:29.462961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0d11-6965-45f9-aee8-3674f6992bb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:05:29.471560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf0d11-6965-45f9-aee8-3674f6992bb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:05:29.473143 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf0d11-6965-45f9-aee8-3674f6992bb0 service swift] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:05:29.481077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1247/2476] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 14:05:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:05:39.249347 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=25 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:39.477869 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=32 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:40.062886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde0ab4-a3ba-484a-a7a5-dbebd8291805 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:05:40.064340 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8dde0ab4-a3ba-484a-a7a5-dbebd8291805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:40.152413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde0ab4-a3ba-484a-a7a5-dbebd8291805 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:05:40.158348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3338dcc-186a-448e-9f81-e90f2e0dc160 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:05:40.158989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3338dcc-186a-448e-9f81-e90f2e0dc160 service placement] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:05:40.159265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3338dcc-186a-448e-9f81-e90f2e0dc160 service placement] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:05:40.159567 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3338dcc-186a-448e-9f81-e90f2e0dc160 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:05:40.161809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c3338dcc-186a-448e-9f81-e90f2e0dc160 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:40.175248 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3338dcc-186a-448e-9f81-e90f2e0dc160 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:05:40.177073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3338dcc-186a-448e-9f81-e90f2e0dc160 service placement] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:05:40.188021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1230/2477] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:05:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:05:50.182956 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=32 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:52.255832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715454c-7aa4-4fb4-abc3-e282943d8c93 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:05:52.256312 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715454c-7aa4-4fb4-abc3-e282943d8c93 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:05:52.256536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715454c-7aa4-4fb4-abc3-e282943d8c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:05:52.274319 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-5715454c-7aa4-4fb4-abc3-e282943d8c93 None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:05:52.275539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-5715454c-7aa4-4fb4-abc3-e282943d8c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:52.283360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1248/2478] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 14:05:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:05:52.294831 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3338dcc-186a-448e-9f81-e90f2e0dc160 service placement] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:05:52.306493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3338dcc-186a-448e-9f81-e90f2e0dc160 service placement] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:05:52.311435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91eca7-3143-46f4-b1d1-71c20bf80ba7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:05:52.312125 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91eca7-3143-46f4-b1d1-71c20bf80ba7 service swift] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:05:52.312406 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91eca7-3143-46f4-b1d1-71c20bf80ba7 service swift] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:05:52.312687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91eca7-3143-46f4-b1d1-71c20bf80ba7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:05:52.320590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91eca7-3143-46f4-b1d1-71c20bf80ba7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:05:52.322155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91eca7-3143-46f4-b1d1-71c20bf80ba7 service swift] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:05:52.330616 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1231/2479] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 14:05:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:06:02.268819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:02.326874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=6 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:13.572920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe9a82-851d-4f75-91f4-0a2533792c34 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:13.573393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe9a82-851d-4f75-91f4-0a2533792c34 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:13.573517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe9a82-851d-4f75-91f4-0a2533792c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:13.596744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-aabe9a82-851d-4f75-91f4-0a2533792c34 None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:06:13.596744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-aabe9a82-851d-4f75-91f4-0a2533792c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:13.600850 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1249/2480] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 2 14:06:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:06:13.613662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91eca7-3143-46f4-b1d1-71c20bf80ba7 service swift] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:13.624595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91eca7-3143-46f4-b1d1-71c20bf80ba7 service swift] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:13.630256 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5548b-964c-4ef4-a4de-71f0a0eaff27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:13.630913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5548b-964c-4ef4-a4de-71f0a0eaff27 service swift] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:13.631425 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5548b-964c-4ef4-a4de-71f0a0eaff27 service swift] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:13.631734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5548b-964c-4ef4-a4de-71f0a0eaff27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:13.641326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5548b-964c-4ef4-a4de-71f0a0eaff27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:13.642980 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5548b-964c-4ef4-a4de-71f0a0eaff27 service swift] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:13.651825 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1232/2481] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 14:06:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:06:14.060986 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f416a-95f0-4ca3-86cc-b9817100ea86 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:14.061278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f416a-95f0-4ca3-86cc-b9817100ea86 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:14.061559 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f416a-95f0-4ca3-86cc-b9817100ea86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:14.081504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-a93f416a-95f0-4ca3-86cc-b9817100ea86 None None] MFA Rules not processed for user `1f544b708f8f437dbc40def8b06de9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:06:14.082826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a93f416a-95f0-4ca3-86cc-b9817100ea86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:14.090011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1250/2482] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:06:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:06:23.648518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=6 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:24.075234 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=6 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:43.632232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5548b-964c-4ef4-a4de-71f0a0eaff27 service swift] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:43.641453 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5548b-964c-4ef4-a4de-71f0a0eaff27 service swift] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:43.644955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53be6a-742b-42b8-ab2c-e4315df6466d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:43.645581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53be6a-742b-42b8-ab2c-e4315df6466d service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:43.645862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53be6a-742b-42b8-ab2c-e4315df6466d service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:43.646135 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53be6a-742b-42b8-ab2c-e4315df6466d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:43.648460 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-2e53be6a-742b-42b8-ab2c-e4315df6466d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:43.661287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53be6a-742b-42b8-ab2c-e4315df6466d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:43.662741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53be6a-742b-42b8-ab2c-e4315df6466d service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:43.673368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1233/2483] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:06:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:06:44.843722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f416a-95f0-4ca3-86cc-b9817100ea86 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:44.853689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f416a-95f0-4ca3-86cc-b9817100ea86 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:44.857210 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852fd6e-247a-43b0-9fbe-60d32e8865ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:44.857855 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852fd6e-247a-43b0-9fbe-60d32e8865ad service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:44.858135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852fd6e-247a-43b0-9fbe-60d32e8865ad service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:44.858666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852fd6e-247a-43b0-9fbe-60d32e8865ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:44.860409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b852fd6e-247a-43b0-9fbe-60d32e8865ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:44.873117 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852fd6e-247a-43b0-9fbe-60d32e8865ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:44.874521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852fd6e-247a-43b0-9fbe-60d32e8865ad service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:44.884984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1251/2484] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:06:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:06:53.356958 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53be6a-742b-42b8-ab2c-e4315df6466d service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:53.365710 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53be6a-742b-42b8-ab2c-e4315df6466d service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:53.369349 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18af29-a97d-4b03-9a67-260141b4f81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:53.369987 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18af29-a97d-4b03-9a67-260141b4f81f service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:53.370274 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18af29-a97d-4b03-9a67-260141b4f81f service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:53.370555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18af29-a97d-4b03-9a67-260141b4f81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:53.372405 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0f18af29-a97d-4b03-9a67-260141b4f81f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:53.385249 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18af29-a97d-4b03-9a67-260141b4f81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:53.386653 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18af29-a97d-4b03-9a67-260141b4f81f service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:53.395981 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1234/2485] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:06:54.880449 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=6 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:56.908394 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852fd6e-247a-43b0-9fbe-60d32e8865ad service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:56.909851 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b852fd6e-247a-43b0-9fbe-60d32e8865ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:56.925031 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852fd6e-247a-43b0-9fbe-60d32e8865ad service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:56.930567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f090f-89a6-445f-854b-77580547d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:56.936186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f090f-89a6-445f-854b-77580547d191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:56.936186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f090f-89a6-445f-854b-77580547d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:56.936186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f090f-89a6-445f-854b-77580547d191 admin admin] PATH_INFO: `/v3/users/0a019fdb84494ec294c16dbc936e7d99` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:56.936186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f090f-89a6-445f-854b-77580547d191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a019fdb84494ec294c16dbc936e7d99)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:56.936186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f090f-89a6-445f-854b-77580547d191 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:57.128255 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8d7f090f-89a6-445f-854b-77580547d191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a019fdb84494ec294c16dbc936e7d99'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:57.222980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8d7f090f-89a6-445f-854b-77580547d191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a019fdb84494ec294c16dbc936e7d99'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:57.236218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8d7f090f-89a6-445f-854b-77580547d191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a019fdb84494ec294c16dbc936e7d99'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:57.237966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8d7f090f-89a6-445f-854b-77580547d191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a019fdb84494ec294c16dbc936e7d99'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:57.244196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8d7f090f-89a6-445f-854b-77580547d191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a019fdb84494ec294c16dbc936e7d99'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:57.250047 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1252/2486] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:06:56 2022] DELETE /identity/v3/users/0a019fdb84494ec294c16dbc936e7d99 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:06:57.552882 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18af29-a97d-4b03-9a67-260141b4f81f service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:57.563024 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18af29-a97d-4b03-9a67-260141b4f81f service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:57.621327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:57.622239 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:57.622527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:57.622806 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193 admin admin] PATH_INFO: `/v3/projects/a2fef7c72fff4c1cbca16f9b19121278` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:57.624047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fef7c72fff4c1cbca16f9b19121278)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:57.625966 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:57.783154 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fef7c72fff4c1cbca16f9b19121278', 'request_id': 'req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:57.897331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fef7c72fff4c1cbca16f9b19121278', 'request_id': 'req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:57.904348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fef7c72fff4c1cbca16f9b19121278', 'request_id': 'req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:57.914708 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193 admin admin] The token cache is being invalidate because project a2fef7c72fff4c1cbca16f9b19121278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:06:57.915034 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:57.915697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-e1557fc1-9ce8-4d2f-bb2e-51e9435ec193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:57.917270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1235/2487] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:06:57 2022] DELETE /identity/v3/projects/a2fef7c72fff4c1cbca16f9b19121278 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:06:57.922307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fd47e-0272-46c0-8767-dc1deea36c15 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:57.922778 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fd47e-0272-46c0-8767-dc1deea36c15 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:57.922881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fd47e-0272-46c0-8767-dc1deea36c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:57.940658 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-3d2fd47e-0272-46c0-8767-dc1deea36c15 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:06:57.950004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-3d2fd47e-0272-46c0-8767-dc1deea36c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:58.002305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1253/2488] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:06:58.010834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeccd6a-f1cf-4932-98ef-cb45d1cb2392 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:58.011127 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeccd6a-f1cf-4932-98ef-cb45d1cb2392 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:58.011412 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeccd6a-f1cf-4932-98ef-cb45d1cb2392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:58.030131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-6eeccd6a-f1cf-4932-98ef-cb45d1cb2392 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:06:58.031336 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6eeccd6a-f1cf-4932-98ef-cb45d1cb2392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:58.039192 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1236/2489] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:06:58.043335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fd47e-0272-46c0-8767-dc1deea36c15 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:58.052831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fd47e-0272-46c0-8767-dc1deea36c15 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:58.057288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c7ff3-fe59-48f1-b2fc-f1f2ba842f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:58.057954 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c7ff3-fe59-48f1-b2fc-f1f2ba842f74 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:58.058237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c7ff3-fe59-48f1-b2fc-f1f2ba842f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:58.058511 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c7ff3-fe59-48f1-b2fc-f1f2ba842f74 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:58.059232 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c7ff3-fe59-48f1-b2fc-f1f2ba842f74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:06:58.059560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c7ff3-fe59-48f1-b2fc-f1f2ba842f74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:58.061148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c7ff3-fe59-48f1-b2fc-f1f2ba842f74 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:58.072894 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1254/2490] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:06:58.077010 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeccd6a-f1cf-4932-98ef-cb45d1cb2392 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:58.086303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeccd6a-f1cf-4932-98ef-cb45d1cb2392 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:58.091497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641efec-5069-4eff-b63d-59aa782ba8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:58.092145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641efec-5069-4eff-b63d-59aa782ba8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:58.092439 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641efec-5069-4eff-b63d-59aa782ba8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:58.092713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641efec-5069-4eff-b63d-59aa782ba8e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:58.093537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641efec-5069-4eff-b63d-59aa782ba8e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:58.095542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641efec-5069-4eff-b63d-59aa782ba8e5 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:58.175657 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1237/2491] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:06:58 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:06:58.179736 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c7ff3-fe59-48f1-b2fc-f1f2ba842f74 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:58.190481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c7ff3-fe59-48f1-b2fc-f1f2ba842f74 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:58.245253 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161d913-609d-4029-a93c-fda3d22ec72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:58.245903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161d913-609d-4029-a93c-fda3d22ec72d admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:58.246183 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161d913-609d-4029-a93c-fda3d22ec72d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:58.246454 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161d913-609d-4029-a93c-fda3d22ec72d admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:58.247132 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161d913-609d-4029-a93c-fda3d22ec72d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:58.249191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161d913-609d-4029-a93c-fda3d22ec72d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:58.255697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:58.354882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1255/2492] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:06:58 2022] POST /identity/v3/users => generated 303 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:06:58.359399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641efec-5069-4eff-b63d-59aa782ba8e5 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:58.370081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641efec-5069-4eff-b63d-59aa782ba8e5 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:58.374751 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21675f97-caf4-4207-89af-772150f80513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:58.375410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21675f97-caf4-4207-89af-772150f80513 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:58.375766 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21675f97-caf4-4207-89af-772150f80513 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:58.376045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21675f97-caf4-4207-89af-772150f80513 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:58.376817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21675f97-caf4-4207-89af-772150f80513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:58.378411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21675f97-caf4-4207-89af-772150f80513 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:58.389257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1238/2493] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:06:58.393202 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161d913-609d-4029-a93c-fda3d22ec72d admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:58.403029 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161d913-609d-4029-a93c-fda3d22ec72d admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:58.407719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa252d-7d03-42a6-be8c-310499031542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:58.408373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa252d-7d03-42a6-be8c-310499031542 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:58.408657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa252d-7d03-42a6-be8c-310499031542 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:58.408933 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa252d-7d03-42a6-be8c-310499031542 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:58.409667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa252d-7d03-42a6-be8c-310499031542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:58.411257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa252d-7d03-42a6-be8c-310499031542 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:58.421676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1256/2494] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:06:58.427215 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21675f97-caf4-4207-89af-772150f80513 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:58.436450 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21675f97-caf4-4207-89af-772150f80513 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:58.441084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385b02c-ef01-45dd-8045-1539c18905c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:58.441958 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385b02c-ef01-45dd-8045-1539c18905c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:58.442240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385b02c-ef01-45dd-8045-1539c18905c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:58.442517 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385b02c-ef01-45dd-8045-1539c18905c6 admin admin] PATH_INFO: `/v3/projects/549492468b344fa4b8946e65072feddc/users/71809e1fde274e9e84ae6c05e37c5683/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:58.457380 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385b02c-ef01-45dd-8045-1539c18905c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549492468b344fa4b8946e65072feddc, user_id=71809e1fde274e9e84ae6c05e37c5683, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:58.460082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385b02c-ef01-45dd-8045-1539c18905c6 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:58.567703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:58.572476 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1239/2495] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:06:58 2022] PUT /identity/v3/projects/549492468b344fa4b8946e65072feddc/users/71809e1fde274e9e84ae6c05e37c5683/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:06:58.581003 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff6472-377f-42fd-a1d7-4790e07fe398 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:58.581324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff6472-377f-42fd-a1d7-4790e07fe398 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:58.581602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff6472-377f-42fd-a1d7-4790e07fe398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:58.598410 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-beff6472-377f-42fd-a1d7-4790e07fe398 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:06:58.599632 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-beff6472-377f-42fd-a1d7-4790e07fe398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:58.660336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1257/2496] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:06:58.670839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385b02c-ef01-45dd-8045-1539c18905c6 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:58.672643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1385b02c-ef01-45dd-8045-1539c18905c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:58.729118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385b02c-ef01-45dd-8045-1539c18905c6 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:58.732616 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49601b7-fb1b-4c38-b292-9472b6ec9e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:58.733503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49601b7-fb1b-4c38-b292-9472b6ec9e8c service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:58.733811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49601b7-fb1b-4c38-b292-9472b6ec9e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:58.734087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49601b7-fb1b-4c38-b292-9472b6ec9e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:58.742839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49601b7-fb1b-4c38-b292-9472b6ec9e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:58.744281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49601b7-fb1b-4c38-b292-9472b6ec9e8c service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:58.753401 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1240/2497] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:00.127166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3826fe-3efc-4445-b451-dfd548234e0a None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:00.127747 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3826fe-3efc-4445-b451-dfd548234e0a None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:00.127974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3826fe-3efc-4445-b451-dfd548234e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:00.155317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-de3826fe-3efc-4445-b451-dfd548234e0a None None] MFA Rules not processed for user `71809e1fde274e9e84ae6c05e37c5683`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:00.156622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-de3826fe-3efc-4445-b451-dfd548234e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:00.223406 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1258/2498] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:00.228192 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49601b7-fb1b-4c38-b292-9472b6ec9e8c service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:00.238038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49601b7-fb1b-4c38-b292-9472b6ec9e8c service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:00.244607 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a6165-6032-4b90-8c89-d772f066d12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:00.245306 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a6165-6032-4b90-8c89-d772f066d12d admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:00.245600 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a6165-6032-4b90-8c89-d772f066d12d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:00.245882 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a6165-6032-4b90-8c89-d772f066d12d admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:00.246596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a6165-6032-4b90-8c89-d772f066d12d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:00.248588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a6165-6032-4b90-8c89-d772f066d12d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:00.350282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1241/2499] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:00 2022] POST /identity/v3/projects => generated 405 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:00.354845 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3826fe-3efc-4445-b451-dfd548234e0a None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:00.366071 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3826fe-3efc-4445-b451-dfd548234e0a None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:00.420828 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fb064-890e-4446-9fd1-816ba5187b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:00.421487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fb064-890e-4446-9fd1-816ba5187b4b admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:00.421771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fb064-890e-4446-9fd1-816ba5187b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:00.422042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fb064-890e-4446-9fd1-816ba5187b4b admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:00.422724 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fb064-890e-4446-9fd1-816ba5187b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:00.424655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fb064-890e-4446-9fd1-816ba5187b4b admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:00.497666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:00.503518 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1259/2500] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:00 2022] POST /identity/v3/users => generated 309 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:00.507440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a6165-6032-4b90-8c89-d772f066d12d admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:00.517890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a6165-6032-4b90-8c89-d772f066d12d admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:00.522441 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f958d-94c2-48b2-9ca8-407e03a9dc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:00.523095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f958d-94c2-48b2-9ca8-407e03a9dc08 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:00.523378 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f958d-94c2-48b2-9ca8-407e03a9dc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:00.524217 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f958d-94c2-48b2-9ca8-407e03a9dc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:00.524935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f958d-94c2-48b2-9ca8-407e03a9dc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:00.526528 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f958d-94c2-48b2-9ca8-407e03a9dc08 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:00.537009 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1242/2501] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:00.541676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fb064-890e-4446-9fd1-816ba5187b4b admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:00.551687 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fb064-890e-4446-9fd1-816ba5187b4b admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:00.556263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be1e40-f8fc-46c7-bf25-9b1e41d34c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:00.557135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be1e40-f8fc-46c7-bf25-9b1e41d34c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:00.557411 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be1e40-f8fc-46c7-bf25-9b1e41d34c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:00.557681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be1e40-f8fc-46c7-bf25-9b1e41d34c84 admin admin] PATH_INFO: `/v3/projects/bb2b312b5ed44940ba9288baa209fc29/users/f6af384415c844e78e82a360e3266bd2/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:00.572329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be1e40-f8fc-46c7-bf25-9b1e41d34c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2b312b5ed44940ba9288baa209fc29, user_id=f6af384415c844e78e82a360e3266bd2, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:00.575148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be1e40-f8fc-46c7-bf25-9b1e41d34c84 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:00.688407 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1260/2502] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:00 2022] PUT /identity/v3/projects/bb2b312b5ed44940ba9288baa209fc29/users/f6af384415c844e78e82a360e3266bd2/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:00.692274 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f958d-94c2-48b2-9ca8-407e03a9dc08 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:00.702561 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f958d-94c2-48b2-9ca8-407e03a9dc08 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:00.758883 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cdcfc-c406-4cc5-aac9-f7ce68fa4fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:00.759482 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cdcfc-c406-4cc5-aac9-f7ce68fa4fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:00.759767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cdcfc-c406-4cc5-aac9-f7ce68fa4fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:00.760046 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cdcfc-c406-4cc5-aac9-f7ce68fa4fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:00.760765 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cdcfc-c406-4cc5-aac9-f7ce68fa4fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:00.762358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cdcfc-c406-4cc5-aac9-f7ce68fa4fc7 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:00.772012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1243/2503] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:00.776671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be1e40-f8fc-46c7-bf25-9b1e41d34c84 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:00.786729 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be1e40-f8fc-46c7-bf25-9b1e41d34c84 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:00.791692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcce1c6-2413-42a9-81a4-801f62a737fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:00.792563 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcce1c6-2413-42a9-81a4-801f62a737fa admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:00.792846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcce1c6-2413-42a9-81a4-801f62a737fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:00.793121 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcce1c6-2413-42a9-81a4-801f62a737fa admin admin] PATH_INFO: `/v3/projects/bb2b312b5ed44940ba9288baa209fc29/users/f6af384415c844e78e82a360e3266bd2/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:00.795062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcce1c6-2413-42a9-81a4-801f62a737fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2b312b5ed44940ba9288baa209fc29, user_id=f6af384415c844e78e82a360e3266bd2, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:00.797754 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcce1c6-2413-42a9-81a4-801f62a737fa admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:00.807777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1261/2504] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:00 2022] PUT /identity/v3/projects/bb2b312b5ed44940ba9288baa209fc29/users/f6af384415c844e78e82a360e3266bd2/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:02.187731 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7391fdb-2314-4afd-8013-ac56a79c3907 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:02.188852 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7391fdb-2314-4afd-8013-ac56a79c3907 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:02.189133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7391fdb-2314-4afd-8013-ac56a79c3907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:02.215818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-b7391fdb-2314-4afd-8013-ac56a79c3907 None None] MFA Rules not processed for user `f6af384415c844e78e82a360e3266bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:02.217036 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-b7391fdb-2314-4afd-8013-ac56a79c3907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:02.270162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:02.288838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1244/2505] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:02 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:07:03.482755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcce1c6-2413-42a9-81a4-801f62a737fa admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:03.484748 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-bbcce1c6-2413-42a9-81a4-801f62a737fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:03.561032 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcce1c6-2413-42a9-81a4-801f62a737fa admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:03.566066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d49c6-52c7-41c5-af57-45d67ea76c57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:03.566718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d49c6-52c7-41c5-af57-45d67ea76c57 service placement] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:03.567037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d49c6-52c7-41c5-af57-45d67ea76c57 service placement] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:03.567331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d49c6-52c7-41c5-af57-45d67ea76c57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:03.569120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-061d49c6-52c7-41c5-af57-45d67ea76c57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:03.580877 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d49c6-52c7-41c5-af57-45d67ea76c57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:03.582475 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d49c6-52c7-41c5-af57-45d67ea76c57 service placement] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:03.592189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1262/2506] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:03.623917 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7391fdb-2314-4afd-8013-ac56a79c3907 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:03.683651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7391fdb-2314-4afd-8013-ac56a79c3907 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:03.688237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d0adb-cbd8-4eca-95a4-252f27a80eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:03.689102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d0adb-cbd8-4eca-95a4-252f27a80eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:03.689384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d0adb-cbd8-4eca-95a4-252f27a80eae admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:03.689661 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d0adb-cbd8-4eca-95a4-252f27a80eae admin admin] PATH_INFO: `/v3/users/71809e1fde274e9e84ae6c05e37c5683` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:03.690849 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d0adb-cbd8-4eca-95a4-252f27a80eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=71809e1fde274e9e84ae6c05e37c5683)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:03.692801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d0adb-cbd8-4eca-95a4-252f27a80eae admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:03.947711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-582d0adb-cbd8-4eca-95a4-252f27a80eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71809e1fde274e9e84ae6c05e37c5683'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:03.959592 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-582d0adb-cbd8-4eca-95a4-252f27a80eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71809e1fde274e9e84ae6c05e37c5683'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:03.966326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-582d0adb-cbd8-4eca-95a4-252f27a80eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71809e1fde274e9e84ae6c05e37c5683'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:03.967043 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-582d0adb-cbd8-4eca-95a4-252f27a80eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71809e1fde274e9e84ae6c05e37c5683'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.059765 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-582d0adb-cbd8-4eca-95a4-252f27a80eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71809e1fde274e9e84ae6c05e37c5683'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.065917 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1245/2507] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:03 2022] DELETE /identity/v3/users/71809e1fde274e9e84ae6c05e37c5683 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:04.312171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d49c6-52c7-41c5-af57-45d67ea76c57 service placement] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:04.321144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d49c6-52c7-41c5-af57-45d67ea76c57 service placement] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:04.383741 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:04.384595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:04.384876 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:04.385150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] PATH_INFO: `/v3/projects/549492468b344fa4b8946e65072feddc` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:04.386329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] RBAC: Authorizing `identity:delete_project(project_id=549492468b344fa4b8946e65072feddc)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:04.388283 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:04.513734 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '549492468b344fa4b8946e65072feddc', 'request_id': 'req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.516157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:04.585965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '549492468b344fa4b8946e65072feddc', 'request_id': 'req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.592662 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '549492468b344fa4b8946e65072feddc', 'request_id': 'req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.604307 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] The token cache is being invalidate because project 549492468b344fa4b8946e65072feddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:07:04.604704 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.605381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.606906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1263/2508] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:07:04 2022] DELETE /identity/v3/projects/549492468b344fa4b8946e65072feddc => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:04.611145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d0adb-cbd8-4eca-95a4-252f27a80eae admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:04.612657 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-582d0adb-cbd8-4eca-95a4-252f27a80eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:04.626638 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d0adb-cbd8-4eca-95a4-252f27a80eae admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:04.684035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b9bc5-3f87-4353-88bc-fe5c826922ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:04.684906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b9bc5-3f87-4353-88bc-fe5c826922ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:04.685190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b9bc5-3f87-4353-88bc-fe5c826922ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:04.685467 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b9bc5-3f87-4353-88bc-fe5c826922ad admin admin] PATH_INFO: `/v3/users/f6af384415c844e78e82a360e3266bd2` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:04.686643 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b9bc5-3f87-4353-88bc-fe5c826922ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6af384415c844e78e82a360e3266bd2)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:04.688610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b9bc5-3f87-4353-88bc-fe5c826922ad admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:04.701707 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:04.887047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4b8b9bc5-3f87-4353-88bc-fe5c826922ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6af384415c844e78e82a360e3266bd2'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.899767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4b8b9bc5-3f87-4353-88bc-fe5c826922ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6af384415c844e78e82a360e3266bd2'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.906495 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4b8b9bc5-3f87-4353-88bc-fe5c826922ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6af384415c844e78e82a360e3266bd2'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.907176 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4b8b9bc5-3f87-4353-88bc-fe5c826922ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6af384415c844e78e82a360e3266bd2'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.994179 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-4b8b9bc5-3f87-4353-88bc-fe5c826922ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6af384415c844e78e82a360e3266bd2'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.000349 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1246/2509] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:04 2022] DELETE /identity/v3/users/f6af384415c844e78e82a360e3266bd2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:05.230008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:05.231570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:05.246145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c82c5-ec54-46bb-8bfe-385c1c0ba66d admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:05.307595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6590806-f2be-4451-b0e8-420215d665a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:05.308458 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6590806-f2be-4451-b0e8-420215d665a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:05.308738 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6590806-f2be-4451-b0e8-420215d665a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:05.309037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6590806-f2be-4451-b0e8-420215d665a8 admin admin] PATH_INFO: `/v3/projects/bb2b312b5ed44940ba9288baa209fc29` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:05.310245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6590806-f2be-4451-b0e8-420215d665a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2b312b5ed44940ba9288baa209fc29)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:05.312236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6590806-f2be-4451-b0e8-420215d665a8 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:05.441919 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f6590806-f2be-4451-b0e8-420215d665a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2b312b5ed44940ba9288baa209fc29', 'request_id': 'req-f6590806-f2be-4451-b0e8-420215d665a8'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.588593 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f6590806-f2be-4451-b0e8-420215d665a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2b312b5ed44940ba9288baa209fc29', 'request_id': 'req-f6590806-f2be-4451-b0e8-420215d665a8'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.595349 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f6590806-f2be-4451-b0e8-420215d665a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2b312b5ed44940ba9288baa209fc29', 'request_id': 'req-f6590806-f2be-4451-b0e8-420215d665a8'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.606413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f6590806-f2be-4451-b0e8-420215d665a8 admin admin] The token cache is being invalidate because project bb2b312b5ed44940ba9288baa209fc29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:07:05.606697 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f6590806-f2be-4451-b0e8-420215d665a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.607404 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f6590806-f2be-4451-b0e8-420215d665a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.609269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1264/2510] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:07:05 2022] DELETE /identity/v3/projects/bb2b312b5ed44940ba9288baa209fc29 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:05.614302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2f0c4-208f-4674-9d3f-40f00e253ca3 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:05.614595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2f0c4-208f-4674-9d3f-40f00e253ca3 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:05.614874 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2f0c4-208f-4674-9d3f-40f00e253ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:05.632492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-b3a2f0c4-208f-4674-9d3f-40f00e253ca3 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:05.633677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-b3a2f0c4-208f-4674-9d3f-40f00e253ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:05.692134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1247/2511] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:07:05.699850 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b4ef3-3551-4e61-b9d5-985c0bc37763 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:05.700170 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b4ef3-3551-4e61-b9d5-985c0bc37763 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:05.700451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b4ef3-3551-4e61-b9d5-985c0bc37763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:05.718807 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-a92b4ef3-3551-4e61-b9d5-985c0bc37763 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:05.724264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a92b4ef3-3551-4e61-b9d5-985c0bc37763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:05.728551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1265/2512] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:05.732613 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2f0c4-208f-4674-9d3f-40f00e253ca3 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:05.742362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2f0c4-208f-4674-9d3f-40f00e253ca3 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:05.746863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c779254-6d50-482f-ac7e-ad30b15d5554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:05.747547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c779254-6d50-482f-ac7e-ad30b15d5554 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:05.747832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c779254-6d50-482f-ac7e-ad30b15d5554 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:05.748114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c779254-6d50-482f-ac7e-ad30b15d5554 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:05.748831 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c779254-6d50-482f-ac7e-ad30b15d5554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:07:05.749133 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c779254-6d50-482f-ac7e-ad30b15d5554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:05.750723 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c779254-6d50-482f-ac7e-ad30b15d5554 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:05.762122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1248/2513] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:07:05.766212 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b4ef3-3551-4e61-b9d5-985c0bc37763 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:05.775987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b4ef3-3551-4e61-b9d5-985c0bc37763 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:05.780689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf1a5b-d97c-4ac7-92fd-64100af8592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:05.781339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf1a5b-d97c-4ac7-92fd-64100af8592e admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:05.781622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf1a5b-d97c-4ac7-92fd-64100af8592e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:05.781900 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf1a5b-d97c-4ac7-92fd-64100af8592e admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:05.782593 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf1a5b-d97c-4ac7-92fd-64100af8592e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:05.784544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf1a5b-d97c-4ac7-92fd-64100af8592e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:05.899507 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1266/2514] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:05 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:05.900669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c779254-6d50-482f-ac7e-ad30b15d5554 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:05.910687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c779254-6d50-482f-ac7e-ad30b15d5554 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:05.967967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20398145-7f5b-4581-8046-8a257d927120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:05.968556 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20398145-7f5b-4581-8046-8a257d927120 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:05.968839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20398145-7f5b-4581-8046-8a257d927120 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:05.969115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20398145-7f5b-4581-8046-8a257d927120 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:05.969801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20398145-7f5b-4581-8046-8a257d927120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:05.972114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20398145-7f5b-4581-8046-8a257d927120 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:06.064302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1249/2515] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:05 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:06.068373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf1a5b-d97c-4ac7-92fd-64100af8592e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.079021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf1a5b-d97c-4ac7-92fd-64100af8592e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:06.083638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ed340-3317-4e78-95bc-fbfb73b77b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:06.084289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ed340-3317-4e78-95bc-fbfb73b77b14 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.084580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ed340-3317-4e78-95bc-fbfb73b77b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.084861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ed340-3317-4e78-95bc-fbfb73b77b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.085601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ed340-3317-4e78-95bc-fbfb73b77b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:06.087893 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ed340-3317-4e78-95bc-fbfb73b77b14 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:06.098063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1267/2516] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:06.101911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20398145-7f5b-4581-8046-8a257d927120 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.111967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20398145-7f5b-4581-8046-8a257d927120 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:06.116580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb283d6-148c-4bb6-882d-008958d84942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:06.117239 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb283d6-148c-4bb6-882d-008958d84942 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.117529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb283d6-148c-4bb6-882d-008958d84942 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.117807 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb283d6-148c-4bb6-882d-008958d84942 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.118560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb283d6-148c-4bb6-882d-008958d84942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:06.120184 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb283d6-148c-4bb6-882d-008958d84942 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:06.121419 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:06.131024 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1250/2517] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:06.135380 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ed340-3317-4e78-95bc-fbfb73b77b14 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.145746 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ed340-3317-4e78-95bc-fbfb73b77b14 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:06.150955 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b15fa-8942-4975-9520-41bddb2c31ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:06.151933 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b15fa-8942-4975-9520-41bddb2c31ef admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.157438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b15fa-8942-4975-9520-41bddb2c31ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.157438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b15fa-8942-4975-9520-41bddb2c31ef admin admin] PATH_INFO: `/v3/projects/70c38c34134a46cfa5d92ef05a66b9c0/users/16680c7fe5c24acf86db6f70286a2b6e/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.166517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b15fa-8942-4975-9520-41bddb2c31ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c38c34134a46cfa5d92ef05a66b9c0, user_id=16680c7fe5c24acf86db6f70286a2b6e, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:06.169201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b15fa-8942-4975-9520-41bddb2c31ef admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:06.281039 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1268/2518] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:06 2022] PUT /identity/v3/projects/70c38c34134a46cfa5d92ef05a66b9c0/users/16680c7fe5c24acf86db6f70286a2b6e/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:06.291228 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baf9d8-338f-4d05-9b41-e9a2667df4bd None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.291560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baf9d8-338f-4d05-9b41-e9a2667df4bd None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.291847 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baf9d8-338f-4d05-9b41-e9a2667df4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.317358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-19baf9d8-338f-4d05-9b41-e9a2667df4bd None None] MFA Rules not processed for user `16680c7fe5c24acf86db6f70286a2b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:06.318565 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-19baf9d8-338f-4d05-9b41-e9a2667df4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:06.382110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1251/2519] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:06.387141 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b15fa-8942-4975-9520-41bddb2c31ef admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.395997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:06.448108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b15fa-8942-4975-9520-41bddb2c31ef admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:06.453004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521b377-990e-4ee8-a183-4f350aae9097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:06.460004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521b377-990e-4ee8-a183-4f350aae9097 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.460004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521b377-990e-4ee8-a183-4f350aae9097 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.460004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521b377-990e-4ee8-a183-4f350aae9097 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.460004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521b377-990e-4ee8-a183-4f350aae9097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:06.460004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521b377-990e-4ee8-a183-4f350aae9097 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:06.624425 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1269/2520] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:06 2022] POST /identity/v3/projects => generated 371 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:07:06.628487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baf9d8-338f-4d05-9b41-e9a2667df4bd None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.639881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baf9d8-338f-4d05-9b41-e9a2667df4bd None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:06.696456 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08302663-5f66-4098-b6cc-d443306b94f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:06.697124 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302663-5f66-4098-b6cc-d443306b94f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.697410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302663-5f66-4098-b6cc-d443306b94f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.697722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302663-5f66-4098-b6cc-d443306b94f6 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.698413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08302663-5f66-4098-b6cc-d443306b94f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:06.700368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08302663-5f66-4098-b6cc-d443306b94f6 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:06.822392 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1252/2521] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:06 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:06.826403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521b377-990e-4ee8-a183-4f350aae9097 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.836488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521b377-990e-4ee8-a183-4f350aae9097 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:06.840987 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b4b77-bac2-4188-9c5b-1e08c5b1e428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:06.841631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b4b77-bac2-4188-9c5b-1e08c5b1e428 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.841910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b4b77-bac2-4188-9c5b-1e08c5b1e428 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.842184 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b4b77-bac2-4188-9c5b-1e08c5b1e428 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.842897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b4b77-bac2-4188-9c5b-1e08c5b1e428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:06.844523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b4b77-bac2-4188-9c5b-1e08c5b1e428 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:06.855353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1270/2522] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:06.860113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08302663-5f66-4098-b6cc-d443306b94f6 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.870753 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08302663-5f66-4098-b6cc-d443306b94f6 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:06.875651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1648f-72ec-4c2e-8d6b-d23f5855ec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:06.876583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1648f-72ec-4c2e-8d6b-d23f5855ec02 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.876870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1648f-72ec-4c2e-8d6b-d23f5855ec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.877173 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1648f-72ec-4c2e-8d6b-d23f5855ec02 admin admin] PATH_INFO: `/v3/projects/6d262ed3ef7f4b1585dc50c03c9085fb/users/ab400b7fc72a495082e39f0542913703/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.891749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1648f-72ec-4c2e-8d6b-d23f5855ec02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d262ed3ef7f4b1585dc50c03c9085fb, user_id=ab400b7fc72a495082e39f0542913703, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:06.894401 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1648f-72ec-4c2e-8d6b-d23f5855ec02 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:06.968624 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1253/2523] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:06 2022] PUT /identity/v3/projects/6d262ed3ef7f4b1585dc50c03c9085fb/users/ab400b7fc72a495082e39f0542913703/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:07:06.972431 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b4b77-bac2-4188-9c5b-1e08c5b1e428 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.983159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b4b77-bac2-4188-9c5b-1e08c5b1e428 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:07.037771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d9d15-0882-4469-9799-c1b2e35f8fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:07.038429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d9d15-0882-4469-9799-c1b2e35f8fff admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:07.038711 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d9d15-0882-4469-9799-c1b2e35f8fff admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:07.038988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d9d15-0882-4469-9799-c1b2e35f8fff admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:07.040261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d9d15-0882-4469-9799-c1b2e35f8fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:07.041930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d9d15-0882-4469-9799-c1b2e35f8fff admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:07.051506 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1271/2524] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:07.056223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1648f-72ec-4c2e-8d6b-d23f5855ec02 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:07.066226 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1648f-72ec-4c2e-8d6b-d23f5855ec02 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:07.070774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c04a2-bcc6-49c9-a52f-2fc5a96689c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:07.071745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c04a2-bcc6-49c9-a52f-2fc5a96689c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:07.072024 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c04a2-bcc6-49c9-a52f-2fc5a96689c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:07.072291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c04a2-bcc6-49c9-a52f-2fc5a96689c9 admin admin] PATH_INFO: `/v3/projects/6d262ed3ef7f4b1585dc50c03c9085fb/users/ab400b7fc72a495082e39f0542913703/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:07.074246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c04a2-bcc6-49c9-a52f-2fc5a96689c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d262ed3ef7f4b1585dc50c03c9085fb, user_id=ab400b7fc72a495082e39f0542913703, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:07.076903 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c04a2-bcc6-49c9-a52f-2fc5a96689c9 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:07.087329 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1254/2525] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:07 2022] PUT /identity/v3/projects/6d262ed3ef7f4b1585dc50c03c9085fb/users/ab400b7fc72a495082e39f0542913703/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:07.098397 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bb4e6-0e09-42ab-be22-7fd4dcea99dd None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:07.098722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bb4e6-0e09-42ab-be22-7fd4dcea99dd None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:07.099004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bb4e6-0e09-42ab-be22-7fd4dcea99dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:07.125299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-820bb4e6-0e09-42ab-be22-7fd4dcea99dd None None] MFA Rules not processed for user `ab400b7fc72a495082e39f0542913703`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:07.126542 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-820bb4e6-0e09-42ab-be22-7fd4dcea99dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:07.191403 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1272/2526] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:07.202466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c04a2-bcc6-49c9-a52f-2fc5a96689c9 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:07.204253 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-534c04a2-bcc6-49c9-a52f-2fc5a96689c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:07.246541 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:07.266696 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c04a2-bcc6-49c9-a52f-2fc5a96689c9 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:07.270505 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac02ba9-9865-401f-9cd3-c8dd71392fce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:07.271163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac02ba9-9865-401f-9cd3-c8dd71392fce service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:07.271476 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac02ba9-9865-401f-9cd3-c8dd71392fce service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:07.271757 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac02ba9-9865-401f-9cd3-c8dd71392fce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:07.282060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac02ba9-9865-401f-9cd3-c8dd71392fce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:07.283610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac02ba9-9865-401f-9cd3-c8dd71392fce service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:07.293803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1255/2527] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:07.491900 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bb4e6-0e09-42ab-be22-7fd4dcea99dd None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:07.496888 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:07.502311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bb4e6-0e09-42ab-be22-7fd4dcea99dd None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:07.505830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abd914-ff7f-4199-afdd-07aedd53de1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:07.506464 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abd914-ff7f-4199-afdd-07aedd53de1a service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:07.506745 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abd914-ff7f-4199-afdd-07aedd53de1a service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:07.507047 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abd914-ff7f-4199-afdd-07aedd53de1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:07.563766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abd914-ff7f-4199-afdd-07aedd53de1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:07.565190 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abd914-ff7f-4199-afdd-07aedd53de1a service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:07.575217 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1273/2528] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:17.305433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=9 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:17.572136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=27 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:26.113846 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac02ba9-9865-401f-9cd3-c8dd71392fce service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:26.115797 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-cac02ba9-9865-401f-9cd3-c8dd71392fce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:26.220502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac02ba9-9865-401f-9cd3-c8dd71392fce service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:26.227830 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21a940-b5cd-4eaf-933a-990ac00dea97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:26.228051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a940-b5cd-4eaf-933a-990ac00dea97 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:26.228386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a940-b5cd-4eaf-933a-990ac00dea97 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:26.228729 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a940-b5cd-4eaf-933a-990ac00dea97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:26.230869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3d21a940-b5cd-4eaf-933a-990ac00dea97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:26.244772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21a940-b5cd-4eaf-933a-990ac00dea97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:26.246525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21a940-b5cd-4eaf-933a-990ac00dea97 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:26.260469 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1256/2529] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:31.758359 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abd914-ff7f-4199-afdd-07aedd53de1a service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:31.759795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-31abd914-ff7f-4199-afdd-07aedd53de1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:31.815362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abd914-ff7f-4199-afdd-07aedd53de1a service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:31.818971 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0abf74-a6c9-4259-b3e3-205ba64e036b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:31.819640 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0abf74-a6c9-4259-b3e3-205ba64e036b service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:31.819923 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0abf74-a6c9-4259-b3e3-205ba64e036b service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:31.820201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0abf74-a6c9-4259-b3e3-205ba64e036b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:31.821932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-de0abf74-a6c9-4259-b3e3-205ba64e036b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:31.884399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0abf74-a6c9-4259-b3e3-205ba64e036b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:31.885842 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0abf74-a6c9-4259-b3e3-205ba64e036b service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:31.896002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1274/2530] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:35.442569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21a940-b5cd-4eaf-933a-990ac00dea97 service nova] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:35.444257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3d21a940-b5cd-4eaf-933a-990ac00dea97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:35.458984 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21a940-b5cd-4eaf-933a-990ac00dea97 service nova] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:35.463629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c3a72-64a6-464a-8b41-1a6dfbb8e65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:35.464490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c3a72-64a6-464a-8b41-1a6dfbb8e65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:35.465279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c3a72-64a6-464a-8b41-1a6dfbb8e65e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:35.465549 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c3a72-64a6-464a-8b41-1a6dfbb8e65e admin admin] PATH_INFO: `/v3/users/199a0c82abd34b5f88063d79d89da19d` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:35.479839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c3a72-64a6-464a-8b41-1a6dfbb8e65e admin admin] RBAC: Authorizing `identity:delete_user(user_id=199a0c82abd34b5f88063d79d89da19d)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:35.482670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c3a72-64a6-464a-8b41-1a6dfbb8e65e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:35.683854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-8b8c3a72-64a6-464a-8b41-1a6dfbb8e65e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199a0c82abd34b5f88063d79d89da19d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:35.696087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-8b8c3a72-64a6-464a-8b41-1a6dfbb8e65e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199a0c82abd34b5f88063d79d89da19d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:35.703782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-8b8c3a72-64a6-464a-8b41-1a6dfbb8e65e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199a0c82abd34b5f88063d79d89da19d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:35.704492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-8b8c3a72-64a6-464a-8b41-1a6dfbb8e65e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199a0c82abd34b5f88063d79d89da19d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:35.779059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-8b8c3a72-64a6-464a-8b41-1a6dfbb8e65e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199a0c82abd34b5f88063d79d89da19d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:35.785277 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1257/2531] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:35 2022] DELETE /identity/v3/users/199a0c82abd34b5f88063d79d89da19d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:36.015136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0abf74-a6c9-4259-b3e3-205ba64e036b service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:36.026652 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0abf74-a6c9-4259-b3e3-205ba64e036b service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:36.085659 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452a873-3970-4ef1-9859-200e111d6431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:36.086513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452a873-3970-4ef1-9859-200e111d6431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:36.086810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452a873-3970-4ef1-9859-200e111d6431 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:36.087065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452a873-3970-4ef1-9859-200e111d6431 admin admin] PATH_INFO: `/v3/projects/32f862664b384d49a489ecaf52844577` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:36.098220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452a873-3970-4ef1-9859-200e111d6431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f862664b384d49a489ecaf52844577)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:36.100212 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452a873-3970-4ef1-9859-200e111d6431 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:36.190165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:36.193819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5452a873-3970-4ef1-9859-200e111d6431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f862664b384d49a489ecaf52844577', 'request_id': 'req-5452a873-3970-4ef1-9859-200e111d6431'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:36.273296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5452a873-3970-4ef1-9859-200e111d6431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f862664b384d49a489ecaf52844577', 'request_id': 'req-5452a873-3970-4ef1-9859-200e111d6431'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:36.280457 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5452a873-3970-4ef1-9859-200e111d6431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f862664b384d49a489ecaf52844577', 'request_id': 'req-5452a873-3970-4ef1-9859-200e111d6431'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:36.290856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5452a873-3970-4ef1-9859-200e111d6431 admin admin] The token cache is being invalidate because project 32f862664b384d49a489ecaf52844577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:07:36.291084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5452a873-3970-4ef1-9859-200e111d6431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:36.291751 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5452a873-3970-4ef1-9859-200e111d6431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:36.293509 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1275/2532] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:07:36 2022] DELETE /identity/v3/projects/32f862664b384d49a489ecaf52844577 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:36.298276 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bdb7a-7cb1-4744-b7cd-b6624e1f3c75 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:36.298571 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bdb7a-7cb1-4744-b7cd-b6624e1f3c75 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:36.298857 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bdb7a-7cb1-4744-b7cd-b6624e1f3c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:36.318186 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-ad2bdb7a-7cb1-4744-b7cd-b6624e1f3c75 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:36.319380 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ad2bdb7a-7cb1-4744-b7cd-b6624e1f3c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:36.360871 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:36.377975 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1258/2533] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:36.385819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b4cb6-1ae1-4417-9012-c441feb33929 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:36.386101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b4cb6-1ae1-4417-9012-c441feb33929 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:36.386376 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b4cb6-1ae1-4417-9012-c441feb33929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:36.404152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-fc5b4cb6-1ae1-4417-9012-c441feb33929 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:36.405343 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-fc5b4cb6-1ae1-4417-9012-c441feb33929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:36.413089 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1276/2534] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:36.417173 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bdb7a-7cb1-4744-b7cd-b6624e1f3c75 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:36.427510 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bdb7a-7cb1-4744-b7cd-b6624e1f3c75 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:36.432068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc39c3-f111-43c5-9ecc-e40416488df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:36.432716 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc39c3-f111-43c5-9ecc-e40416488df1 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:36.432997 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc39c3-f111-43c5-9ecc-e40416488df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:36.433269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc39c3-f111-43c5-9ecc-e40416488df1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:36.434497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc39c3-f111-43c5-9ecc-e40416488df1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:07:36.434798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc39c3-f111-43c5-9ecc-e40416488df1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:36.436413 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc39c3-f111-43c5-9ecc-e40416488df1 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:36.447796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1259/2535] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:07:36.452141 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b4cb6-1ae1-4417-9012-c441feb33929 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:36.461179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b4cb6-1ae1-4417-9012-c441feb33929 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:36.466271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d06e8-b843-44e1-900e-b5c7f5ddb113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:36.466904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d06e8-b843-44e1-900e-b5c7f5ddb113 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:36.467179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d06e8-b843-44e1-900e-b5c7f5ddb113 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:36.467472 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d06e8-b843-44e1-900e-b5c7f5ddb113 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:36.468161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d06e8-b843-44e1-900e-b5c7f5ddb113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:36.470056 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d06e8-b843-44e1-900e-b5c7f5ddb113 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:36.560636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1277/2536] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:36 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:36.564711 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc39c3-f111-43c5-9ecc-e40416488df1 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:36.574588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc39c3-f111-43c5-9ecc-e40416488df1 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:36.630596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fd13b-c322-46c8-b400-fc5d7de772d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:36.631262 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fd13b-c322-46c8-b400-fc5d7de772d4 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:36.631576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fd13b-c322-46c8-b400-fc5d7de772d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:36.631855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fd13b-c322-46c8-b400-fc5d7de772d4 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:36.632543 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fd13b-c322-46c8-b400-fc5d7de772d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:36.634491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fd13b-c322-46c8-b400-fc5d7de772d4 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:36.711358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1260/2537] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:36 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:36.716293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d06e8-b843-44e1-900e-b5c7f5ddb113 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:36.723559 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d06e8-b843-44e1-900e-b5c7f5ddb113 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:36.728316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567da4a-7cd1-4897-a378-2078a3bf5c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:36.729011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567da4a-7cd1-4897-a378-2078a3bf5c4f admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:36.729325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567da4a-7cd1-4897-a378-2078a3bf5c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:36.729599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567da4a-7cd1-4897-a378-2078a3bf5c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:36.730358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567da4a-7cd1-4897-a378-2078a3bf5c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:36.731983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567da4a-7cd1-4897-a378-2078a3bf5c4f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:36.742345 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1278/2538] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:36.747285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fd13b-c322-46c8-b400-fc5d7de772d4 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:36.757207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fd13b-c322-46c8-b400-fc5d7de772d4 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:36.762416 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41fbdf-131e-4d6d-854c-117d1db31a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:36.763065 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41fbdf-131e-4d6d-854c-117d1db31a1e admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:36.763348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41fbdf-131e-4d6d-854c-117d1db31a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:36.763652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41fbdf-131e-4d6d-854c-117d1db31a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:36.764369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41fbdf-131e-4d6d-854c-117d1db31a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:36.765951 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41fbdf-131e-4d6d-854c-117d1db31a1e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:36.775697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1261/2539] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:36.780547 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567da4a-7cd1-4897-a378-2078a3bf5c4f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:36.790924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567da4a-7cd1-4897-a378-2078a3bf5c4f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:36.795572 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405c0be-2b03-42fc-bcc0-cf39b3e856c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:36.796493 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405c0be-2b03-42fc-bcc0-cf39b3e856c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:36.796781 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405c0be-2b03-42fc-bcc0-cf39b3e856c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:36.797062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405c0be-2b03-42fc-bcc0-cf39b3e856c6 admin admin] PATH_INFO: `/v3/projects/47f9ad0c0e164ac4abc9aba54375f369/users/bfafb59710b1490e86c1e0db7769615e/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:36.813299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405c0be-2b03-42fc-bcc0-cf39b3e856c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f9ad0c0e164ac4abc9aba54375f369, user_id=bfafb59710b1490e86c1e0db7769615e, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:36.814351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405c0be-2b03-42fc-bcc0-cf39b3e856c6 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:36.933668 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1279/2540] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:36 2022] PUT /identity/v3/projects/47f9ad0c0e164ac4abc9aba54375f369/users/bfafb59710b1490e86c1e0db7769615e/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:36.945069 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024399-0251-4811-b2e7-a1ede24f5c9e None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:36.945428 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024399-0251-4811-b2e7-a1ede24f5c9e None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:36.945724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024399-0251-4811-b2e7-a1ede24f5c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:36.973174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-dd024399-0251-4811-b2e7-a1ede24f5c9e None None] MFA Rules not processed for user `bfafb59710b1490e86c1e0db7769615e`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:36.974478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-dd024399-0251-4811-b2e7-a1ede24f5c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:37.039328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1262/2541] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:37.043973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405c0be-2b03-42fc-bcc0-cf39b3e856c6 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:37.106399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405c0be-2b03-42fc-bcc0-cf39b3e856c6 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:37.111230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9bf9c-e16c-47ce-b9a9-3ae471017459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:37.111907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9bf9c-e16c-47ce-b9a9-3ae471017459 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:37.112197 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9bf9c-e16c-47ce-b9a9-3ae471017459 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:37.112471 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9bf9c-e16c-47ce-b9a9-3ae471017459 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:37.113144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9bf9c-e16c-47ce-b9a9-3ae471017459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:37.115050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9bf9c-e16c-47ce-b9a9-3ae471017459 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:37.217382 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1280/2542] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:37 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:07:37.221515 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd024399-0251-4811-b2e7-a1ede24f5c9e None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:37.232216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd024399-0251-4811-b2e7-a1ede24f5c9e None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:37.274562 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:37.290439 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f155-6182-468a-9457-e36107e79286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:37.291107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f155-6182-468a-9457-e36107e79286 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:37.291392 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f155-6182-468a-9457-e36107e79286 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:37.291704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f155-6182-468a-9457-e36107e79286 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:37.292392 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082f155-6182-468a-9457-e36107e79286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:37.294309 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082f155-6182-468a-9457-e36107e79286 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:37.380541 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1263/2543] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:37 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:37.384482 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9bf9c-e16c-47ce-b9a9-3ae471017459 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:37.395158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9bf9c-e16c-47ce-b9a9-3ae471017459 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:37.399962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03a4d1-808c-43a5-a838-f1751545308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:37.400621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a4d1-808c-43a5-a838-f1751545308d admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:37.400906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a4d1-808c-43a5-a838-f1751545308d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:37.401188 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a4d1-808c-43a5-a838-f1751545308d admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:37.401911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03a4d1-808c-43a5-a838-f1751545308d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:37.403566 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03a4d1-808c-43a5-a838-f1751545308d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:37.413993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1281/2544] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:37.418646 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f155-6182-468a-9457-e36107e79286 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:37.428570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f155-6182-468a-9457-e36107e79286 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:37.434247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5ff45-bb46-45f5-bce4-30b804985afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:37.435158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5ff45-bb46-45f5-bce4-30b804985afd admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:37.435440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5ff45-bb46-45f5-bce4-30b804985afd admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:37.435784 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5ff45-bb46-45f5-bce4-30b804985afd admin admin] PATH_INFO: `/v3/projects/a3159aaf6d86471aa7c62f825ef8cb83/users/7355a9b50fa847bbb10fe8043123471a/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:37.450538 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5ff45-bb46-45f5-bce4-30b804985afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3159aaf6d86471aa7c62f825ef8cb83, user_id=7355a9b50fa847bbb10fe8043123471a, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:37.453227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5ff45-bb46-45f5-bce4-30b804985afd admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:37.524940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1264/2545] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:37 2022] PUT /identity/v3/projects/a3159aaf6d86471aa7c62f825ef8cb83/users/7355a9b50fa847bbb10fe8043123471a/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:07:37.529014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03a4d1-808c-43a5-a838-f1751545308d admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:37.539078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03a4d1-808c-43a5-a838-f1751545308d admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:37.579073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:37.595443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5c240-f2c3-4064-b948-cf058243e7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:37.596134 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5c240-f2c3-4064-b948-cf058243e7ed admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:37.596415 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5c240-f2c3-4064-b948-cf058243e7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:37.596707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5c240-f2c3-4064-b948-cf058243e7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:37.597411 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5c240-f2c3-4064-b948-cf058243e7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:37.599053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5c240-f2c3-4064-b948-cf058243e7ed admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:37.609699 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1282/2546] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:37.613890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5ff45-bb46-45f5-bce4-30b804985afd admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:37.624909 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5ff45-bb46-45f5-bce4-30b804985afd admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:37.629575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6f91a-453b-41c5-b775-2c78ac94fdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:37.630449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6f91a-453b-41c5-b775-2c78ac94fdaf admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:37.630779 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6f91a-453b-41c5-b775-2c78ac94fdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:37.631005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6f91a-453b-41c5-b775-2c78ac94fdaf admin admin] PATH_INFO: `/v3/projects/a3159aaf6d86471aa7c62f825ef8cb83/users/7355a9b50fa847bbb10fe8043123471a/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:37.633008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6f91a-453b-41c5-b775-2c78ac94fdaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3159aaf6d86471aa7c62f825ef8cb83, user_id=7355a9b50fa847bbb10fe8043123471a, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:37.635801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6f91a-453b-41c5-b775-2c78ac94fdaf admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:37.646075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1265/2547] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:37 2022] PUT /identity/v3/projects/a3159aaf6d86471aa7c62f825ef8cb83/users/7355a9b50fa847bbb10fe8043123471a/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:37.656084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652558de-f88d-44eb-9798-bdec0f505d86 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:37.656375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652558de-f88d-44eb-9798-bdec0f505d86 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:37.656651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652558de-f88d-44eb-9798-bdec0f505d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:37.682308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-652558de-f88d-44eb-9798-bdec0f505d86 None None] MFA Rules not processed for user `7355a9b50fa847bbb10fe8043123471a`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:37.684130 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-652558de-f88d-44eb-9798-bdec0f505d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:37.754694 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1283/2548] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:37.765155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6f91a-453b-41c5-b775-2c78ac94fdaf admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:37.767061 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-65b6f91a-453b-41c5-b775-2c78ac94fdaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:37.836013 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6f91a-453b-41c5-b775-2c78ac94fdaf admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:37.840332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0641951-6530-4175-b220-306744fec7a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:37.840976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0641951-6530-4175-b220-306744fec7a5 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:37.842629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0641951-6530-4175-b220-306744fec7a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:37.842629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0641951-6530-4175-b220-306744fec7a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:37.851736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0641951-6530-4175-b220-306744fec7a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:37.853206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0641951-6530-4175-b220-306744fec7a5 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:37.863603 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1266/2549] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:38.124465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652558de-f88d-44eb-9798-bdec0f505d86 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:38.134035 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652558de-f88d-44eb-9798-bdec0f505d86 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:38.138355 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716b117-a6cf-4c56-b797-20206055824e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:38.138920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716b117-a6cf-4c56-b797-20206055824e service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:38.139200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716b117-a6cf-4c56-b797-20206055824e service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:38.139505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716b117-a6cf-4c56-b797-20206055824e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:38.201764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716b117-a6cf-4c56-b797-20206055824e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:38.204651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716b117-a6cf-4c56-b797-20206055824e service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:38.213341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1284/2550] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:47.859345 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=51,keystone:INSERT=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:48.211980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=72 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:50.031225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0641951-6530-4175-b220-306744fec7a5 service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:50.094993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0641951-6530-4175-b220-306744fec7a5 service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:50.103823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cc70a-1a5a-43e9-8d7c-e0abae58b9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:50.103823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cc70a-1a5a-43e9-8d7c-e0abae58b9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:50.103823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cc70a-1a5a-43e9-8d7c-e0abae58b9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:50.103823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cc70a-1a5a-43e9-8d7c-e0abae58b9bc admin admin] PATH_INFO: `/v3/users/bfafb59710b1490e86c1e0db7769615e` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:50.104166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cc70a-1a5a-43e9-8d7c-e0abae58b9bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfafb59710b1490e86c1e0db7769615e)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:50.104496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cc70a-1a5a-43e9-8d7c-e0abae58b9bc admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:50.321213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3d9cc70a-1a5a-43e9-8d7c-e0abae58b9bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfafb59710b1490e86c1e0db7769615e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:50.333502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3d9cc70a-1a5a-43e9-8d7c-e0abae58b9bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfafb59710b1490e86c1e0db7769615e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:50.340531 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3d9cc70a-1a5a-43e9-8d7c-e0abae58b9bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfafb59710b1490e86c1e0db7769615e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:50.346018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3d9cc70a-1a5a-43e9-8d7c-e0abae58b9bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfafb59710b1490e86c1e0db7769615e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:50.436796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3d9cc70a-1a5a-43e9-8d7c-e0abae58b9bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfafb59710b1490e86c1e0db7769615e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:50.443550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1267/2551] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:50 2022] DELETE /identity/v3/users/bfafb59710b1490e86c1e0db7769615e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:50.448025 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075c2dd-b6d5-4234-bcd9-24ea4fc7a64d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:50.448500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075c2dd-b6d5-4234-bcd9-24ea4fc7a64d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:50.448658 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075c2dd-b6d5-4234-bcd9-24ea4fc7a64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:50.467197 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-8075c2dd-b6d5-4234-bcd9-24ea4fc7a64d None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:50.468433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8075c2dd-b6d5-4234-bcd9-24ea4fc7a64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:50.526700 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1285/2552] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:50.536423 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cc70a-1a5a-43e9-8d7c-e0abae58b9bc admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:50.537884 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3d9cc70a-1a5a-43e9-8d7c-e0abae58b9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:50.595332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cc70a-1a5a-43e9-8d7c-e0abae58b9bc admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:50.598890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cac13-74f1-449c-b489-bf78a8fc7512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:50.599562 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cac13-74f1-449c-b489-bf78a8fc7512 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:50.601308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cac13-74f1-449c-b489-bf78a8fc7512 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:50.601308 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cac13-74f1-449c-b489-bf78a8fc7512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:50.609282 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cac13-74f1-449c-b489-bf78a8fc7512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:50.610730 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cac13-74f1-449c-b489-bf78a8fc7512 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:50.620045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1268/2553] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:51.031863 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075c2dd-b6d5-4234-bcd9-24ea4fc7a64d None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:51.033336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8075c2dd-b6d5-4234-bcd9-24ea4fc7a64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:51.047030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075c2dd-b6d5-4234-bcd9-24ea4fc7a64d None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:51.051932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:51.052872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:51.056642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:51.056642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] PATH_INFO: `/v3/projects/47f9ad0c0e164ac4abc9aba54375f369` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:51.056642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f9ad0c0e164ac4abc9aba54375f369)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:51.056642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:51.162350 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f9ad0c0e164ac4abc9aba54375f369', 'request_id': 'req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:51.238802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f9ad0c0e164ac4abc9aba54375f369', 'request_id': 'req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:51.245869 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f9ad0c0e164ac4abc9aba54375f369', 'request_id': 'req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:51.257846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] The token cache is being invalidate because project 47f9ad0c0e164ac4abc9aba54375f369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:07:51.258225 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:51.258967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:51.260678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1286/2554] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:07:51 2022] DELETE /identity/v3/projects/47f9ad0c0e164ac4abc9aba54375f369 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:51.264689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cac13-74f1-449c-b489-bf78a8fc7512 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:51.280137 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cac13-74f1-449c-b489-bf78a8fc7512 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:51.299177 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:51.338784 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8e2da-0191-43c0-9d0f-9dde197939d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:51.339791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e2da-0191-43c0-9d0f-9dde197939d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:51.340220 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e2da-0191-43c0-9d0f-9dde197939d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:51.340721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e2da-0191-43c0-9d0f-9dde197939d2 admin admin] PATH_INFO: `/v3/users/7355a9b50fa847bbb10fe8043123471a` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:51.342941 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8e2da-0191-43c0-9d0f-9dde197939d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7355a9b50fa847bbb10fe8043123471a)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:51.345332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8e2da-0191-43c0-9d0f-9dde197939d2 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:51.541693 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-98a8e2da-0191-43c0-9d0f-9dde197939d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7355a9b50fa847bbb10fe8043123471a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:51.552302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-98a8e2da-0191-43c0-9d0f-9dde197939d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7355a9b50fa847bbb10fe8043123471a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:51.559518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-98a8e2da-0191-43c0-9d0f-9dde197939d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7355a9b50fa847bbb10fe8043123471a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:51.560220 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-98a8e2da-0191-43c0-9d0f-9dde197939d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7355a9b50fa847bbb10fe8043123471a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:51.647742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-98a8e2da-0191-43c0-9d0f-9dde197939d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7355a9b50fa847bbb10fe8043123471a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:51.654403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1269/2555] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:51 2022] DELETE /identity/v3/users/7355a9b50fa847bbb10fe8043123471a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:52.089209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:52.090687 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:52.104213 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849acb3d-1665-4d69-b5d2-2d3aafe7adc2 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:52.162502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a4f58-e365-47ce-b68a-166b56a9f4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:52.163409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a4f58-e365-47ce-b68a-166b56a9f4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:52.163734 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a4f58-e365-47ce-b68a-166b56a9f4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:52.164017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a4f58-e365-47ce-b68a-166b56a9f4e6 admin admin] PATH_INFO: `/v3/projects/a3159aaf6d86471aa7c62f825ef8cb83` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:52.165207 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a4f58-e365-47ce-b68a-166b56a9f4e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3159aaf6d86471aa7c62f825ef8cb83)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:52.167257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a4f58-e365-47ce-b68a-166b56a9f4e6 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:52.185014 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8e2da-0191-43c0-9d0f-9dde197939d2 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:52.187122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-98a8e2da-0191-43c0-9d0f-9dde197939d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:52.199796 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8e2da-0191-43c0-9d0f-9dde197939d2 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:52.205030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d5194-3f5a-46c4-8a99-5b691b73f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:52.205890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5194-3f5a-46c4-8a99-5b691b73f54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:52.206171 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5194-3f5a-46c4-8a99-5b691b73f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:52.206445 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5194-3f5a-46c4-8a99-5b691b73f54e admin admin] PATH_INFO: `/v3/users/16680c7fe5c24acf86db6f70286a2b6e` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:52.207680 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d5194-3f5a-46c4-8a99-5b691b73f54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=16680c7fe5c24acf86db6f70286a2b6e)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:52.209594 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d5194-3f5a-46c4-8a99-5b691b73f54e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:52.286501 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:52.302603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b50a4f58-e365-47ce-b68a-166b56a9f4e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3159aaf6d86471aa7c62f825ef8cb83', 'request_id': 'req-b50a4f58-e365-47ce-b68a-166b56a9f4e6'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:52.375823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b50a4f58-e365-47ce-b68a-166b56a9f4e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3159aaf6d86471aa7c62f825ef8cb83', 'request_id': 'req-b50a4f58-e365-47ce-b68a-166b56a9f4e6'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:52.382370 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b50a4f58-e365-47ce-b68a-166b56a9f4e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3159aaf6d86471aa7c62f825ef8cb83', 'request_id': 'req-b50a4f58-e365-47ce-b68a-166b56a9f4e6'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:52.392844 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b50a4f58-e365-47ce-b68a-166b56a9f4e6 admin admin] The token cache is being invalidate because project a3159aaf6d86471aa7c62f825ef8cb83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:07:52.393137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b50a4f58-e365-47ce-b68a-166b56a9f4e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:52.393777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b50a4f58-e365-47ce-b68a-166b56a9f4e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:52.395330 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1287/2556] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:07:52 2022] DELETE /identity/v3/projects/a3159aaf6d86471aa7c62f825ef8cb83 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:52.400693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b216e3-169d-4cac-afe3-a8cddfdd2817 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:52.401003 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b216e3-169d-4cac-afe3-a8cddfdd2817 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:52.401276 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b216e3-169d-4cac-afe3-a8cddfdd2817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:52.415097 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1c5d5194-3f5a-46c4-8a99-5b691b73f54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16680c7fe5c24acf86db6f70286a2b6e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:52.420668 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-16b216e3-169d-4cac-afe3-a8cddfdd2817 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:52.421861 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-16b216e3-169d-4cac-afe3-a8cddfdd2817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:52.430066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1c5d5194-3f5a-46c4-8a99-5b691b73f54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16680c7fe5c24acf86db6f70286a2b6e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:52.438185 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1c5d5194-3f5a-46c4-8a99-5b691b73f54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16680c7fe5c24acf86db6f70286a2b6e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:52.438889 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1c5d5194-3f5a-46c4-8a99-5b691b73f54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16680c7fe5c24acf86db6f70286a2b6e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:52.479634 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1288/2557] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:07:52.488275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd192a6-1a66-4d39-8393-af2f1ad99602 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:52.488567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd192a6-1a66-4d39-8393-af2f1ad99602 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:52.488911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd192a6-1a66-4d39-8393-af2f1ad99602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:52.507305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-1fd192a6-1a66-4d39-8393-af2f1ad99602 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:52.510833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1fd192a6-1a66-4d39-8393-af2f1ad99602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:52.516429 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1289/2558] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:07:52.520266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd192a6-1a66-4d39-8393-af2f1ad99602 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:52.528887 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd192a6-1a66-4d39-8393-af2f1ad99602 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:52.530262 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1c5d5194-3f5a-46c4-8a99-5b691b73f54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16680c7fe5c24acf86db6f70286a2b6e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:52.533561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f014769-974f-4613-b502-ce1c725c0f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:52.534191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f014769-974f-4613-b502-ce1c725c0f3d admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:52.534478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f014769-974f-4613-b502-ce1c725c0f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:52.534756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f014769-974f-4613-b502-ce1c725c0f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:52.535506 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f014769-974f-4613-b502-ce1c725c0f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:07:52.535823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f014769-974f-4613-b502-ce1c725c0f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:52.540633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f014769-974f-4613-b502-ce1c725c0f3d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:52.540755 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1270/2559] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:52 2022] DELETE /identity/v3/users/16680c7fe5c24acf86db6f70286a2b6e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:07:52.544493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be4574-1ba5-49e8-8f9d-9424165874a4 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:52.544870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be4574-1ba5-49e8-8f9d-9424165874a4 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:52.545967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be4574-1ba5-49e8-8f9d-9424165874a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:52.551369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1290/2560] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:07:52.555527 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f014769-974f-4613-b502-ce1c725c0f3d admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:52.564281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-04be4574-1ba5-49e8-8f9d-9424165874a4 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:52.565473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-04be4574-1ba5-49e8-8f9d-9424165874a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:52.565586 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f014769-974f-4613-b502-ce1c725c0f3d admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:52.573404 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:52.622564 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef5186-124a-4cc7-be23-76547cbef12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:52.623252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5186-124a-4cc7-be23-76547cbef12a admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:52.624498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5186-124a-4cc7-be23-76547cbef12a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:52.624781 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5186-124a-4cc7-be23-76547cbef12a admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:52.625465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef5186-124a-4cc7-be23-76547cbef12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:52.626229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1271/2561] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:07:52.630451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef5186-124a-4cc7-be23-76547cbef12a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:52.635746 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be4574-1ba5-49e8-8f9d-9424165874a4 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:52.637087 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-04be4574-1ba5-49e8-8f9d-9424165874a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:52.693046 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be4574-1ba5-49e8-8f9d-9424165874a4 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:52.696994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed514352-7758-4962-8dd9-211d882f0d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:52.697639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed514352-7758-4962-8dd9-211d882f0d47 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:52.697925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed514352-7758-4962-8dd9-211d882f0d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:52.698210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed514352-7758-4962-8dd9-211d882f0d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:52.707470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed514352-7758-4962-8dd9-211d882f0d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:52.708908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed514352-7758-4962-8dd9-211d882f0d47 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:52.718777 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1272/2562] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:52.735804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1291/2563] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:52 2022] POST /identity/v3/projects => generated 389 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:52.739989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed514352-7758-4962-8dd9-211d882f0d47 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:52.749546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed514352-7758-4962-8dd9-211d882f0d47 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:52.806202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b43df-afc0-464f-8063-3113b4b3fea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:52.806886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b43df-afc0-464f-8063-3113b4b3fea7 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:52.807155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b43df-afc0-464f-8063-3113b4b3fea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:52.807434 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b43df-afc0-464f-8063-3113b4b3fea7 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:52.808154 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b43df-afc0-464f-8063-3113b4b3fea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:52.810202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b43df-afc0-464f-8063-3113b4b3fea7 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:52.902207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1273/2564] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:52 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:52.906874 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef5186-124a-4cc7-be23-76547cbef12a admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:52.917911 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef5186-124a-4cc7-be23-76547cbef12a admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:52.925871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a311f-c126-42bd-a579-ddb4104de62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:52.926562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a311f-c126-42bd-a579-ddb4104de62b admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:52.926857 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a311f-c126-42bd-a579-ddb4104de62b admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:52.927207 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a311f-c126-42bd-a579-ddb4104de62b admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:52.927942 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a311f-c126-42bd-a579-ddb4104de62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:52.929595 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a311f-c126-42bd-a579-ddb4104de62b admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:52.940820 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1292/2565] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:52.944794 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b43df-afc0-464f-8063-3113b4b3fea7 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:52.955905 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b43df-afc0-464f-8063-3113b4b3fea7 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:52.960842 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed2b72-9d98-4825-beba-c43d65c6c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:52.961501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed2b72-9d98-4825-beba-c43d65c6c9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:52.961783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed2b72-9d98-4825-beba-c43d65c6c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:52.962049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed2b72-9d98-4825-beba-c43d65c6c9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:52.962763 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed2b72-9d98-4825-beba-c43d65c6c9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:52.964422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed2b72-9d98-4825-beba-c43d65c6c9c2 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:52.975035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1274/2566] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:52.979256 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a311f-c126-42bd-a579-ddb4104de62b admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:52.989843 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a311f-c126-42bd-a579-ddb4104de62b admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:52.994459 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826998ac-b0f1-4c2b-b716-08c35c5ee488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:52.995331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826998ac-b0f1-4c2b-b716-08c35c5ee488 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:52.995684 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826998ac-b0f1-4c2b-b716-08c35c5ee488 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:52.995965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826998ac-b0f1-4c2b-b716-08c35c5ee488 admin admin] PATH_INFO: `/v3/projects/1cedf17e4521403c9307202ddec083c3/users/66a82c88f0da4b649d96cc912fca76dd/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:52.999109 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:53.011164 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826998ac-b0f1-4c2b-b716-08c35c5ee488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cedf17e4521403c9307202ddec083c3, user_id=66a82c88f0da4b649d96cc912fca76dd, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:53.014016 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826998ac-b0f1-4c2b-b716-08c35c5ee488 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:53.119261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1293/2567] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:52 2022] PUT /identity/v3/projects/1cedf17e4521403c9307202ddec083c3/users/66a82c88f0da4b649d96cc912fca76dd/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:53.130712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ce9f9-2de9-469e-8bc6-a08da4c7eb3c None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:53.131072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ce9f9-2de9-469e-8bc6-a08da4c7eb3c None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:53.131425 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ce9f9-2de9-469e-8bc6-a08da4c7eb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:53.131823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826998ac-b0f1-4c2b-b716-08c35c5ee488 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:53.134117 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-826998ac-b0f1-4c2b-b716-08c35c5ee488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:53.163596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-e67ce9f9-2de9-469e-8bc6-a08da4c7eb3c None None] MFA Rules not processed for user `66a82c88f0da4b649d96cc912fca76dd`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:53.164866 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e67ce9f9-2de9-469e-8bc6-a08da4c7eb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:53.188907 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:53.210787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826998ac-b0f1-4c2b-b716-08c35c5ee488 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:53.215585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:53.216444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:53.216726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:53.217025 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] PATH_INFO: `/v3/projects/70c38c34134a46cfa5d92ef05a66b9c0` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:53.218765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c38c34134a46cfa5d92ef05a66b9c0)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:53.220722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:53.231629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1275/2568] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:53.236380 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ce9f9-2de9-469e-8bc6-a08da4c7eb3c None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:53.246277 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ce9f9-2de9-469e-8bc6-a08da4c7eb3c None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:53.251727 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c3c8f-88bd-46db-b395-74cff43b3b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:53.252402 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c3c8f-88bd-46db-b395-74cff43b3b5c admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:53.252682 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c3c8f-88bd-46db-b395-74cff43b3b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:53.252957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c3c8f-88bd-46db-b395-74cff43b3b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:53.253638 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c3c8f-88bd-46db-b395-74cff43b3b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:53.255613 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c3c8f-88bd-46db-b395-74cff43b3b5c admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:53.382876 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c38c34134a46cfa5d92ef05a66b9c0', 'request_id': 'req-8de96a0e-6902-4e15-a13a-74ff393405f5'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:53.383334 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1276/2569] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:53 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:07:53.386936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c3c8f-88bd-46db-b395-74cff43b3b5c admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:53.444856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c38c34134a46cfa5d92ef05a66b9c0', 'request_id': 'req-8de96a0e-6902-4e15-a13a-74ff393405f5'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:53.448525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c3c8f-88bd-46db-b395-74cff43b3b5c admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:53.452226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c38c34134a46cfa5d92ef05a66b9c0', 'request_id': 'req-8de96a0e-6902-4e15-a13a-74ff393405f5'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:53.454357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a3526-d781-4f82-bed0-86574f0d1983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:53.454885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a3526-d781-4f82-bed0-86574f0d1983 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:53.455190 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a3526-d781-4f82-bed0-86574f0d1983 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:53.455473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a3526-d781-4f82-bed0-86574f0d1983 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:53.456170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a3526-d781-4f82-bed0-86574f0d1983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:53.460845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a3526-d781-4f82-bed0-86574f0d1983 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:53.463086 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] The token cache is being invalidate because project 70c38c34134a46cfa5d92ef05a66b9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:07:53.463373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:53.464074 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:53.465632 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1294/2570] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:07:53 2022] DELETE /identity/v3/projects/70c38c34134a46cfa5d92ef05a66b9c0 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:07:53.469558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:53.470878 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:53.525679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1277/2571] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:53 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:07:53.529610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a3526-d781-4f82-bed0-86574f0d1983 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:53.531584 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-102a3526-d781-4f82-bed0-86574f0d1983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:53.534978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de96a0e-6902-4e15-a13a-74ff393405f5 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:53.540620 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b99e51-ad18-43c5-b0a7-b7128069924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:53.541515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b99e51-ad18-43c5-b0a7-b7128069924c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:53.541844 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b99e51-ad18-43c5-b0a7-b7128069924c admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:53.542123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b99e51-ad18-43c5-b0a7-b7128069924c admin admin] PATH_INFO: `/v3/users/ab400b7fc72a495082e39f0542913703` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:53.543201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a3526-d781-4f82-bed0-86574f0d1983 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:53.543329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b99e51-ad18-43c5-b0a7-b7128069924c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab400b7fc72a495082e39f0542913703)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:53.545316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b99e51-ad18-43c5-b0a7-b7128069924c admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:53.547809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e035a1-822e-47dd-b436-bd681425ea7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:53.548446 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e035a1-822e-47dd-b436-bd681425ea7e admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:53.548725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e035a1-822e-47dd-b436-bd681425ea7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:53.548999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e035a1-822e-47dd-b436-bd681425ea7e admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:53.549709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e035a1-822e-47dd-b436-bd681425ea7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:53.551275 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e035a1-822e-47dd-b436-bd681425ea7e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:53.562867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:53.566663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1278/2572] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:07:53.567564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e035a1-822e-47dd-b436-bd681425ea7e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:53.577897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e035a1-822e-47dd-b436-bd681425ea7e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:53.582495 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256a18c-97ee-420e-a02e-85d13f28985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:53.583367 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256a18c-97ee-420e-a02e-85d13f28985d admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:53.583683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256a18c-97ee-420e-a02e-85d13f28985d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:53.583953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256a18c-97ee-420e-a02e-85d13f28985d admin admin] PATH_INFO: `/v3/projects/f5481eb2b45a404cb34094165863caca/users/207aa421d79f45539ec4f5c41f17f548/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:53.598366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256a18c-97ee-420e-a02e-85d13f28985d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5481eb2b45a404cb34094165863caca, user_id=207aa421d79f45539ec4f5c41f17f548, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:53.601050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256a18c-97ee-420e-a02e-85d13f28985d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:53.665154 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1279/2573] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:53 2022] PUT /identity/v3/projects/f5481eb2b45a404cb34094165863caca/users/207aa421d79f45539ec4f5c41f17f548/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:53.669125 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256a18c-97ee-420e-a02e-85d13f28985d admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:53.725511 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:53.729251 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256a18c-97ee-420e-a02e-85d13f28985d admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:53.734207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6721d-847f-41e0-bed9-f3f6fca23de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:53.734863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6721d-847f-41e0-bed9-f3f6fca23de0 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:53.735145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6721d-847f-41e0-bed9-f3f6fca23de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:53.735418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6721d-847f-41e0-bed9-f3f6fca23de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:53.735622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a0b99e51-ad18-43c5-b0a7-b7128069924c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab400b7fc72a495082e39f0542913703'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:53.736200 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6721d-847f-41e0-bed9-f3f6fca23de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:53.737784 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6721d-847f-41e0-bed9-f3f6fca23de0 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:53.747438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1280/2574] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:07:53.752155 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6721d-847f-41e0-bed9-f3f6fca23de0 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:53.761545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6721d-847f-41e0-bed9-f3f6fca23de0 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:53.767044 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafb79a-2d21-4e62-b6a1-4eb846a10ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:53.767954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafb79a-2d21-4e62-b6a1-4eb846a10ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:53.768268 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafb79a-2d21-4e62-b6a1-4eb846a10ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:53.768546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafb79a-2d21-4e62-b6a1-4eb846a10ebe admin admin] PATH_INFO: `/v3/projects/f5481eb2b45a404cb34094165863caca/users/207aa421d79f45539ec4f5c41f17f548/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:53.770531 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafb79a-2d21-4e62-b6a1-4eb846a10ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5481eb2b45a404cb34094165863caca, user_id=207aa421d79f45539ec4f5c41f17f548, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:53.773286 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafb79a-2d21-4e62-b6a1-4eb846a10ebe admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:53.783205 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1281/2575] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:53 2022] PUT /identity/v3/projects/f5481eb2b45a404cb34094165863caca/users/207aa421d79f45539ec4f5c41f17f548/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:07:53.792854 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14762ec2-c967-4bb9-a475-3e1ff4513973 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:53.793142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14762ec2-c967-4bb9-a475-3e1ff4513973 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:53.793504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14762ec2-c967-4bb9-a475-3e1ff4513973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:53.819642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-14762ec2-c967-4bb9-a475-3e1ff4513973 None None] MFA Rules not processed for user `207aa421d79f45539ec4f5c41f17f548`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:53.820824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-14762ec2-c967-4bb9-a475-3e1ff4513973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:53.830276 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a0b99e51-ad18-43c5-b0a7-b7128069924c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab400b7fc72a495082e39f0542913703'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:53.843938 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a0b99e51-ad18-43c5-b0a7-b7128069924c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab400b7fc72a495082e39f0542913703'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:53.844604 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a0b99e51-ad18-43c5-b0a7-b7128069924c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab400b7fc72a495082e39f0542913703'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:53.852282 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a0b99e51-ad18-43c5-b0a7-b7128069924c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab400b7fc72a495082e39f0542913703'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:53.859200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1295/2576] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:53 2022] DELETE /identity/v3/users/ab400b7fc72a495082e39f0542913703 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:07:53.889094 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1282/2577] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:07:53.899536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b99e51-ad18-43c5-b0a7-b7128069924c admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:53.900933 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a0b99e51-ad18-43c5-b0a7-b7128069924c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:53.959020 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b99e51-ad18-43c5-b0a7-b7128069924c admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:53.962743 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558ca08-b8ec-4b7b-8588-3595877f5f92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:53.963428 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558ca08-b8ec-4b7b-8588-3595877f5f92 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:53.963744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558ca08-b8ec-4b7b-8588-3595877f5f92 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:53.964025 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558ca08-b8ec-4b7b-8588-3595877f5f92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:54.023650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558ca08-b8ec-4b7b-8588-3595877f5f92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:54.025115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558ca08-b8ec-4b7b-8588-3595877f5f92 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:54.034677 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1296/2578] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:54.169704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14762ec2-c967-4bb9-a475-3e1ff4513973 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:54.171210 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-14762ec2-c967-4bb9-a475-3e1ff4513973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:54.236335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14762ec2-c967-4bb9-a475-3e1ff4513973 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:54.292385 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa638eea-ccd6-4ef4-8d19-f3b986cf4dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:54.293243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa638eea-ccd6-4ef4-8d19-f3b986cf4dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:54.293527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa638eea-ccd6-4ef4-8d19-f3b986cf4dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:54.293801 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa638eea-ccd6-4ef4-8d19-f3b986cf4dc6 admin admin] PATH_INFO: `/v3/users/66a82c88f0da4b649d96cc912fca76dd` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:54.295042 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa638eea-ccd6-4ef4-8d19-f3b986cf4dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a82c88f0da4b649d96cc912fca76dd)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:54.297082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa638eea-ccd6-4ef4-8d19-f3b986cf4dc6 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:54.310148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:54.332550 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558ca08-b8ec-4b7b-8588-3595877f5f92 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:54.334035 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6558ca08-b8ec-4b7b-8588-3595877f5f92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:54.347908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558ca08-b8ec-4b7b-8588-3595877f5f92 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:54.352493 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bf531-c0fd-417c-afa9-163ba18c5a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:54.353399 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bf531-c0fd-417c-afa9-163ba18c5a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:54.353657 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bf531-c0fd-417c-afa9-163ba18c5a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:54.353930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bf531-c0fd-417c-afa9-163ba18c5a63 admin admin] PATH_INFO: `/v3/projects/6d262ed3ef7f4b1585dc50c03c9085fb` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:54.355580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bf531-c0fd-417c-afa9-163ba18c5a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d262ed3ef7f4b1585dc50c03c9085fb)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:54.357885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bf531-c0fd-417c-afa9-163ba18c5a63 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:54.535052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:54.542180 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3b7bf531-c0fd-417c-afa9-163ba18c5a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d262ed3ef7f4b1585dc50c03c9085fb', 'request_id': 'req-3b7bf531-c0fd-417c-afa9-163ba18c5a63'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:54.542470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fa638eea-ccd6-4ef4-8d19-f3b986cf4dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a82c88f0da4b649d96cc912fca76dd'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:54.554571 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fa638eea-ccd6-4ef4-8d19-f3b986cf4dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a82c88f0da4b649d96cc912fca76dd'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:54.562088 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fa638eea-ccd6-4ef4-8d19-f3b986cf4dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a82c88f0da4b649d96cc912fca76dd'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:54.562799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fa638eea-ccd6-4ef4-8d19-f3b986cf4dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a82c88f0da4b649d96cc912fca76dd'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:54.613081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3b7bf531-c0fd-417c-afa9-163ba18c5a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d262ed3ef7f4b1585dc50c03c9085fb', 'request_id': 'req-3b7bf531-c0fd-417c-afa9-163ba18c5a63'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:54.619888 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3b7bf531-c0fd-417c-afa9-163ba18c5a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d262ed3ef7f4b1585dc50c03c9085fb', 'request_id': 'req-3b7bf531-c0fd-417c-afa9-163ba18c5a63'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:54.630869 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3b7bf531-c0fd-417c-afa9-163ba18c5a63 admin admin] The token cache is being invalidate because project 6d262ed3ef7f4b1585dc50c03c9085fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:07:54.631186 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3b7bf531-c0fd-417c-afa9-163ba18c5a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:54.631832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-3b7bf531-c0fd-417c-afa9-163ba18c5a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:54.633391 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1297/2579] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:07:54 2022] DELETE /identity/v3/projects/6d262ed3ef7f4b1585dc50c03c9085fb => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:07:54.638079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b5a9-2ee3-48d2-a972-b918fc601e8a None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:54.638401 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b5a9-2ee3-48d2-a972-b918fc601e8a None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:54.638689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b5a9-2ee3-48d2-a972-b918fc601e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:54.656022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-1a79b5a9-2ee3-48d2-a972-b918fc601e8a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:54.657208 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1a79b5a9-2ee3-48d2-a972-b918fc601e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:54.714284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1298/2580] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:07:54.722004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-fa638eea-ccd6-4ef4-8d19-f3b986cf4dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a82c88f0da4b649d96cc912fca76dd'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:54.722146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9085876-137f-4bdf-8f65-eb007532793a None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:54.722516 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9085876-137f-4bdf-8f65-eb007532793a None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:54.722795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9085876-137f-4bdf-8f65-eb007532793a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:54.728487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1283/2581] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:54 2022] DELETE /identity/v3/users/66a82c88f0da4b649d96cc912fca76dd => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:54.733616 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a39bc6-47e5-48ec-b55d-89f2825bc8f1 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:54.734141 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a39bc6-47e5-48ec-b55d-89f2825bc8f1 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:54.734544 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a39bc6-47e5-48ec-b55d-89f2825bc8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:54.741261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-c9085876-137f-4bdf-8f65-eb007532793a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:54.745792 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c9085876-137f-4bdf-8f65-eb007532793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:54.753050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-42a39bc6-47e5-48ec-b55d-89f2825bc8f1 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:54.754209 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-42a39bc6-47e5-48ec-b55d-89f2825bc8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:54.801582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1299/2582] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:07:54.805784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9085876-137f-4bdf-8f65-eb007532793a None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:54.811956 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1284/2583] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:54.815290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9085876-137f-4bdf-8f65-eb007532793a None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:54.820148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b489be-1324-4057-9eb4-800412414e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:54.820847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b489be-1324-4057-9eb4-800412414e6f admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:54.821172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b489be-1324-4057-9eb4-800412414e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:54.821289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a39bc6-47e5-48ec-b55d-89f2825bc8f1 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:54.821388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b489be-1324-4057-9eb4-800412414e6f admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:54.822080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b489be-1324-4057-9eb4-800412414e6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:07:54.822385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b489be-1324-4057-9eb4-800412414e6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:54.822814 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-42a39bc6-47e5-48ec-b55d-89f2825bc8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:54.824033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b489be-1324-4057-9eb4-800412414e6f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:54.835705 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1300/2584] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:07:54.839941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b489be-1324-4057-9eb4-800412414e6f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:54.849209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b489be-1324-4057-9eb4-800412414e6f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:54.853941 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e575b-b7fc-4cd6-b360-555351ace2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:54.854572 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e575b-b7fc-4cd6-b360-555351ace2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:54.854856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e575b-b7fc-4cd6-b360-555351ace2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:54.855134 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e575b-b7fc-4cd6-b360-555351ace2c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:54.855833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e575b-b7fc-4cd6-b360-555351ace2c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:54.858523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e575b-b7fc-4cd6-b360-555351ace2c0 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:54.881426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a39bc6-47e5-48ec-b55d-89f2825bc8f1 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:54.884975 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60525bb2-cc9c-4a99-85a0-8fa2e0f00b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:54.885611 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60525bb2-cc9c-4a99-85a0-8fa2e0f00b47 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:54.885891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60525bb2-cc9c-4a99-85a0-8fa2e0f00b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:54.886163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60525bb2-cc9c-4a99-85a0-8fa2e0f00b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:54.895719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60525bb2-cc9c-4a99-85a0-8fa2e0f00b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:54.897134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60525bb2-cc9c-4a99-85a0-8fa2e0f00b47 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:54.906906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1285/2585] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:07:54.949116 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1301/2586] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:54 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:07:54.950736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60525bb2-cc9c-4a99-85a0-8fa2e0f00b47 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:54.961497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60525bb2-cc9c-4a99-85a0-8fa2e0f00b47 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:54.995015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:55.020295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8c712-a42e-4c75-b54c-c58842fd52d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:55.020967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8c712-a42e-4c75-b54c-c58842fd52d3 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:55.021254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8c712-a42e-4c75-b54c-c58842fd52d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:55.021536 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8c712-a42e-4c75-b54c-c58842fd52d3 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:55.022216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8c712-a42e-4c75-b54c-c58842fd52d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:55.024263 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8c712-a42e-4c75-b54c-c58842fd52d3 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:55.133745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1286/2587] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:54 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:55.140152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e575b-b7fc-4cd6-b360-555351ace2c0 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:55.150828 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e575b-b7fc-4cd6-b360-555351ace2c0 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:55.156387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a7e20-e8a6-4e10-8afc-f8394e1d9fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:55.159643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a7e20-e8a6-4e10-8afc-f8394e1d9fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:55.159643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a7e20-e8a6-4e10-8afc-f8394e1d9fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:55.159643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a7e20-e8a6-4e10-8afc-f8394e1d9fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:55.159643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a7e20-e8a6-4e10-8afc-f8394e1d9fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:55.160280 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a7e20-e8a6-4e10-8afc-f8394e1d9fa4 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:55.170656 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1302/2588] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:07:55.174725 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8c712-a42e-4c75-b54c-c58842fd52d3 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:55.185013 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8c712-a42e-4c75-b54c-c58842fd52d3 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:55.190822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ea5ef-c7f9-4ab2-9c8f-be20ee0b3d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:55.191583 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ea5ef-c7f9-4ab2-9c8f-be20ee0b3d91 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:55.191863 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ea5ef-c7f9-4ab2-9c8f-be20ee0b3d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:55.192132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ea5ef-c7f9-4ab2-9c8f-be20ee0b3d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:55.192849 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ea5ef-c7f9-4ab2-9c8f-be20ee0b3d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:55.194435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ea5ef-c7f9-4ab2-9c8f-be20ee0b3d91 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:55.208472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1287/2589] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:55.209560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a7e20-e8a6-4e10-8afc-f8394e1d9fa4 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:55.219668 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a7e20-e8a6-4e10-8afc-f8394e1d9fa4 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:55.224188 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267807b9-5db1-4791-b85a-bb8eb1a8c1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:55.225080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267807b9-5db1-4791-b85a-bb8eb1a8c1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:55.225510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267807b9-5db1-4791-b85a-bb8eb1a8c1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:55.225784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267807b9-5db1-4791-b85a-bb8eb1a8c1d5 admin admin] PATH_INFO: `/v3/projects/a40dfbe058b84f8ba9ed8a8319d115c9/users/e4fedb338834493887609d5f2c26f47e/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:55.242353 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267807b9-5db1-4791-b85a-bb8eb1a8c1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40dfbe058b84f8ba9ed8a8319d115c9, user_id=e4fedb338834493887609d5f2c26f47e, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:55.245082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267807b9-5db1-4791-b85a-bb8eb1a8c1d5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:55.306159 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ea5ef-c7f9-4ab2-9c8f-be20ee0b3d91 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:55.307922 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-338ea5ef-c7f9-4ab2-9c8f-be20ee0b3d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:55.322373 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ea5ef-c7f9-4ab2-9c8f-be20ee0b3d91 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:55.328113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:55.329050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:55.329354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:55.329632 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] PATH_INFO: `/v3/projects/1cedf17e4521403c9307202ddec083c3` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:55.330961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cedf17e4521403c9307202ddec083c3)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:55.333004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:55.334050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:55.340666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1303/2590] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:55 2022] PUT /identity/v3/projects/a40dfbe058b84f8ba9ed8a8319d115c9/users/e4fedb338834493887609d5f2c26f47e/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:07:55.351508 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df4ef4-5bb2-4ebd-a640-b732c7c6f511 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:55.351802 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df4ef4-5bb2-4ebd-a640-b732c7c6f511 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:55.352074 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df4ef4-5bb2-4ebd-a640-b732c7c6f511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:55.379195 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-70df4ef4-5bb2-4ebd-a640-b732c7c6f511 None None] MFA Rules not processed for user `e4fedb338834493887609d5f2c26f47e`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:55.388389 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-70df4ef4-5bb2-4ebd-a640-b732c7c6f511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:55.457733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cedf17e4521403c9307202ddec083c3', 'request_id': 'req-1cff89e6-2748-46d5-bcd8-8dfc6f546676'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:55.461015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1304/2591] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:07:55.465152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df4ef4-5bb2-4ebd-a640-b732c7c6f511 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:55.518833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cedf17e4521403c9307202ddec083c3', 'request_id': 'req-1cff89e6-2748-46d5-bcd8-8dfc6f546676'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:55.526146 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cedf17e4521403c9307202ddec083c3', 'request_id': 'req-1cff89e6-2748-46d5-bcd8-8dfc6f546676'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:55.526528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df4ef4-5bb2-4ebd-a640-b732c7c6f511 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:55.536609 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] The token cache is being invalidate because project 1cedf17e4521403c9307202ddec083c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:07:55.536893 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:55.537545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:55.539160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1288/2592] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:07:55 2022] DELETE /identity/v3/projects/1cedf17e4521403c9307202ddec083c3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:07:55.543070 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:55.544466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:55.587237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf74a8d-8a14-4026-a0dd-615356592b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:55.588007 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf74a8d-8a14-4026-a0dd-615356592b92 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:55.588366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf74a8d-8a14-4026-a0dd-615356592b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:55.588715 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf74a8d-8a14-4026-a0dd-615356592b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:55.589478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf74a8d-8a14-4026-a0dd-615356592b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:55.591510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf74a8d-8a14-4026-a0dd-615356592b92 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:55.610343 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff89e6-2748-46d5-bcd8-8dfc6f546676 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:55.615083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25167970-d148-4bd7-bc59-1ce1b8256fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:55.623058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25167970-d148-4bd7-bc59-1ce1b8256fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:55.623058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25167970-d148-4bd7-bc59-1ce1b8256fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:55.623058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25167970-d148-4bd7-bc59-1ce1b8256fa9 admin admin] PATH_INFO: `/v3/users/207aa421d79f45539ec4f5c41f17f548` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:55.623058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25167970-d148-4bd7-bc59-1ce1b8256fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=207aa421d79f45539ec4f5c41f17f548)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:55.623058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25167970-d148-4bd7-bc59-1ce1b8256fa9 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:55.677682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1305/2593] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:55 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:07:55.681565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf74a8d-8a14-4026-a0dd-615356592b92 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:55.683135 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4bf74a8d-8a14-4026-a0dd-615356592b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:55.704122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:55.746799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf74a8d-8a14-4026-a0dd-615356592b92 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:55.751834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bd19b-f7ac-42ec-9720-2788240e08ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:55.752488 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd19b-f7ac-42ec-9720-2788240e08ae admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:55.752769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd19b-f7ac-42ec-9720-2788240e08ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:55.753042 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd19b-f7ac-42ec-9720-2788240e08ae admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:55.753713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bd19b-f7ac-42ec-9720-2788240e08ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:55.755637 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bd19b-f7ac-42ec-9720-2788240e08ae admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:55.781599 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:55.787079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-25167970-d148-4bd7-bc59-1ce1b8256fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '207aa421d79f45539ec4f5c41f17f548'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:55.799120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-25167970-d148-4bd7-bc59-1ce1b8256fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '207aa421d79f45539ec4f5c41f17f548'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:55.805918 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-25167970-d148-4bd7-bc59-1ce1b8256fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '207aa421d79f45539ec4f5c41f17f548'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:55.806704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-25167970-d148-4bd7-bc59-1ce1b8256fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '207aa421d79f45539ec4f5c41f17f548'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:55.825037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1306/2594] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:55 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:07:55.829054 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bd19b-f7ac-42ec-9720-2788240e08ae admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:55.830765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-269bd19b-f7ac-42ec-9720-2788240e08ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:55.842931 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bd19b-f7ac-42ec-9720-2788240e08ae admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:55.847494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868a13c-ed10-4544-a1c8-d25806631983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:55.848229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a13c-ed10-4544-a1c8-d25806631983 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:55.848513 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a13c-ed10-4544-a1c8-d25806631983 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:55.848790 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a13c-ed10-4544-a1c8-d25806631983 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:55.849504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868a13c-ed10-4544-a1c8-d25806631983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:55.851081 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868a13c-ed10-4544-a1c8-d25806631983 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:55.861794 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1307/2595] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:07:55.865706 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868a13c-ed10-4544-a1c8-d25806631983 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:55.867569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-25167970-d148-4bd7-bc59-1ce1b8256fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '207aa421d79f45539ec4f5c41f17f548'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:55.874023 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1289/2596] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:55 2022] DELETE /identity/v3/users/207aa421d79f45539ec4f5c41f17f548 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:07:55.875268 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868a13c-ed10-4544-a1c8-d25806631983 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:55.936422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3286fc-a5c6-42a6-a8f8-f45ede9ca779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:55.937462 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3286fc-a5c6-42a6-a8f8-f45ede9ca779 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:55.938021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3286fc-a5c6-42a6-a8f8-f45ede9ca779 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:55.938171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3286fc-a5c6-42a6-a8f8-f45ede9ca779 admin admin] PATH_INFO: `/v3/projects/c83d21ab069d4b49a4f0e37a8444e10a/users/c2bdf76f762d44a79547a3252955a4f0/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:55.954104 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3286fc-a5c6-42a6-a8f8-f45ede9ca779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83d21ab069d4b49a4f0e37a8444e10a, user_id=c2bdf76f762d44a79547a3252955a4f0, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:55.958714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3286fc-a5c6-42a6-a8f8-f45ede9ca779 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:56.090673 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1308/2597] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:55 2022] PUT /identity/v3/projects/c83d21ab069d4b49a4f0e37a8444e10a/users/c2bdf76f762d44a79547a3252955a4f0/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:07:56.095615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25167970-d148-4bd7-bc59-1ce1b8256fa9 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:56.105624 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25167970-d148-4bd7-bc59-1ce1b8256fa9 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:56.166471 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a429911-f73d-4617-9978-bf5d13a9c8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:56.167146 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a429911-f73d-4617-9978-bf5d13a9c8dc admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:56.167432 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a429911-f73d-4617-9978-bf5d13a9c8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:56.167737 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a429911-f73d-4617-9978-bf5d13a9c8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:56.168466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a429911-f73d-4617-9978-bf5d13a9c8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:56.170071 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a429911-f73d-4617-9978-bf5d13a9c8dc admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:56.180825 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1290/2598] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:56.185057 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3286fc-a5c6-42a6-a8f8-f45ede9ca779 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:56.195795 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3286fc-a5c6-42a6-a8f8-f45ede9ca779 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:56.200434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c131f6-d11f-4ee8-960b-637a24ef2146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:56.201330 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c131f6-d11f-4ee8-960b-637a24ef2146 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:56.205080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c131f6-d11f-4ee8-960b-637a24ef2146 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:56.205080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c131f6-d11f-4ee8-960b-637a24ef2146 admin admin] PATH_INFO: `/v3/projects/c83d21ab069d4b49a4f0e37a8444e10a/users/c2bdf76f762d44a79547a3252955a4f0/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:56.205080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c131f6-d11f-4ee8-960b-637a24ef2146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83d21ab069d4b49a4f0e37a8444e10a, user_id=c2bdf76f762d44a79547a3252955a4f0, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:56.206634 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c131f6-d11f-4ee8-960b-637a24ef2146 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:56.217585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1309/2599] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:56 2022] PUT /identity/v3/projects/c83d21ab069d4b49a4f0e37a8444e10a/users/c2bdf76f762d44a79547a3252955a4f0/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:56.227802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d5cdf-6408-40c8-9337-3b7a137a5fcd None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:56.228095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d5cdf-6408-40c8-9337-3b7a137a5fcd None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:56.228376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d5cdf-6408-40c8-9337-3b7a137a5fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:56.257375 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-210d5cdf-6408-40c8-9337-3b7a137a5fcd None None] MFA Rules not processed for user `c2bdf76f762d44a79547a3252955a4f0`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:56.258657 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-210d5cdf-6408-40c8-9337-3b7a137a5fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:56.327314 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1291/2600] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:56.338159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c131f6-d11f-4ee8-960b-637a24ef2146 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:56.340370 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-75c131f6-d11f-4ee8-960b-637a24ef2146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:56.344682 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d5cdf-6408-40c8-9337-3b7a137a5fcd None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:56.344682 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-210d5cdf-6408-40c8-9337-3b7a137a5fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:56.389346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:56.406968 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c131f6-d11f-4ee8-960b-637a24ef2146 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:56.410770 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f75bf9-c6a2-47d8-a4bb-52d1fd236bef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:56.411508 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75bf9-c6a2-47d8-a4bb-52d1fd236bef service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:56.411793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75bf9-c6a2-47d8-a4bb-52d1fd236bef service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:56.412065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75bf9-c6a2-47d8-a4bb-52d1fd236bef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:56.413905 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-56f75bf9-c6a2-47d8-a4bb-52d1fd236bef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:56.415770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d5cdf-6408-40c8-9337-3b7a137a5fcd None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:56.421655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cd5a4-1951-431f-838d-cf243fbb686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:56.422588 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd5a4-1951-431f-838d-cf243fbb686d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:56.424809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd5a4-1951-431f-838d-cf243fbb686d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:56.424809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd5a4-1951-431f-838d-cf243fbb686d admin admin] PATH_INFO: `/v3/projects/f5481eb2b45a404cb34094165863caca` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:56.424809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cd5a4-1951-431f-838d-cf243fbb686d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5481eb2b45a404cb34094165863caca)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:56.427128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cd5a4-1951-431f-838d-cf243fbb686d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:56.436664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:56.475998 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f75bf9-c6a2-47d8-a4bb-52d1fd236bef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:56.477435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f75bf9-c6a2-47d8-a4bb-52d1fd236bef service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:56.487420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1310/2601] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:56.544969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-975cd5a4-1951-431f-838d-cf243fbb686d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5481eb2b45a404cb34094165863caca', 'request_id': 'req-975cd5a4-1951-431f-838d-cf243fbb686d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:56.630255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-975cd5a4-1951-431f-838d-cf243fbb686d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5481eb2b45a404cb34094165863caca', 'request_id': 'req-975cd5a4-1951-431f-838d-cf243fbb686d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:56.636880 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-975cd5a4-1951-431f-838d-cf243fbb686d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5481eb2b45a404cb34094165863caca', 'request_id': 'req-975cd5a4-1951-431f-838d-cf243fbb686d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:56.647299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-975cd5a4-1951-431f-838d-cf243fbb686d admin admin] The token cache is being invalidate because project f5481eb2b45a404cb34094165863caca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:07:56.647623 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-975cd5a4-1951-431f-838d-cf243fbb686d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:56.648271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-975cd5a4-1951-431f-838d-cf243fbb686d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:56.649841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1292/2602] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:07:56 2022] DELETE /identity/v3/projects/f5481eb2b45a404cb34094165863caca => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:56.655219 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3142a0-326c-4739-bf07-eace2ec3d7a9 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:56.655530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3142a0-326c-4739-bf07-eace2ec3d7a9 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:56.655805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3142a0-326c-4739-bf07-eace2ec3d7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:56.674421 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-4c3142a0-326c-4739-bf07-eace2ec3d7a9 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:56.675637 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4c3142a0-326c-4739-bf07-eace2ec3d7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:56.733323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1311/2603] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:56.741578 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c20f09-8b52-41da-8be7-dd1f1821d0f6 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:56.741879 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c20f09-8b52-41da-8be7-dd1f1821d0f6 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:56.742158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c20f09-8b52-41da-8be7-dd1f1821d0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:56.760250 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-00c20f09-8b52-41da-8be7-dd1f1821d0f6 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:56.761422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-00c20f09-8b52-41da-8be7-dd1f1821d0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:56.769691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1293/2604] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:07:56.773930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3142a0-326c-4739-bf07-eace2ec3d7a9 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:56.784188 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3142a0-326c-4739-bf07-eace2ec3d7a9 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:56.788855 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad235f-db70-4d13-8de8-568a46a322b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:56.789509 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad235f-db70-4d13-8de8-568a46a322b3 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:56.789818 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad235f-db70-4d13-8de8-568a46a322b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:56.790095 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad235f-db70-4d13-8de8-568a46a322b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:56.790851 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad235f-db70-4d13-8de8-568a46a322b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:07:56.791162 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad235f-db70-4d13-8de8-568a46a322b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:56.792823 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad235f-db70-4d13-8de8-568a46a322b3 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:56.805117 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1312/2605] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:07:56.809284 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c20f09-8b52-41da-8be7-dd1f1821d0f6 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:56.818389 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c20f09-8b52-41da-8be7-dd1f1821d0f6 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:56.823110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b3cd6-3906-4670-93fb-062909a0c008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:56.823790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b3cd6-3906-4670-93fb-062909a0c008 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:56.824078 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b3cd6-3906-4670-93fb-062909a0c008 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:56.824357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b3cd6-3906-4670-93fb-062909a0c008 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:56.825063 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b3cd6-3906-4670-93fb-062909a0c008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:56.827508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b3cd6-3906-4670-93fb-062909a0c008 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:56.989187 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1294/2606] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:56 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:56.993300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad235f-db70-4d13-8de8-568a46a322b3 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:57.003006 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad235f-db70-4d13-8de8-568a46a322b3 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:57.061068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa91dc-53a2-42c5-85d8-1b2ffd5a0c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:57.065296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa91dc-53a2-42c5-85d8-1b2ffd5a0c0f admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:57.065296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa91dc-53a2-42c5-85d8-1b2ffd5a0c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:57.065296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa91dc-53a2-42c5-85d8-1b2ffd5a0c0f admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:57.065296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa91dc-53a2-42c5-85d8-1b2ffd5a0c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:57.065296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa91dc-53a2-42c5-85d8-1b2ffd5a0c0f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:57.147151 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1313/2607] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:56 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:57.151201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b3cd6-3906-4670-93fb-062909a0c008 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:57.162380 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b3cd6-3906-4670-93fb-062909a0c008 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:57.167054 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a700f8b-52d2-455c-a993-0c5618270193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:57.167736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a700f8b-52d2-455c-a993-0c5618270193 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:57.168023 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a700f8b-52d2-455c-a993-0c5618270193 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:57.168302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a700f8b-52d2-455c-a993-0c5618270193 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:57.169059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a700f8b-52d2-455c-a993-0c5618270193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:57.170647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a700f8b-52d2-455c-a993-0c5618270193 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:57.180947 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1295/2608] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:57.184747 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa91dc-53a2-42c5-85d8-1b2ffd5a0c0f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:57.195059 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa91dc-53a2-42c5-85d8-1b2ffd5a0c0f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:57.199625 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9789819-8868-43e8-b610-3a2916b6cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:57.200328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789819-8868-43e8-b610-3a2916b6cfcf admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:57.200559 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789819-8868-43e8-b610-3a2916b6cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:57.200833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789819-8868-43e8-b610-3a2916b6cfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:57.202149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9789819-8868-43e8-b610-3a2916b6cfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:57.203764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9789819-8868-43e8-b610-3a2916b6cfcf admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:57.214032 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1314/2609] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:57.217994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a700f8b-52d2-455c-a993-0c5618270193 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:57.228628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a700f8b-52d2-455c-a993-0c5618270193 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:57.233886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36959fb-4c40-4867-9339-ec79457ab739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:57.240976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36959fb-4c40-4867-9339-ec79457ab739 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:57.240976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36959fb-4c40-4867-9339-ec79457ab739 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:57.240976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36959fb-4c40-4867-9339-ec79457ab739 admin admin] PATH_INFO: `/v3/projects/8c24de3e757440b5a51f9547bb3d1923/users/f91374a0875d4804a14d216cf4c8313d/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:57.251691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36959fb-4c40-4867-9339-ec79457ab739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c24de3e757440b5a51f9547bb3d1923, user_id=f91374a0875d4804a14d216cf4c8313d, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:57.254706 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36959fb-4c40-4867-9339-ec79457ab739 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:57.319434 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1296/2610] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:57 2022] PUT /identity/v3/projects/8c24de3e757440b5a51f9547bb3d1923/users/f91374a0875d4804a14d216cf4c8313d/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:57.331639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91fe1b-45bb-48a3-8a0a-59b94ad390cb None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:57.331930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91fe1b-45bb-48a3-8a0a-59b94ad390cb None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:57.332233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91fe1b-45bb-48a3-8a0a-59b94ad390cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:57.359838 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-2d91fe1b-45bb-48a3-8a0a-59b94ad390cb None None] MFA Rules not processed for user `f91374a0875d4804a14d216cf4c8313d`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:57.361086 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2d91fe1b-45bb-48a3-8a0a-59b94ad390cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:57.378048 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:57.434379 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1315/2611] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:57.439688 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36959fb-4c40-4867-9339-ec79457ab739 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:57.501762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36959fb-4c40-4867-9339-ec79457ab739 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:57.506564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f0114-4288-4a6c-a505-d3e074d415b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:57.507216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f0114-4288-4a6c-a505-d3e074d415b7 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:57.507537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f0114-4288-4a6c-a505-d3e074d415b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:57.507815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f0114-4288-4a6c-a505-d3e074d415b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:57.508526 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f0114-4288-4a6c-a505-d3e074d415b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:57.510433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f0114-4288-4a6c-a505-d3e074d415b7 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:57.519141 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:57.588437 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1297/2612] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:57 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:57.592505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91fe1b-45bb-48a3-8a0a-59b94ad390cb None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:57.603109 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91fe1b-45bb-48a3-8a0a-59b94ad390cb None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:57.659625 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac154be-d86f-46b9-b721-306b635e44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:57.660288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac154be-d86f-46b9-b721-306b635e44df admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:57.660567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac154be-d86f-46b9-b721-306b635e44df admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:57.660837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac154be-d86f-46b9-b721-306b635e44df admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:57.661526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac154be-d86f-46b9-b721-306b635e44df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:57.663435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac154be-d86f-46b9-b721-306b635e44df admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:57.747234 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1316/2613] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:57 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:57.751963 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f0114-4288-4a6c-a505-d3e074d415b7 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:57.762303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f0114-4288-4a6c-a505-d3e074d415b7 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:57.767120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9140a-9444-439c-ae56-f9b917228ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:57.767938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9140a-9444-439c-ae56-f9b917228ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:57.768223 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9140a-9444-439c-ae56-f9b917228ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:57.768499 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9140a-9444-439c-ae56-f9b917228ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:57.769219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9140a-9444-439c-ae56-f9b917228ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:57.770834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9140a-9444-439c-ae56-f9b917228ed4 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:57.781224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1298/2614] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:57.785201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac154be-d86f-46b9-b721-306b635e44df admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:57.795575 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac154be-d86f-46b9-b721-306b635e44df admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:57.800209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad937c10-6001-4f46-a8a5-6d73b1de5a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:57.801080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad937c10-6001-4f46-a8a5-6d73b1de5a02 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:57.801368 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad937c10-6001-4f46-a8a5-6d73b1de5a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:57.801642 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad937c10-6001-4f46-a8a5-6d73b1de5a02 admin admin] PATH_INFO: `/v3/projects/2a6f3565dfe84a7d98c7d96182233acd/users/f33d1bef32b14f3d992f12ef96c3abda/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:57.816784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad937c10-6001-4f46-a8a5-6d73b1de5a02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a6f3565dfe84a7d98c7d96182233acd, user_id=f33d1bef32b14f3d992f12ef96c3abda, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:57.819445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad937c10-6001-4f46-a8a5-6d73b1de5a02 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:57.924856 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1317/2615] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:57 2022] PUT /identity/v3/projects/2a6f3565dfe84a7d98c7d96182233acd/users/f33d1bef32b14f3d992f12ef96c3abda/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:07:57.928994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9140a-9444-439c-ae56-f9b917228ed4 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:57.938811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9140a-9444-439c-ae56-f9b917228ed4 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:57.995015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84c57e-3129-43e9-abd5-04793d3f01f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:57.995703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84c57e-3129-43e9-abd5-04793d3f01f1 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:57.995991 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84c57e-3129-43e9-abd5-04793d3f01f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:57.996265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84c57e-3129-43e9-abd5-04793d3f01f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:58.003499 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84c57e-3129-43e9-abd5-04793d3f01f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:58.003499 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84c57e-3129-43e9-abd5-04793d3f01f1 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:58.008086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1299/2616] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:58.012279 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad937c10-6001-4f46-a8a5-6d73b1de5a02 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:58.022681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad937c10-6001-4f46-a8a5-6d73b1de5a02 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:58.027377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9745a-d76d-4ba1-bd9e-e4b44d913137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:58.032215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9745a-d76d-4ba1-bd9e-e4b44d913137 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:58.032215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9745a-d76d-4ba1-bd9e-e4b44d913137 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:58.032215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9745a-d76d-4ba1-bd9e-e4b44d913137 admin admin] PATH_INFO: `/v3/projects/2a6f3565dfe84a7d98c7d96182233acd/users/f33d1bef32b14f3d992f12ef96c3abda/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:58.032215 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9745a-d76d-4ba1-bd9e-e4b44d913137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a6f3565dfe84a7d98c7d96182233acd, user_id=f33d1bef32b14f3d992f12ef96c3abda, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:58.033950 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9745a-d76d-4ba1-bd9e-e4b44d913137 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:58.044270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1318/2617] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:58 2022] PUT /identity/v3/projects/2a6f3565dfe84a7d98c7d96182233acd/users/f33d1bef32b14f3d992f12ef96c3abda/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:07:58.055041 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aca20-7637-4ef3-b939-e4b5129f4a78 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:58.055327 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aca20-7637-4ef3-b939-e4b5129f4a78 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:58.055708 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aca20-7637-4ef3-b939-e4b5129f4a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:58.081885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-510aca20-7637-4ef3-b939-e4b5129f4a78 None None] MFA Rules not processed for user `f33d1bef32b14f3d992f12ef96c3abda`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:58.083163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-510aca20-7637-4ef3-b939-e4b5129f4a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:58.151778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1300/2618] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:58.163311 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9745a-d76d-4ba1-bd9e-e4b44d913137 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:58.164995 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c3d9745a-d76d-4ba1-bd9e-e4b44d913137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:58.220196 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9745a-d76d-4ba1-bd9e-e4b44d913137 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:58.223835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85676b-92d9-45c2-8ee5-ab347f8688f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:58.224465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85676b-92d9-45c2-8ee5-ab347f8688f8 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:58.224749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85676b-92d9-45c2-8ee5-ab347f8688f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:58.225024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85676b-92d9-45c2-8ee5-ab347f8688f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:58.234065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85676b-92d9-45c2-8ee5-ab347f8688f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:58.235524 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85676b-92d9-45c2-8ee5-ab347f8688f8 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:58.244722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1319/2619] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:59.439021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aca20-7637-4ef3-b939-e4b5129f4a78 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:59.634233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aca20-7637-4ef3-b939-e4b5129f4a78 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:59.638704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87113139-435d-45c6-9f45-262f6982f9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:59.639681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87113139-435d-45c6-9f45-262f6982f9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:59.639963 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87113139-435d-45c6-9f45-262f6982f9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:59.640347 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87113139-435d-45c6-9f45-262f6982f9fe admin admin] PATH_INFO: `/v3/users/f91374a0875d4804a14d216cf4c8313d` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:59.641546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87113139-435d-45c6-9f45-262f6982f9fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f91374a0875d4804a14d216cf4c8313d)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:59.643469 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87113139-435d-45c6-9f45-262f6982f9fe admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:59.644960 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:59.839574 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85676b-92d9-45c2-8ee5-ab347f8688f8 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:59.849296 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85676b-92d9-45c2-8ee5-ab347f8688f8 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:59.853182 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfb1bc-8cb5-41bb-adfa-4598837f28e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:59.853890 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb1bc-8cb5-41bb-adfa-4598837f28e0 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:59.854254 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb1bc-8cb5-41bb-adfa-4598837f28e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:59.854603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb1bc-8cb5-41bb-adfa-4598837f28e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:59.856481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a8dfb1bc-8cb5-41bb-adfa-4598837f28e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:59.868994 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:59.876092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-87113139-435d-45c6-9f45-262f6982f9fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f91374a0875d4804a14d216cf4c8313d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:59.891943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-87113139-435d-45c6-9f45-262f6982f9fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f91374a0875d4804a14d216cf4c8313d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:59.905797 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-87113139-435d-45c6-9f45-262f6982f9fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f91374a0875d4804a14d216cf4c8313d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:59.905797 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-87113139-435d-45c6-9f45-262f6982f9fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f91374a0875d4804a14d216cf4c8313d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:59.929249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfb1bc-8cb5-41bb-adfa-4598837f28e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:59.930761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfb1bc-8cb5-41bb-adfa-4598837f28e0 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:59.940387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1320/2620] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:07:59.984582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-87113139-435d-45c6-9f45-262f6982f9fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f91374a0875d4804a14d216cf4c8313d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:59.990838 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1301/2621] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:59 2022] DELETE /identity/v3/users/f91374a0875d4804a14d216cf4c8313d => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:59.995434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513248-4622-417a-9891-fe113d40b513 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:59.995765 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513248-4622-417a-9891-fe113d40b513 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:59.996047 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513248-4622-417a-9891-fe113d40b513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:00.012740 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-be513248-4622-417a-9891-fe113d40b513 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:00.014373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-be513248-4622-417a-9891-fe113d40b513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:00.071008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1321/2622] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:00.081081 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87113139-435d-45c6-9f45-262f6982f9fe admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:00.082565 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-87113139-435d-45c6-9f45-262f6982f9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:00.146957 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87113139-435d-45c6-9f45-262f6982f9fe admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:00.150554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b4d7e-d1dd-49c2-841a-ed804c5bd73f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:00.151193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b4d7e-d1dd-49c2-841a-ed804c5bd73f service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:00.151565 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b4d7e-d1dd-49c2-841a-ed804c5bd73f service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:00.151842 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b4d7e-d1dd-49c2-841a-ed804c5bd73f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:00.161262 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b4d7e-d1dd-49c2-841a-ed804c5bd73f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:00.162691 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b4d7e-d1dd-49c2-841a-ed804c5bd73f service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:00.172433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1302/2623] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:00.645870 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be513248-4622-417a-9891-fe113d40b513 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:00.649495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-be513248-4622-417a-9891-fe113d40b513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:00.662905 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be513248-4622-417a-9891-fe113d40b513 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:00.668656 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:00.669529 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:00.669815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:00.670641 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] PATH_INFO: `/v3/projects/8c24de3e757440b5a51f9547bb3d1923` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:00.671906 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c24de3e757440b5a51f9547bb3d1923)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:00.673836 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:00.786961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c24de3e757440b5a51f9547bb3d1923', 'request_id': 'req-85998ef3-d25e-49d1-b861-aa1f3e718560'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:00.901649 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c24de3e757440b5a51f9547bb3d1923', 'request_id': 'req-85998ef3-d25e-49d1-b861-aa1f3e718560'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:00.908647 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c24de3e757440b5a51f9547bb3d1923', 'request_id': 'req-85998ef3-d25e-49d1-b861-aa1f3e718560'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:00.919023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] The token cache is being invalidate because project 8c24de3e757440b5a51f9547bb3d1923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:08:00.919313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:00.919982 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:00.921522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1322/2624] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:08:00 2022] DELETE /identity/v3/projects/8c24de3e757440b5a51f9547bb3d1923 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:00.925500 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b4d7e-d1dd-49c2-841a-ed804c5bd73f service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:00.935035 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b4d7e-d1dd-49c2-841a-ed804c5bd73f service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:00.990794 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfd01a-a34b-432e-a241-c8555a4b09ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:00.991770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd01a-a34b-432e-a241-c8555a4b09ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:00.992058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd01a-a34b-432e-a241-c8555a4b09ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:00.992329 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd01a-a34b-432e-a241-c8555a4b09ab admin admin] PATH_INFO: `/v3/users/f33d1bef32b14f3d992f12ef96c3abda` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:00.993669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfd01a-a34b-432e-a241-c8555a4b09ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33d1bef32b14f3d992f12ef96c3abda)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:00.995672 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfd01a-a34b-432e-a241-c8555a4b09ab admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:01.018750 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:01.249310 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-92bfd01a-a34b-432e-a241-c8555a4b09ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33d1bef32b14f3d992f12ef96c3abda'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:01.261547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-92bfd01a-a34b-432e-a241-c8555a4b09ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33d1bef32b14f3d992f12ef96c3abda'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:01.269302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-92bfd01a-a34b-432e-a241-c8555a4b09ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33d1bef32b14f3d992f12ef96c3abda'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:01.270025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-92bfd01a-a34b-432e-a241-c8555a4b09ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33d1bef32b14f3d992f12ef96c3abda'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:01.347144 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-92bfd01a-a34b-432e-a241-c8555a4b09ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33d1bef32b14f3d992f12ef96c3abda'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:01.353426 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1303/2625] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:08:00 2022] DELETE /identity/v3/users/f33d1bef32b14f3d992f12ef96c3abda => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:01.820626 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:01.822174 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:01.837346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85998ef3-d25e-49d1-b861-aa1f3e718560 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:01.870959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:01.900562 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf62cc-de75-465e-829e-527b641a8472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:01.901418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf62cc-de75-465e-829e-527b641a8472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:01.901701 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf62cc-de75-465e-829e-527b641a8472 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:01.902279 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf62cc-de75-465e-829e-527b641a8472 admin admin] PATH_INFO: `/v3/projects/2a6f3565dfe84a7d98c7d96182233acd` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:01.903156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf62cc-de75-465e-829e-527b641a8472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a6f3565dfe84a7d98c7d96182233acd)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:01.905672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf62cc-de75-465e-829e-527b641a8472 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:02.073022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a1bf62cc-de75-465e-829e-527b641a8472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a6f3565dfe84a7d98c7d96182233acd', 'request_id': 'req-a1bf62cc-de75-465e-829e-527b641a8472'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:02.167284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a1bf62cc-de75-465e-829e-527b641a8472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a6f3565dfe84a7d98c7d96182233acd', 'request_id': 'req-a1bf62cc-de75-465e-829e-527b641a8472'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:02.173977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a1bf62cc-de75-465e-829e-527b641a8472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a6f3565dfe84a7d98c7d96182233acd', 'request_id': 'req-a1bf62cc-de75-465e-829e-527b641a8472'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:02.185017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a1bf62cc-de75-465e-829e-527b641a8472 admin admin] The token cache is being invalidate because project 2a6f3565dfe84a7d98c7d96182233acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:08:02.185309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a1bf62cc-de75-465e-829e-527b641a8472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:02.185969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-a1bf62cc-de75-465e-829e-527b641a8472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:02.187565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1323/2626] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:08:01 2022] DELETE /identity/v3/projects/2a6f3565dfe84a7d98c7d96182233acd => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:08:02.192458 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bd8a1-349a-43c2-b5c1-58cfbc654458 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:02.192911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bd8a1-349a-43c2-b5c1-58cfbc654458 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:02.193039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bd8a1-349a-43c2-b5c1-58cfbc654458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:02.211732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f64bd8a1-349a-43c2-b5c1-58cfbc654458 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:02.216401 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f64bd8a1-349a-43c2-b5c1-58cfbc654458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:02.274861 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1304/2627] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:08:02.284244 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a511d25-032b-4d3a-8d51-14f5c800aef9 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:02.293576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a511d25-032b-4d3a-8d51-14f5c800aef9 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:02.293576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a511d25-032b-4d3a-8d51-14f5c800aef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:02.302972 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-2a511d25-032b-4d3a-8d51-14f5c800aef9 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:02.304218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2a511d25-032b-4d3a-8d51-14f5c800aef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:02.312589 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1324/2628] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:02.316811 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bd8a1-349a-43c2-b5c1-58cfbc654458 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:02.327243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bd8a1-349a-43c2-b5c1-58cfbc654458 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:02.331813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac321528-9d7b-4b43-8d27-336ec3612187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:02.332465 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac321528-9d7b-4b43-8d27-336ec3612187 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:02.332747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac321528-9d7b-4b43-8d27-336ec3612187 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:02.333018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac321528-9d7b-4b43-8d27-336ec3612187 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:02.333733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac321528-9d7b-4b43-8d27-336ec3612187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:08:02.334085 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac321528-9d7b-4b43-8d27-336ec3612187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:02.335705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac321528-9d7b-4b43-8d27-336ec3612187 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:02.348278 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1305/2629] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:08:02.352884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a511d25-032b-4d3a-8d51-14f5c800aef9 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:02.362451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a511d25-032b-4d3a-8d51-14f5c800aef9 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:02.367317 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a2339-a1a1-4967-9463-6921bd497496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:02.368011 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a2339-a1a1-4967-9463-6921bd497496 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:02.368324 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a2339-a1a1-4967-9463-6921bd497496 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:02.368600 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a2339-a1a1-4967-9463-6921bd497496 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:02.369339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a2339-a1a1-4967-9463-6921bd497496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:02.371270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a2339-a1a1-4967-9463-6921bd497496 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:02.460849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1325/2630] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:08:02 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:08:02.462040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac321528-9d7b-4b43-8d27-336ec3612187 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:02.472106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac321528-9d7b-4b43-8d27-336ec3612187 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:02.530464 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c3c1b-48b1-4dcf-8a13-1c54dc306e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:02.531135 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c3c1b-48b1-4dcf-8a13-1c54dc306e4d admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:02.531422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c3c1b-48b1-4dcf-8a13-1c54dc306e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:02.531742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c3c1b-48b1-4dcf-8a13-1c54dc306e4d admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:02.532423 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c3c1b-48b1-4dcf-8a13-1c54dc306e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:02.534380 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c3c1b-48b1-4dcf-8a13-1c54dc306e4d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:02.640021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1306/2631] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:08:02 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:08:02.644094 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a2339-a1a1-4967-9463-6921bd497496 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:02.654762 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a2339-a1a1-4967-9463-6921bd497496 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:02.659431 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeef95-3f85-4e91-b5a4-5eb661fa7bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:02.660159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeef95-3f85-4e91-b5a4-5eb661fa7bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:02.660445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeef95-3f85-4e91-b5a4-5eb661fa7bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:02.660722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeef95-3f85-4e91-b5a4-5eb661fa7bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:02.661544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eeef95-3f85-4e91-b5a4-5eb661fa7bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:02.663240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eeef95-3f85-4e91-b5a4-5eb661fa7bd2 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:02.674912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1326/2632] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:02.679005 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c3c1b-48b1-4dcf-8a13-1c54dc306e4d admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:02.689910 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c3c1b-48b1-4dcf-8a13-1c54dc306e4d admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:02.694656 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295b2d8-77db-4a61-80b9-a5cca28cab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:02.704697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295b2d8-77db-4a61-80b9-a5cca28cab7f admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:02.704697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295b2d8-77db-4a61-80b9-a5cca28cab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:02.704697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295b2d8-77db-4a61-80b9-a5cca28cab7f admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:02.704697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295b2d8-77db-4a61-80b9-a5cca28cab7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:02.704697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295b2d8-77db-4a61-80b9-a5cca28cab7f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:02.711993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1307/2633] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:02.714062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeef95-3f85-4e91-b5a4-5eb661fa7bd2 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:02.724958 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeef95-3f85-4e91-b5a4-5eb661fa7bd2 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:02.729789 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a5e23-36c8-41b5-b534-a21579243dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:02.730742 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a5e23-36c8-41b5-b534-a21579243dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:02.731095 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a5e23-36c8-41b5-b534-a21579243dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:02.731439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a5e23-36c8-41b5-b534-a21579243dc5 admin admin] PATH_INFO: `/v3/projects/29b7e81bc2364be88b31da74346e1dd4/users/6713ce1661ac4511a71d5d3c95fdcfc9/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:02.746622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a5e23-36c8-41b5-b534-a21579243dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b7e81bc2364be88b31da74346e1dd4, user_id=6713ce1661ac4511a71d5d3c95fdcfc9, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:02.749932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a5e23-36c8-41b5-b534-a21579243dc5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:02.836673 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1327/2634] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:02 2022] PUT /identity/v3/projects/29b7e81bc2364be88b31da74346e1dd4/users/6713ce1661ac4511a71d5d3c95fdcfc9/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:02.847043 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b107301-7069-43a5-b1f2-9da75ac6e5c1 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:02.847769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b107301-7069-43a5-b1f2-9da75ac6e5c1 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:02.848385 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b107301-7069-43a5-b1f2-9da75ac6e5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:02.863515 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:02.880083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-3b107301-7069-43a5-b1f2-9da75ac6e5c1 None None] MFA Rules not processed for user `6713ce1661ac4511a71d5d3c95fdcfc9`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:02.881436 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3b107301-7069-43a5-b1f2-9da75ac6e5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:02.948597 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1308/2635] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:02.952980 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a5e23-36c8-41b5-b534-a21579243dc5 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:03.014825 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:03.018603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a5e23-36c8-41b5-b534-a21579243dc5 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:03.023329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d4877-4854-4202-a298-5308a0867d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:03.024014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d4877-4854-4202-a298-5308a0867d0d admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:03.024297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d4877-4854-4202-a298-5308a0867d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:03.024569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d4877-4854-4202-a298-5308a0867d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:03.025260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d4877-4854-4202-a298-5308a0867d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:03.027435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d4877-4854-4202-a298-5308a0867d0d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:03.163574 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1328/2636] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:08:02 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:08:03.167618 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b107301-7069-43a5-b1f2-9da75ac6e5c1 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:03.186036 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b107301-7069-43a5-b1f2-9da75ac6e5c1 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:03.285767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed1067-e80d-4113-bffa-14a6df6d517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:03.286437 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed1067-e80d-4113-bffa-14a6df6d517b admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:03.286721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed1067-e80d-4113-bffa-14a6df6d517b admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:03.286992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed1067-e80d-4113-bffa-14a6df6d517b admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:03.288383 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed1067-e80d-4113-bffa-14a6df6d517b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:03.290734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed1067-e80d-4113-bffa-14a6df6d517b admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:03.389118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1309/2637] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:08:03 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:08:03.393281 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d4877-4854-4202-a298-5308a0867d0d admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:03.404815 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d4877-4854-4202-a298-5308a0867d0d admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:03.410977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2c81d-e5d3-48df-9fa2-0e624a58941e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:03.411932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2c81d-e5d3-48df-9fa2-0e624a58941e admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:03.416517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2c81d-e5d3-48df-9fa2-0e624a58941e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:03.416517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2c81d-e5d3-48df-9fa2-0e624a58941e admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:03.416517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2c81d-e5d3-48df-9fa2-0e624a58941e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:03.416517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2c81d-e5d3-48df-9fa2-0e624a58941e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:03.427773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1329/2638] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:03.431920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed1067-e80d-4113-bffa-14a6df6d517b admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:03.442547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed1067-e80d-4113-bffa-14a6df6d517b admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:03.447415 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30f635-fa2b-425c-a473-eeca6af79fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:03.448422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30f635-fa2b-425c-a473-eeca6af79fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:03.448779 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30f635-fa2b-425c-a473-eeca6af79fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:03.449287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30f635-fa2b-425c-a473-eeca6af79fcf admin admin] PATH_INFO: `/v3/projects/cf1feeaf05d24b669661d0560f921196/users/cc1385e851f94395a18a87a20f10d3f0/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:03.465769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30f635-fa2b-425c-a473-eeca6af79fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf1feeaf05d24b669661d0560f921196, user_id=cc1385e851f94395a18a87a20f10d3f0, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:03.469386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30f635-fa2b-425c-a473-eeca6af79fcf admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:03.544781 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1310/2639] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:03 2022] PUT /identity/v3/projects/cf1feeaf05d24b669661d0560f921196/users/cc1385e851f94395a18a87a20f10d3f0/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:03.549360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2c81d-e5d3-48df-9fa2-0e624a58941e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:03.559604 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2c81d-e5d3-48df-9fa2-0e624a58941e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:03.617896 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42ca9e-7c73-44fb-9382-15587e0c065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:03.618565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42ca9e-7c73-44fb-9382-15587e0c065a admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:03.618849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42ca9e-7c73-44fb-9382-15587e0c065a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:03.619123 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42ca9e-7c73-44fb-9382-15587e0c065a admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:03.620073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42ca9e-7c73-44fb-9382-15587e0c065a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:03.621695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42ca9e-7c73-44fb-9382-15587e0c065a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:03.639747 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1330/2640] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:03.640872 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30f635-fa2b-425c-a473-eeca6af79fcf admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:03.652775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30f635-fa2b-425c-a473-eeca6af79fcf admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:03.658991 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689ba6c-67a9-4339-b1ea-48cf8cd57d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:03.660564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689ba6c-67a9-4339-b1ea-48cf8cd57d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:03.660832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689ba6c-67a9-4339-b1ea-48cf8cd57d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:03.661105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689ba6c-67a9-4339-b1ea-48cf8cd57d0f admin admin] PATH_INFO: `/v3/projects/cf1feeaf05d24b669661d0560f921196/users/cc1385e851f94395a18a87a20f10d3f0/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:03.663722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689ba6c-67a9-4339-b1ea-48cf8cd57d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf1feeaf05d24b669661d0560f921196, user_id=cc1385e851f94395a18a87a20f10d3f0, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:03.671892 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689ba6c-67a9-4339-b1ea-48cf8cd57d0f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:03.678341 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1311/2641] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:03 2022] PUT /identity/v3/projects/cf1feeaf05d24b669661d0560f921196/users/cc1385e851f94395a18a87a20f10d3f0/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:03.688849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad01172-38d7-482d-8235-835a19655d9b None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:03.695463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad01172-38d7-482d-8235-835a19655d9b None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:03.695463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad01172-38d7-482d-8235-835a19655d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:03.717575 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-6ad01172-38d7-482d-8235-835a19655d9b None None] MFA Rules not processed for user `cc1385e851f94395a18a87a20f10d3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:03.718775 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6ad01172-38d7-482d-8235-835a19655d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:03.789751 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1331/2642] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:03.800744 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689ba6c-67a9-4339-b1ea-48cf8cd57d0f admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:03.802508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4689ba6c-67a9-4339-b1ea-48cf8cd57d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:03.870563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:03.874582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689ba6c-67a9-4339-b1ea-48cf8cd57d0f admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:03.878457 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23633f-751b-43f9-a121-94d39ad60f35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:03.879246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23633f-751b-43f9-a121-94d39ad60f35 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:03.879558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23633f-751b-43f9-a121-94d39ad60f35 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:03.879832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23633f-751b-43f9-a121-94d39ad60f35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:03.937399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23633f-751b-43f9-a121-94d39ad60f35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:03.938851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23633f-751b-43f9-a121-94d39ad60f35 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:03.948122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1312/2643] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:10.394695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad01172-38d7-482d-8235-835a19655d9b None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:10.396223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6ad01172-38d7-482d-8235-835a19655d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:10.408397 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad01172-38d7-482d-8235-835a19655d9b None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:10.412039 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12f84d-b346-434e-bc7e-c9687048275d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:10.412682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12f84d-b346-434e-bc7e-c9687048275d service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:10.412966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12f84d-b346-434e-bc7e-c9687048275d service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:10.413639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12f84d-b346-434e-bc7e-c9687048275d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:10.423288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12f84d-b346-434e-bc7e-c9687048275d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:10.424771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12f84d-b346-434e-bc7e-c9687048275d service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:10.434511 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1332/2644] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:14.164458 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=26 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:16.195404 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23633f-751b-43f9-a121-94d39ad60f35 service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:16.197049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-bf23633f-751b-43f9-a121-94d39ad60f35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:16.268017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23633f-751b-43f9-a121-94d39ad60f35 service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:16.273797 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b873b9-2135-490f-a118-37152b9f73ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:16.274678 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b873b9-2135-490f-a118-37152b9f73ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:16.274962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b873b9-2135-490f-a118-37152b9f73ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:16.276563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b873b9-2135-490f-a118-37152b9f73ed admin admin] PATH_INFO: `/v3/users/e4fedb338834493887609d5f2c26f47e` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:16.276563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b873b9-2135-490f-a118-37152b9f73ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4fedb338834493887609d5f2c26f47e)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:16.278388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b873b9-2135-490f-a118-37152b9f73ed admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:16.597647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-37b873b9-2135-490f-a118-37152b9f73ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4fedb338834493887609d5f2c26f47e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:16.610264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-37b873b9-2135-490f-a118-37152b9f73ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4fedb338834493887609d5f2c26f47e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:16.617870 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-37b873b9-2135-490f-a118-37152b9f73ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4fedb338834493887609d5f2c26f47e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:16.618551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-37b873b9-2135-490f-a118-37152b9f73ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4fedb338834493887609d5f2c26f47e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:16.824564 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-37b873b9-2135-490f-a118-37152b9f73ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4fedb338834493887609d5f2c26f47e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:16.831521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1313/2645] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:08:16 2022] DELETE /identity/v3/users/e4fedb338834493887609d5f2c26f47e => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:16.837022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad6418-766f-4293-89e3-8998454e882f None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:16.837510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad6418-766f-4293-89e3-8998454e882f None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:16.837785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad6418-766f-4293-89e3-8998454e882f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:16.855859 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-4fad6418-766f-4293-89e3-8998454e882f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:16.857330 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4fad6418-766f-4293-89e3-8998454e882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:16.894440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:16.919934 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1333/2646] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:16.929884 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b873b9-2135-490f-a118-37152b9f73ed admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:16.931610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-37b873b9-2135-490f-a118-37152b9f73ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:16.993238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b873b9-2135-490f-a118-37152b9f73ed admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:16.996912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e6154-78f3-4c52-986f-a7425991ab0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:16.997553 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e6154-78f3-4c52-986f-a7425991ab0e service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:16.997839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e6154-78f3-4c52-986f-a7425991ab0e service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:16.998112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e6154-78f3-4c52-986f-a7425991ab0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:17.007839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e6154-78f3-4c52-986f-a7425991ab0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:17.009254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e6154-78f3-4c52-986f-a7425991ab0e service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:17.018644 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1314/2647] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:17.612784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad6418-766f-4293-89e3-8998454e882f None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:17.618580 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4fad6418-766f-4293-89e3-8998454e882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:17.626090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad6418-766f-4293-89e3-8998454e882f None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:17.630682 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5655be-346e-4ff2-a715-1e39264d8e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:17.631582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5655be-346e-4ff2-a715-1e39264d8e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:17.631866 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5655be-346e-4ff2-a715-1e39264d8e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:17.635903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5655be-346e-4ff2-a715-1e39264d8e75 admin admin] PATH_INFO: `/v3/users/6713ce1661ac4511a71d5d3c95fdcfc9` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:17.635903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5655be-346e-4ff2-a715-1e39264d8e75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6713ce1661ac4511a71d5d3c95fdcfc9)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:17.635903 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5655be-346e-4ff2-a715-1e39264d8e75 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:17.645509 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871fa5-efdc-43c1-bc36-031296f1aa98 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:17.646049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871fa5-efdc-43c1-bc36-031296f1aa98 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:17.646049 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871fa5-efdc-43c1-bc36-031296f1aa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:17.669589 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-46871fa5-efdc-43c1-bc36-031296f1aa98 None None] MFA Rules not processed for user `1f544b708f8f437dbc40def8b06de9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:17.670829 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-46871fa5-efdc-43c1-bc36-031296f1aa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:17.690628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:17.728279 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1315/2648] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:17.729254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46871fa5-efdc-43c1-bc36-031296f1aa98 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:17.730513 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-46871fa5-efdc-43c1-bc36-031296f1aa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:17.745018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46871fa5-efdc-43c1-bc36-031296f1aa98 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:17.749712 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:17.750577 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:17.750861 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:17.751138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] PATH_INFO: `/v3/projects/a40dfbe058b84f8ba9ed8a8319d115c9` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:17.752371 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40dfbe058b84f8ba9ed8a8319d115c9)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:17.756959 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:17.897019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40dfbe058b84f8ba9ed8a8319d115c9', 'request_id': 'req-d8905abd-e037-49d9-bdd6-96649ebb3fd4'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:17.897459 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-ff5655be-346e-4ff2-a715-1e39264d8e75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6713ce1661ac4511a71d5d3c95fdcfc9'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:18.018424 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40dfbe058b84f8ba9ed8a8319d115c9', 'request_id': 'req-d8905abd-e037-49d9-bdd6-96649ebb3fd4'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:18.025541 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40dfbe058b84f8ba9ed8a8319d115c9', 'request_id': 'req-d8905abd-e037-49d9-bdd6-96649ebb3fd4'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:18.036920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] The token cache is being invalidate because project a40dfbe058b84f8ba9ed8a8319d115c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:08:18.037288 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:18.038017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:18.039917 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1316/2649] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:08:17 2022] DELETE /identity/v3/projects/a40dfbe058b84f8ba9ed8a8319d115c9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:18.040627 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:18.041946 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:18.098834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8905abd-e037-49d9-bdd6-96649ebb3fd4 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:18.102470 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1485e-1355-4e76-b8f0-91d3a7ac2d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:18.103101 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1485e-1355-4e76-b8f0-91d3a7ac2d0c service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:18.103382 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1485e-1355-4e76-b8f0-91d3a7ac2d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:18.103684 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1485e-1355-4e76-b8f0-91d3a7ac2d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:18.105431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-efa1485e-1355-4e76-b8f0-91d3a7ac2d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:18.115294 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1485e-1355-4e76-b8f0-91d3a7ac2d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:18.116739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1485e-1355-4e76-b8f0-91d3a7ac2d0c service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:18.125249 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1317/2650] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:08:18.126031 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1485e-1355-4e76-b8f0-91d3a7ac2d0c service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:18.127294 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-efa1485e-1355-4e76-b8f0-91d3a7ac2d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:18.144561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-ff5655be-346e-4ff2-a715-1e39264d8e75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6713ce1661ac4511a71d5d3c95fdcfc9'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:18.160040 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-ff5655be-346e-4ff2-a715-1e39264d8e75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6713ce1661ac4511a71d5d3c95fdcfc9'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:18.160661 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-ff5655be-346e-4ff2-a715-1e39264d8e75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6713ce1661ac4511a71d5d3c95fdcfc9'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:18.168920 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-ff5655be-346e-4ff2-a715-1e39264d8e75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6713ce1661ac4511a71d5d3c95fdcfc9'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:18.176771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1334/2651] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:08:17 2022] DELETE /identity/v3/users/6713ce1661ac4511a71d5d3c95fdcfc9 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:08:18.181077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1903527-e85b-4e1a-9da1-66a19e356503 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:18.181366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1903527-e85b-4e1a-9da1-66a19e356503 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:18.181645 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1903527-e85b-4e1a-9da1-66a19e356503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:18.183903 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:18.198446 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1485e-1355-4e76-b8f0-91d3a7ac2d0c service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:18.200426 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-f1903527-e85b-4e1a-9da1-66a19e356503 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:18.201649 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f1903527-e85b-4e1a-9da1-66a19e356503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:18.266623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1335/2652] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:08:18.271481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026a46-06d8-4a17-af44-34252c5a67c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:18.272511 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026a46-06d8-4a17-af44-34252c5a67c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:18.273043 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026a46-06d8-4a17-af44-34252c5a67c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:18.273458 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026a46-06d8-4a17-af44-34252c5a67c8 admin admin] PATH_INFO: `/v3/users/c2bdf76f762d44a79547a3252955a4f0` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:18.275573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8026a46-06d8-4a17-af44-34252c5a67c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2bdf76f762d44a79547a3252955a4f0)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:18.277651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8026a46-06d8-4a17-af44-34252c5a67c8 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:18.281214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1903527-e85b-4e1a-9da1-66a19e356503 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:18.282813 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f1903527-e85b-4e1a-9da1-66a19e356503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:18.344079 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1903527-e85b-4e1a-9da1-66a19e356503 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:18.348235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c920ed-d81a-487b-a1ec-14c29b9f7594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:18.348958 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c920ed-d81a-487b-a1ec-14c29b9f7594 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:18.349249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c920ed-d81a-487b-a1ec-14c29b9f7594 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:18.349527 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c920ed-d81a-487b-a1ec-14c29b9f7594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:18.357168 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:18.360263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c920ed-d81a-487b-a1ec-14c29b9f7594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:18.361726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c920ed-d81a-487b-a1ec-14c29b9f7594 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:18.371754 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1336/2653] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:18.674207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c8026a46-06d8-4a17-af44-34252c5a67c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2bdf76f762d44a79547a3252955a4f0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:18.687316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c8026a46-06d8-4a17-af44-34252c5a67c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2bdf76f762d44a79547a3252955a4f0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:18.694391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c8026a46-06d8-4a17-af44-34252c5a67c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2bdf76f762d44a79547a3252955a4f0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:18.695103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c8026a46-06d8-4a17-af44-34252c5a67c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2bdf76f762d44a79547a3252955a4f0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:18.755679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c8026a46-06d8-4a17-af44-34252c5a67c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2bdf76f762d44a79547a3252955a4f0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:18.762043 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1318/2654] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:08:18 2022] DELETE /identity/v3/users/c2bdf76f762d44a79547a3252955a4f0 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:18.875597 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c920ed-d81a-487b-a1ec-14c29b9f7594 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:18.877119 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-92c920ed-d81a-487b-a1ec-14c29b9f7594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:18.889732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c920ed-d81a-487b-a1ec-14c29b9f7594 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:18.954559 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:18.961749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:18.961749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:18.961749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] PATH_INFO: `/v3/projects/29b7e81bc2364be88b31da74346e1dd4` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:18.961749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b7e81bc2364be88b31da74346e1dd4)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:18.961749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:19.103627 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b7e81bc2364be88b31da74346e1dd4', 'request_id': 'req-da2b18bf-d486-425c-8e17-9ff9e2e28177'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.181558 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b7e81bc2364be88b31da74346e1dd4', 'request_id': 'req-da2b18bf-d486-425c-8e17-9ff9e2e28177'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.189018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b7e81bc2364be88b31da74346e1dd4', 'request_id': 'req-da2b18bf-d486-425c-8e17-9ff9e2e28177'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.199559 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] The token cache is being invalidate because project 29b7e81bc2364be88b31da74346e1dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:08:19.199847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.200515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.202075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1337/2655] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:08:18 2022] DELETE /identity/v3/projects/29b7e81bc2364be88b31da74346e1dd4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:19.206562 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026a46-06d8-4a17-af44-34252c5a67c8 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:19.208058 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c8026a46-06d8-4a17-af44-34252c5a67c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:19.220615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026a46-06d8-4a17-af44-34252c5a67c8 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:19.278547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46e364-f0a4-4b42-a8e1-2550fc9909f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:19.279418 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46e364-f0a4-4b42-a8e1-2550fc9909f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:19.279733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46e364-f0a4-4b42-a8e1-2550fc9909f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:19.280008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46e364-f0a4-4b42-a8e1-2550fc9909f8 admin admin] PATH_INFO: `/v3/users/cc1385e851f94395a18a87a20f10d3f0` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:19.281198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46e364-f0a4-4b42-a8e1-2550fc9909f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1385e851f94395a18a87a20f10d3f0)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:19.283196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46e364-f0a4-4b42-a8e1-2550fc9909f8 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:19.309015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:19.309467 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:19.310916 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:19.326646 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b18bf-d486-425c-8e17-9ff9e2e28177 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:19.331739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f767575-ffeb-4e09-ae60-51e426b8d111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:19.332798 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f767575-ffeb-4e09-ae60-51e426b8d111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:19.333002 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f767575-ffeb-4e09-ae60-51e426b8d111 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:19.333280 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f767575-ffeb-4e09-ae60-51e426b8d111 admin admin] PATH_INFO: `/v3/projects/c83d21ab069d4b49a4f0e37a8444e10a` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:19.334472 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f767575-ffeb-4e09-ae60-51e426b8d111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c83d21ab069d4b49a4f0e37a8444e10a)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:19.336447 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f767575-ffeb-4e09-ae60-51e426b8d111 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:19.575354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6f46e364-f0a4-4b42-a8e1-2550fc9909f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1385e851f94395a18a87a20f10d3f0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.576289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-1f767575-ffeb-4e09-ae60-51e426b8d111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c83d21ab069d4b49a4f0e37a8444e10a', 'request_id': 'req-1f767575-ffeb-4e09-ae60-51e426b8d111'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.587086 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6f46e364-f0a4-4b42-a8e1-2550fc9909f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1385e851f94395a18a87a20f10d3f0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.593789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6f46e364-f0a4-4b42-a8e1-2550fc9909f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1385e851f94395a18a87a20f10d3f0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.594467 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6f46e364-f0a4-4b42-a8e1-2550fc9909f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1385e851f94395a18a87a20f10d3f0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.827292 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-1f767575-ffeb-4e09-ae60-51e426b8d111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c83d21ab069d4b49a4f0e37a8444e10a', 'request_id': 'req-1f767575-ffeb-4e09-ae60-51e426b8d111'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.833974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-1f767575-ffeb-4e09-ae60-51e426b8d111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c83d21ab069d4b49a4f0e37a8444e10a', 'request_id': 'req-1f767575-ffeb-4e09-ae60-51e426b8d111'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.845073 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-1f767575-ffeb-4e09-ae60-51e426b8d111 admin admin] The token cache is being invalidate because project c83d21ab069d4b49a4f0e37a8444e10a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:08:19.845360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-1f767575-ffeb-4e09-ae60-51e426b8d111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.845997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-1f767575-ffeb-4e09-ae60-51e426b8d111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.847565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1338/2656] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:08:19 2022] DELETE /identity/v3/projects/c83d21ab069d4b49a4f0e37a8444e10a => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:08:19.852201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44288f3d-608a-401a-bb04-23533978c1e9 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:19.852525 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44288f3d-608a-401a-bb04-23533978c1e9 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:19.852809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44288f3d-608a-401a-bb04-23533978c1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:19.871149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-44288f3d-608a-401a-bb04-23533978c1e9 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:19.872374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-44288f3d-608a-401a-bb04-23533978c1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:19.876599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:19.931247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1339/2657] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:08:19.939769 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb179-36b9-421e-9bf2-ddaf1667b014 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:19.940146 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb179-36b9-421e-9bf2-ddaf1667b014 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:19.940423 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb179-36b9-421e-9bf2-ddaf1667b014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:19.958121 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d2ffb179-36b9-421e-9bf2-ddaf1667b014 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:19.959309 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d2ffb179-36b9-421e-9bf2-ddaf1667b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:19.967138 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1340/2658] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:08:19.971585 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffb179-36b9-421e-9bf2-ddaf1667b014 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:19.978869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-6f46e364-f0a4-4b42-a8e1-2550fc9909f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1385e851f94395a18a87a20f10d3f0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:19.980211 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffb179-36b9-421e-9bf2-ddaf1667b014 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:19.985830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dbead-512d-46cb-9ae4-8bf75a6cbb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:19.986497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1319/2659] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:08:19 2022] DELETE /identity/v3/users/cc1385e851f94395a18a87a20f10d3f0 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:19.988863 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dbead-512d-46cb-9ae4-8bf75a6cbb2d admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:19.988863 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dbead-512d-46cb-9ae4-8bf75a6cbb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:19.988863 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dbead-512d-46cb-9ae4-8bf75a6cbb2d admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:19.988863 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dbead-512d-46cb-9ae4-8bf75a6cbb2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:08:19.988863 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dbead-512d-46cb-9ae4-8bf75a6cbb2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:19.989776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dbead-512d-46cb-9ae4-8bf75a6cbb2d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:20.002358 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1341/2660] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:08:20.006540 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46e364-f0a4-4b42-a8e1-2550fc9909f8 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:20.008015 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6f46e364-f0a4-4b42-a8e1-2550fc9909f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:20.071531 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46e364-f0a4-4b42-a8e1-2550fc9909f8 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:20.076166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8d0b7-e820-4685-bed3-c9f42f486b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:20.076821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8d0b7-e820-4685-bed3-c9f42f486b28 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:20.077105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8d0b7-e820-4685-bed3-c9f42f486b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:20.077456 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8d0b7-e820-4685-bed3-c9f42f486b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:20.078616 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8d0b7-e820-4685-bed3-c9f42f486b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:20.080570 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8d0b7-e820-4685-bed3-c9f42f486b28 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:20.238068 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1320/2661] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:08:20 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:08:20.239371 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dbead-512d-46cb-9ae4-8bf75a6cbb2d admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:20.249712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dbead-512d-46cb-9ae4-8bf75a6cbb2d admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:20.317830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8532a6-f114-4d3e-bbba-cfea34b94e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:20.318592 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8532a6-f114-4d3e-bbba-cfea34b94e3f admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:20.318952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8532a6-f114-4d3e-bbba-cfea34b94e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:20.319236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8532a6-f114-4d3e-bbba-cfea34b94e3f admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:20.319961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8532a6-f114-4d3e-bbba-cfea34b94e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:20.321897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8532a6-f114-4d3e-bbba-cfea34b94e3f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:20.433090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1342/2662] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:08:20 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:08:20.437247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8d0b7-e820-4685-bed3-c9f42f486b28 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:20.447217 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8d0b7-e820-4685-bed3-c9f42f486b28 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:20.451745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6db292-7633-44e3-aa3f-914a5014f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:20.452399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6db292-7633-44e3-aa3f-914a5014f14b admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:20.452673 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6db292-7633-44e3-aa3f-914a5014f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:20.452944 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6db292-7633-44e3-aa3f-914a5014f14b admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:20.453767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6db292-7633-44e3-aa3f-914a5014f14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:20.455354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6db292-7633-44e3-aa3f-914a5014f14b admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:20.465726 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1321/2663] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:20.470359 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8532a6-f114-4d3e-bbba-cfea34b94e3f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:20.475207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6db292-7633-44e3-aa3f-914a5014f14b admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:20.477412 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-bc6db292-7633-44e3-aa3f-914a5014f14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:20.482412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8532a6-f114-4d3e-bbba-cfea34b94e3f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:20.488043 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9f162-52cd-41a0-a545-c0af81427724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:20.488723 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9f162-52cd-41a0-a545-c0af81427724 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:20.488992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9f162-52cd-41a0-a545-c0af81427724 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:20.489265 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9f162-52cd-41a0-a545-c0af81427724 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:20.489983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9f162-52cd-41a0-a545-c0af81427724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:20.491663 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9f162-52cd-41a0-a545-c0af81427724 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:20.494857 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6db292-7633-44e3-aa3f-914a5014f14b admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:20.500237 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:20.502224 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:20.502508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:20.502782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] PATH_INFO: `/v3/projects/cf1feeaf05d24b669661d0560f921196` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:20.503636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1343/2664] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:20.504333 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf1feeaf05d24b669661d0560f921196)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:20.506240 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:20.507886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9f162-52cd-41a0-a545-c0af81427724 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:20.518820 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9f162-52cd-41a0-a545-c0af81427724 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:20.524130 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f68d6c-ac11-430d-a668-eb0ad43deb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:20.525008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f68d6c-ac11-430d-a668-eb0ad43deb54 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:20.525337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f68d6c-ac11-430d-a668-eb0ad43deb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:20.525630 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f68d6c-ac11-430d-a668-eb0ad43deb54 admin admin] PATH_INFO: `/v3/projects/3d699348d16f4426871e7f2f2ccea3e3/users/6baab58b8e9d49a59a2ab44c5f173ea1/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:20.541238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f68d6c-ac11-430d-a668-eb0ad43deb54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d699348d16f4426871e7f2f2ccea3e3, user_id=6baab58b8e9d49a59a2ab44c5f173ea1, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:20.544530 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f68d6c-ac11-430d-a668-eb0ad43deb54 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:20.677029 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1344/2665] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:20 2022] PUT /identity/v3/projects/3d699348d16f4426871e7f2f2ccea3e3/users/6baab58b8e9d49a59a2ab44c5f173ea1/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:08:20.684598 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf1feeaf05d24b669661d0560f921196', 'request_id': 'req-df300fd9-691f-4384-976c-fa72743a6ed6'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:20.687273 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a10af-d159-4ca3-89fd-dd4b8aa35038 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:20.687695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a10af-d159-4ca3-89fd-dd4b8aa35038 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:20.688090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a10af-d159-4ca3-89fd-dd4b8aa35038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:20.715291 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-db9a10af-d159-4ca3-89fd-dd4b8aa35038 None None] MFA Rules not processed for user `6baab58b8e9d49a59a2ab44c5f173ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:20.716712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-db9a10af-d159-4ca3-89fd-dd4b8aa35038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:20.750643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:20.784202 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1345/2666] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:08:20.785246 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a10af-d159-4ca3-89fd-dd4b8aa35038 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:20.786621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-db9a10af-d159-4ca3-89fd-dd4b8aa35038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:20.827403 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf1feeaf05d24b669661d0560f921196', 'request_id': 'req-df300fd9-691f-4384-976c-fa72743a6ed6'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:20.836739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf1feeaf05d24b669661d0560f921196', 'request_id': 'req-df300fd9-691f-4384-976c-fa72743a6ed6'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:20.842202 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:20.862144 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] The token cache is being invalidate because project cf1feeaf05d24b669661d0560f921196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:08:20.870988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:20.870988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:20.870988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1322/2667] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:08:20 2022] DELETE /identity/v3/projects/cf1feeaf05d24b669661d0560f921196 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:08:20.870988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:20.870988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:20.871507 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a10af-d159-4ca3-89fd-dd4b8aa35038 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:20.877787 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394f34b-7969-4bea-9441-6842cda3368c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:20.878444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394f34b-7969-4bea-9441-6842cda3368c service placement] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:20.878729 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394f34b-7969-4bea-9441-6842cda3368c service placement] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:20.879008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394f34b-7969-4bea-9441-6842cda3368c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:20.880816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6394f34b-7969-4bea-9441-6842cda3368c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:20.893037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394f34b-7969-4bea-9441-6842cda3368c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:20.894643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394f34b-7969-4bea-9441-6842cda3368c service placement] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:20.922509 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df300fd9-691f-4384-976c-fa72743a6ed6 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:20.926161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f3492-d28b-45d3-bdcc-e057582d9935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:20.926561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1346/2668] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:20.926806 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f3492-d28b-45d3-bdcc-e057582d9935 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:20.927089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f3492-d28b-45d3-bdcc-e057582d9935 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:20.927366 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f3492-d28b-45d3-bdcc-e057582d9935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:20.928248 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc6b28-e921-4c7e-8e08-d3b854294c5e None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:20.928527 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc6b28-e921-4c7e-8e08-d3b854294c5e None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:20.928775 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc6b28-e921-4c7e-8e08-d3b854294c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:20.933783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-263f3492-d28b-45d3-bdcc-e057582d9935 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:20.942582 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f3492-d28b-45d3-bdcc-e057582d9935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:20.944074 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f3492-d28b-45d3-bdcc-e057582d9935 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:20.946027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-cccc6b28-e921-4c7e-8e08-d3b854294c5e None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:20.947209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-cccc6b28-e921-4c7e-8e08-d3b854294c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:20.954007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1323/2669] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:21.025766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1347/2670] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:21.035483 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a35c6-e074-4f5c-9ab2-95a1ff1da97a None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:21.035952 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a35c6-e074-4f5c-9ab2-95a1ff1da97a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:21.036089 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a35c6-e074-4f5c-9ab2-95a1ff1da97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:21.054615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-9f7a35c6-e074-4f5c-9ab2-95a1ff1da97a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:21.055835 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9f7a35c6-e074-4f5c-9ab2-95a1ff1da97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:21.067764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1324/2671] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:21.073643 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc6b28-e921-4c7e-8e08-d3b854294c5e None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:21.086479 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc6b28-e921-4c7e-8e08-d3b854294c5e None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:21.091140 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356af02-34f0-4ec2-8a1e-b688860a117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:21.091841 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356af02-34f0-4ec2-8a1e-b688860a117f admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:21.092111 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356af02-34f0-4ec2-8a1e-b688860a117f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:21.092387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356af02-34f0-4ec2-8a1e-b688860a117f admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:21.093113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356af02-34f0-4ec2-8a1e-b688860a117f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:08:21.093418 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356af02-34f0-4ec2-8a1e-b688860a117f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:21.095707 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356af02-34f0-4ec2-8a1e-b688860a117f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:21.111532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1348/2672] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:08:21.114449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a35c6-e074-4f5c-9ab2-95a1ff1da97a None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:21.123687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a35c6-e074-4f5c-9ab2-95a1ff1da97a None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:21.128461 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432790e-f899-42f3-93c4-51e72cb231c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:21.129107 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432790e-f899-42f3-93c4-51e72cb231c1 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:21.129391 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432790e-f899-42f3-93c4-51e72cb231c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:21.129667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432790e-f899-42f3-93c4-51e72cb231c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:21.130347 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432790e-f899-42f3-93c4-51e72cb231c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:21.132289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432790e-f899-42f3-93c4-51e72cb231c1 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:21.320704 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1325/2673] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:08:21 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:08:21.324959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356af02-34f0-4ec2-8a1e-b688860a117f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:21.335023 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356af02-34f0-4ec2-8a1e-b688860a117f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:21.347942 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:21.390363 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc3549-e628-4750-91cd-275bfde23ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:21.391037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc3549-e628-4750-91cd-275bfde23ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:21.391320 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc3549-e628-4750-91cd-275bfde23ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:21.391628 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc3549-e628-4750-91cd-275bfde23ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:21.392305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc3549-e628-4750-91cd-275bfde23ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:21.394225 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc3549-e628-4750-91cd-275bfde23ee5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:21.570156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1349/2674] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:08:21 2022] POST /identity/v3/users => generated 288 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:08:21.574201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432790e-f899-42f3-93c4-51e72cb231c1 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:21.584936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432790e-f899-42f3-93c4-51e72cb231c1 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:21.589548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9710f-bcdb-48d5-98bd-e630c44c82c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:21.590201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9710f-bcdb-48d5-98bd-e630c44c82c0 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:21.590486 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9710f-bcdb-48d5-98bd-e630c44c82c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:21.590764 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9710f-bcdb-48d5-98bd-e630c44c82c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:21.591521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9710f-bcdb-48d5-98bd-e630c44c82c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:21.593113 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9710f-bcdb-48d5-98bd-e630c44c82c0 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:21.611120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1326/2675] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:21.613845 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc3549-e628-4750-91cd-275bfde23ee5 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:21.624136 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc3549-e628-4750-91cd-275bfde23ee5 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:21.629022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe3871-7e76-4c15-bc8b-9d625077c1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:21.629689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe3871-7e76-4c15-bc8b-9d625077c1ea admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:21.629978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe3871-7e76-4c15-bc8b-9d625077c1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:21.630260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe3871-7e76-4c15-bc8b-9d625077c1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:21.631022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe3871-7e76-4c15-bc8b-9d625077c1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:21.632690 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe3871-7e76-4c15-bc8b-9d625077c1ea admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:21.643392 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1350/2676] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:21.647483 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9710f-bcdb-48d5-98bd-e630c44c82c0 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:21.658356 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9710f-bcdb-48d5-98bd-e630c44c82c0 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:21.662979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735b799-b327-4cb0-8e2f-497ead1f215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:21.663881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735b799-b327-4cb0-8e2f-497ead1f215d admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:21.664162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735b799-b327-4cb0-8e2f-497ead1f215d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:21.664435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735b799-b327-4cb0-8e2f-497ead1f215d admin admin] PATH_INFO: `/v3/projects/6da733aa945d4fd6b0094831c6c7089a/users/15512867b08a42f284c7d8bbc058b36f/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:21.679214 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735b799-b327-4cb0-8e2f-497ead1f215d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da733aa945d4fd6b0094831c6c7089a, user_id=15512867b08a42f284c7d8bbc058b36f, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:21.681917 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735b799-b327-4cb0-8e2f-497ead1f215d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:21.767183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1327/2677] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:21 2022] PUT /identity/v3/projects/6da733aa945d4fd6b0094831c6c7089a/users/15512867b08a42f284c7d8bbc058b36f/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:21.782499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8b427-7b10-440e-b51f-f4c8e312aab3 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:21.782835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8b427-7b10-440e-b51f-f4c8e312aab3 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:21.783053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8b427-7b10-440e-b51f-f4c8e312aab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:21.810141 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-4fb8b427-7b10-440e-b51f-f4c8e312aab3 None None] MFA Rules not processed for user `15512867b08a42f284c7d8bbc058b36f`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:21.811334 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4fb8b427-7b10-440e-b51f-f4c8e312aab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:21.878848 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1351/2678] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:21.883234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735b799-b327-4cb0-8e2f-497ead1f215d admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:21.965401 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735b799-b327-4cb0-8e2f-497ead1f215d admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:21.970178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500e251-394a-4259-b6be-4e52dc8ce62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:21.970851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500e251-394a-4259-b6be-4e52dc8ce62e admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:21.971139 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500e251-394a-4259-b6be-4e52dc8ce62e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:21.971493 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500e251-394a-4259-b6be-4e52dc8ce62e admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:21.972206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500e251-394a-4259-b6be-4e52dc8ce62e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:21.974134 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500e251-394a-4259-b6be-4e52dc8ce62e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:22.102686 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1328/2679] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:08:21 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:08:22.106919 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8b427-7b10-440e-b51f-f4c8e312aab3 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:22.117656 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8b427-7b10-440e-b51f-f4c8e312aab3 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:22.174010 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31a3d6-da0b-415d-889a-e94a7ad296a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:22.174681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31a3d6-da0b-415d-889a-e94a7ad296a4 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:22.174967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31a3d6-da0b-415d-889a-e94a7ad296a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:22.175245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31a3d6-da0b-415d-889a-e94a7ad296a4 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:22.175978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31a3d6-da0b-415d-889a-e94a7ad296a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:22.177912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31a3d6-da0b-415d-889a-e94a7ad296a4 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:22.264203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1352/2680] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:08:22 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:08:22.268292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500e251-394a-4259-b6be-4e52dc8ce62e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:22.274912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:22.278841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500e251-394a-4259-b6be-4e52dc8ce62e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:22.283788 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042a485-524f-4fdc-82c9-2e7df8a81aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:22.284444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042a485-524f-4fdc-82c9-2e7df8a81aab admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:22.284734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042a485-524f-4fdc-82c9-2e7df8a81aab admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:22.285119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042a485-524f-4fdc-82c9-2e7df8a81aab admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:22.285845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042a485-524f-4fdc-82c9-2e7df8a81aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:22.287552 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042a485-524f-4fdc-82c9-2e7df8a81aab admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:22.298910 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1329/2681] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:22.303180 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31a3d6-da0b-415d-889a-e94a7ad296a4 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:22.313871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31a3d6-da0b-415d-889a-e94a7ad296a4 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:22.318446 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc9658-7e26-494f-a0df-97fba8c7c2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:22.319310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc9658-7e26-494f-a0df-97fba8c7c2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:22.319622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc9658-7e26-494f-a0df-97fba8c7c2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:22.319899 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc9658-7e26-494f-a0df-97fba8c7c2c4 admin admin] PATH_INFO: `/v3/projects/7c13523c5af44de380068eb455cc580e/users/2dce61ffc4e446479340aca2c43b0c84/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:22.331722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:22.334766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc9658-7e26-494f-a0df-97fba8c7c2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c13523c5af44de380068eb455cc580e, user_id=2dce61ffc4e446479340aca2c43b0c84, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:22.337504 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc9658-7e26-494f-a0df-97fba8c7c2c4 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:22.415619 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1353/2682] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:22 2022] PUT /identity/v3/projects/7c13523c5af44de380068eb455cc580e/users/2dce61ffc4e446479340aca2c43b0c84/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:22.419681 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042a485-524f-4fdc-82c9-2e7df8a81aab admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:22.430066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042a485-524f-4fdc-82c9-2e7df8a81aab admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:22.485559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e23213-2559-4cc0-a69f-1bb05aca55c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:22.486208 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e23213-2559-4cc0-a69f-1bb05aca55c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:22.486492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e23213-2559-4cc0-a69f-1bb05aca55c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:22.486769 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e23213-2559-4cc0-a69f-1bb05aca55c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:22.487517 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e23213-2559-4cc0-a69f-1bb05aca55c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:22.489114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e23213-2559-4cc0-a69f-1bb05aca55c6 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:22.498642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1330/2683] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:08:22.503276 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc9658-7e26-494f-a0df-97fba8c7c2c4 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:22.513417 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc9658-7e26-494f-a0df-97fba8c7c2c4 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:22.518075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca1ac9-5bb3-4c6b-aaaa-814d3f142ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:22.518965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca1ac9-5bb3-4c6b-aaaa-814d3f142ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:22.519239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca1ac9-5bb3-4c6b-aaaa-814d3f142ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:22.519540 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca1ac9-5bb3-4c6b-aaaa-814d3f142ff0 admin admin] PATH_INFO: `/v3/projects/7c13523c5af44de380068eb455cc580e/users/2dce61ffc4e446479340aca2c43b0c84/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:22.521487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca1ac9-5bb3-4c6b-aaaa-814d3f142ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c13523c5af44de380068eb455cc580e, user_id=2dce61ffc4e446479340aca2c43b0c84, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:22.524180 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca1ac9-5bb3-4c6b-aaaa-814d3f142ff0 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:22.534583 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1354/2684] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:22 2022] PUT /identity/v3/projects/7c13523c5af44de380068eb455cc580e/users/2dce61ffc4e446479340aca2c43b0c84/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:08:22.545816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fb08d-8f47-4263-bc18-c22b2e73afb8 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:22.546075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fb08d-8f47-4263-bc18-c22b2e73afb8 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:22.546359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fb08d-8f47-4263-bc18-c22b2e73afb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:22.573154 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-b49fb08d-8f47-4263-bc18-c22b2e73afb8 None None] MFA Rules not processed for user `2dce61ffc4e446479340aca2c43b0c84`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:22.574354 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-b49fb08d-8f47-4263-bc18-c22b2e73afb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:22.641648 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1331/2685] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:22.653038 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca1ac9-5bb3-4c6b-aaaa-814d3f142ff0 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:22.724963 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca1ac9-5bb3-4c6b-aaaa-814d3f142ff0 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:22.728648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583cb3f-8a51-4713-afee-4bebd4d0d2dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:22.729432 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583cb3f-8a51-4713-afee-4bebd4d0d2dd service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:22.729716 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583cb3f-8a51-4713-afee-4bebd4d0d2dd service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:22.730125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583cb3f-8a51-4713-afee-4bebd4d0d2dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:22.786295 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583cb3f-8a51-4713-afee-4bebd4d0d2dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:22.787778 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583cb3f-8a51-4713-afee-4bebd4d0d2dd service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:22.796485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1355/2686] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:26.919469 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fb08d-8f47-4263-bc18-c22b2e73afb8 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:26.998448 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:27.001014 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fb08d-8f47-4263-bc18-c22b2e73afb8 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:27.005635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5c680-cd97-4798-838d-d835849449f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:27.006501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5c680-cd97-4798-838d-d835849449f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:27.006792 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5c680-cd97-4798-838d-d835849449f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:27.009328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5c680-cd97-4798-838d-d835849449f1 admin admin] PATH_INFO: `/v3/users/15512867b08a42f284c7d8bbc058b36f` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:27.009328 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5c680-cd97-4798-838d-d835849449f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15512867b08a42f284c7d8bbc058b36f)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:27.010192 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5c680-cd97-4798-838d-d835849449f1 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:27.230057 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-52a5c680-cd97-4798-838d-d835849449f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15512867b08a42f284c7d8bbc058b36f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:27.242624 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-52a5c680-cd97-4798-838d-d835849449f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15512867b08a42f284c7d8bbc058b36f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:27.249651 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-52a5c680-cd97-4798-838d-d835849449f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15512867b08a42f284c7d8bbc058b36f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:27.251121 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-52a5c680-cd97-4798-838d-d835849449f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15512867b08a42f284c7d8bbc058b36f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:27.284649 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583cb3f-8a51-4713-afee-4bebd4d0d2dd service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:27.286175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1583cb3f-8a51-4713-afee-4bebd4d0d2dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:27.326447 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-52a5c680-cd97-4798-838d-d835849449f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15512867b08a42f284c7d8bbc058b36f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:27.333636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1332/2687] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:08:26 2022] DELETE /identity/v3/users/15512867b08a42f284c7d8bbc058b36f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:27.346896 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329939b1-c973-487e-ba17-d7630d9d309f None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:27.347192 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329939b1-c973-487e-ba17-d7630d9d309f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:27.347687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329939b1-c973-487e-ba17-d7630d9d309f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:27.372405 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583cb3f-8a51-4713-afee-4bebd4d0d2dd service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:27.385665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:27.393502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-329939b1-c973-487e-ba17-d7630d9d309f None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:27.395309 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-329939b1-c973-487e-ba17-d7630d9d309f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:27.440413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2138a-b242-4389-bea3-287101ad556e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:27.441071 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2138a-b242-4389-bea3-287101ad556e service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:27.441351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2138a-b242-4389-bea3-287101ad556e service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:27.441628 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2138a-b242-4389-bea3-287101ad556e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:27.444122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-fcb2138a-b242-4389-bea3-287101ad556e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:27.455785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2138a-b242-4389-bea3-287101ad556e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:27.457501 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2138a-b242-4389-bea3-287101ad556e service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:27.473671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1356/2688] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:08:27.483201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1333/2689] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:27.493539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2138a-b242-4389-bea3-287101ad556e service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:27.494947 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-fcb2138a-b242-4389-bea3-287101ad556e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:27.505462 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2138a-b242-4389-bea3-287101ad556e service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:27.509572 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412528d4-c728-4d8e-8388-327e35913c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:27.510222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412528d4-c728-4d8e-8388-327e35913c50 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:27.510505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412528d4-c728-4d8e-8388-327e35913c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:27.510784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412528d4-c728-4d8e-8388-327e35913c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:27.520760 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412528d4-c728-4d8e-8388-327e35913c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:27.522227 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412528d4-c728-4d8e-8388-327e35913c50 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:27.533577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1357/2690] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:28.006066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329939b1-c973-487e-ba17-d7630d9d309f None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:28.007640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-329939b1-c973-487e-ba17-d7630d9d309f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:28.020191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329939b1-c973-487e-ba17-d7630d9d309f None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:28.024745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:28.025614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:28.025900 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:28.026181 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] PATH_INFO: `/v3/projects/6da733aa945d4fd6b0094831c6c7089a` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:28.027385 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da733aa945d4fd6b0094831c6c7089a)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:28.029321 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:28.187128 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da733aa945d4fd6b0094831c6c7089a', 'request_id': 'req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.259091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da733aa945d4fd6b0094831c6c7089a', 'request_id': 'req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.266685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da733aa945d4fd6b0094831c6c7089a', 'request_id': 'req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.276516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:28.284191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] The token cache is being invalidate because project 6da733aa945d4fd6b0094831c6c7089a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:08:28.285444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.285444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.286640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1334/2691] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:08:28 2022] DELETE /identity/v3/projects/6da733aa945d4fd6b0094831c6c7089a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:28.290624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412528d4-c728-4d8e-8388-327e35913c50 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:28.300433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412528d4-c728-4d8e-8388-327e35913c50 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:28.359974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a43287-8037-477c-817f-d56a25639fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:28.360837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a43287-8037-477c-817f-d56a25639fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:28.361115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a43287-8037-477c-817f-d56a25639fef admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:28.361386 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a43287-8037-477c-817f-d56a25639fef admin admin] PATH_INFO: `/v3/users/2dce61ffc4e446479340aca2c43b0c84` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:28.362568 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a43287-8037-477c-817f-d56a25639fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dce61ffc4e446479340aca2c43b0c84)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:28.364942 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a43287-8037-477c-817f-d56a25639fef admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:28.512757 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:28.517444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:28.530848 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca68c05-aabd-45fc-a79d-c2e4b75f730d admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:28.538806 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548a909-a945-4e91-99f2-6f6a67092ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:28.539881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548a909-a945-4e91-99f2-6f6a67092ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:28.540271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548a909-a945-4e91-99f2-6f6a67092ada admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:28.540689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548a909-a945-4e91-99f2-6f6a67092ada admin admin] PATH_INFO: `/v3/users/6baab58b8e9d49a59a2ab44c5f173ea1` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:28.541990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548a909-a945-4e91-99f2-6f6a67092ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=6baab58b8e9d49a59a2ab44c5f173ea1)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:28.544129 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548a909-a945-4e91-99f2-6f6a67092ada admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:28.600422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4a43287-8037-477c-817f-d56a25639fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dce61ffc4e446479340aca2c43b0c84'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.682300 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4a43287-8037-477c-817f-d56a25639fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dce61ffc4e446479340aca2c43b0c84'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.695567 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4a43287-8037-477c-817f-d56a25639fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dce61ffc4e446479340aca2c43b0c84'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.696323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4a43287-8037-477c-817f-d56a25639fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dce61ffc4e446479340aca2c43b0c84'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.703997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f4a43287-8037-477c-817f-d56a25639fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dce61ffc4e446479340aca2c43b0c84'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.710371 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1358/2692] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:08:28 2022] DELETE /identity/v3/users/2dce61ffc4e446479340aca2c43b0c84 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:08:28.769546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9548a909-a945-4e91-99f2-6f6a67092ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6baab58b8e9d49a59a2ab44c5f173ea1'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.783810 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9548a909-a945-4e91-99f2-6f6a67092ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6baab58b8e9d49a59a2ab44c5f173ea1'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.792495 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9548a909-a945-4e91-99f2-6f6a67092ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6baab58b8e9d49a59a2ab44c5f173ea1'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.793353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9548a909-a945-4e91-99f2-6f6a67092ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6baab58b8e9d49a59a2ab44c5f173ea1'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.889802 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-9548a909-a945-4e91-99f2-6f6a67092ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6baab58b8e9d49a59a2ab44c5f173ea1'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:28.896849 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1335/2693] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:08:28 2022] DELETE /identity/v3/users/6baab58b8e9d49a59a2ab44c5f173ea1 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:28.902500 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de36d0-d4c8-433e-9192-4829b324a526 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:28.902949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de36d0-d4c8-433e-9192-4829b324a526 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:28.903543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de36d0-d4c8-433e-9192-4829b324a526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:28.928449 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-b6de36d0-d4c8-433e-9192-4829b324a526 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:28.929805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b6de36d0-d4c8-433e-9192-4829b324a526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:28.950703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:28.999033 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1359/2694] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:08:29.008972 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548a909-a945-4e91-99f2-6f6a67092ada admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:29.010510 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9548a909-a945-4e91-99f2-6f6a67092ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:29.069732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548a909-a945-4e91-99f2-6f6a67092ada admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:29.073316 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1908af3-c227-4a49-b4ab-84e9c1fcec7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:29.074008 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1908af3-c227-4a49-b4ab-84e9c1fcec7d service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:29.074290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1908af3-c227-4a49-b4ab-84e9c1fcec7d service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:29.074586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1908af3-c227-4a49-b4ab-84e9c1fcec7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:29.085634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1908af3-c227-4a49-b4ab-84e9c1fcec7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:29.087095 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1908af3-c227-4a49-b4ab-84e9c1fcec7d service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:29.097967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1336/2695] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:29.315261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de36d0-d4c8-433e-9192-4829b324a526 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:29.317018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b6de36d0-d4c8-433e-9192-4829b324a526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:29.329571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de36d0-d4c8-433e-9192-4829b324a526 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:29.334419 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:29.335275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:29.340979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:29.340979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f admin admin] PATH_INFO: `/v3/projects/7c13523c5af44de380068eb455cc580e` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:29.340979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c13523c5af44de380068eb455cc580e)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:29.340979 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:29.524297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c13523c5af44de380068eb455cc580e', 'request_id': 'req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:29.588289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1908af3-c227-4a49-b4ab-84e9c1fcec7d service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:29.589783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a1908af3-c227-4a49-b4ab-84e9c1fcec7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:29.602591 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1908af3-c227-4a49-b4ab-84e9c1fcec7d service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:29.660188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd694a-6712-433d-8277-76df38c5a8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:29.661053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd694a-6712-433d-8277-76df38c5a8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:29.661332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd694a-6712-433d-8277-76df38c5a8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:29.661605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd694a-6712-433d-8277-76df38c5a8bf admin admin] PATH_INFO: `/v3/projects/3d699348d16f4426871e7f2f2ccea3e3` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:29.662797 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd694a-6712-433d-8277-76df38c5a8bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d699348d16f4426871e7f2f2ccea3e3)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:29.664748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd694a-6712-433d-8277-76df38c5a8bf admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:29.675225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:29.680875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c13523c5af44de380068eb455cc580e', 'request_id': 'req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:29.688064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c13523c5af44de380068eb455cc580e', 'request_id': 'req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:29.698534 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f admin admin] The token cache is being invalidate because project 7c13523c5af44de380068eb455cc580e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:08:29.698822 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:29.699491 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-dd2a8ff6-5efb-4abe-8d31-2ae56b17c88f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:29.701067 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1360/2696] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:08:29 2022] DELETE /identity/v3/projects/7c13523c5af44de380068eb455cc580e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:29.706523 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557055b7-a084-4292-aa79-e7887e4e959c None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:29.706830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557055b7-a084-4292-aa79-e7887e4e959c None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:29.707120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557055b7-a084-4292-aa79-e7887e4e959c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:29.744253 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-557055b7-a084-4292-aa79-e7887e4e959c None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:29.745450 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-557055b7-a084-4292-aa79-e7887e4e959c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:29.753985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1361/2697] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:29.761329 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e02a37-2c8f-4f47-8f8e-8da40807de86 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:29.763220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e02a37-2c8f-4f47-8f8e-8da40807de86 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:29.763220 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e02a37-2c8f-4f47-8f8e-8da40807de86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:29.779439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-e2e02a37-2c8f-4f47-8f8e-8da40807de86 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:29.780590 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e2e02a37-2c8f-4f47-8f8e-8da40807de86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:29.789899 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1362/2698] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:08:29.794198 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e02a37-2c8f-4f47-8f8e-8da40807de86 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:29.802267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-85dd694a-6712-433d-8277-76df38c5a8bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d699348d16f4426871e7f2f2ccea3e3', 'request_id': 'req-85dd694a-6712-433d-8277-76df38c5a8bf'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:29.803732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e02a37-2c8f-4f47-8f8e-8da40807de86 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:29.861863 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312f526-3549-4f89-a75d-669fb31b6b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:29.862529 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f526-3549-4f89-a75d-669fb31b6b4c admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:29.862812 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f526-3549-4f89-a75d-669fb31b6b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:29.863090 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f526-3549-4f89-a75d-669fb31b6b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:29.863851 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312f526-3549-4f89-a75d-669fb31b6b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:08:29.864160 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312f526-3549-4f89-a75d-669fb31b6b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:29.865867 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312f526-3549-4f89-a75d-669fb31b6b4c admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:29.878071 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1363/2699] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:08:29.882328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312f526-3549-4f89-a75d-669fb31b6b4c admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:29.892492 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312f526-3549-4f89-a75d-669fb31b6b4c admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:29.897163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110b3b9-714c-4dcc-be9b-74a2b23bc5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:29.897839 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b3b9-714c-4dcc-be9b-74a2b23bc5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:29.898125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b3b9-714c-4dcc-be9b-74a2b23bc5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:29.898402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b3b9-714c-4dcc-be9b-74a2b23bc5a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:29.899087 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110b3b9-714c-4dcc-be9b-74a2b23bc5a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:29.901133 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110b3b9-714c-4dcc-be9b-74a2b23bc5a0 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:29.910227 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:29.924920 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-85dd694a-6712-433d-8277-76df38c5a8bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d699348d16f4426871e7f2f2ccea3e3', 'request_id': 'req-85dd694a-6712-433d-8277-76df38c5a8bf'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:29.931399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-85dd694a-6712-433d-8277-76df38c5a8bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d699348d16f4426871e7f2f2ccea3e3', 'request_id': 'req-85dd694a-6712-433d-8277-76df38c5a8bf'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:29.942152 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-85dd694a-6712-433d-8277-76df38c5a8bf admin admin] The token cache is being invalidate because project 3d699348d16f4426871e7f2f2ccea3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:08:29.942446 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-85dd694a-6712-433d-8277-76df38c5a8bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:29.943106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-85dd694a-6712-433d-8277-76df38c5a8bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:29.944677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1337/2700] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:08:29 2022] DELETE /identity/v3/projects/3d699348d16f4426871e7f2f2ccea3e3 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:08:29.949525 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae2e88-f80f-4c5a-b752-049f01fc68b1 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:29.949837 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae2e88-f80f-4c5a-b752-049f01fc68b1 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:29.950101 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae2e88-f80f-4c5a-b752-049f01fc68b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:29.968342 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-b8ae2e88-f80f-4c5a-b752-049f01fc68b1 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:29.969547 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-b8ae2e88-f80f-4c5a-b752-049f01fc68b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:29.977537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1338/2701] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:08:29.986111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f622fd-ff3d-4ae7-86ce-6a1280c90dcf None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:29.986414 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f622fd-ff3d-4ae7-86ce-6a1280c90dcf None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:29.986686 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f622fd-ff3d-4ae7-86ce-6a1280c90dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.006760 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1364/2702] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:08:29 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:08:30.006942 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-e5f622fd-ff3d-4ae7-86ce-6a1280c90dcf None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:30.007718 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110b3b9-714c-4dcc-be9b-74a2b23bc5a0 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:30.007945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e5f622fd-ff3d-4ae7-86ce-6a1280c90dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:30.009305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b110b3b9-714c-4dcc-be9b-74a2b23bc5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:30.066856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1339/2703] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:08:30.071012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f622fd-ff3d-4ae7-86ce-6a1280c90dcf None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:30.071302 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110b3b9-714c-4dcc-be9b-74a2b23bc5a0 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:30.075961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10ce50-dd4d-4e14-9aaa-1054c4f1c8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:30.076648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10ce50-dd4d-4e14-9aaa-1054c4f1c8bc admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.077422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10ce50-dd4d-4e14-9aaa-1054c4f1c8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.077422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10ce50-dd4d-4e14-9aaa-1054c4f1c8bc admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.077965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10ce50-dd4d-4e14-9aaa-1054c4f1c8bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:30.079901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10ce50-dd4d-4e14-9aaa-1054c4f1c8bc admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:30.080047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f622fd-ff3d-4ae7-86ce-6a1280c90dcf None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:30.084484 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b07a5-fe8d-4c41-a154-dd0f8433747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:30.085173 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b07a5-fe8d-4c41-a154-dd0f8433747d admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.085457 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b07a5-fe8d-4c41-a154-dd0f8433747d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.085735 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b07a5-fe8d-4c41-a154-dd0f8433747d admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.086456 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b07a5-fe8d-4c41-a154-dd0f8433747d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:08:30.086760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b07a5-fe8d-4c41-a154-dd0f8433747d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:30.088405 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b07a5-fe8d-4c41-a154-dd0f8433747d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:30.100421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1340/2704] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:08:30.104593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b07a5-fe8d-4c41-a154-dd0f8433747d admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:30.114250 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b07a5-fe8d-4c41-a154-dd0f8433747d admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:30.126912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1144e46-2e7f-4825-8830-46a8ee5cf0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:30.126912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1144e46-2e7f-4825-8830-46a8ee5cf0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.126912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1144e46-2e7f-4825-8830-46a8ee5cf0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.126912 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1144e46-2e7f-4825-8830-46a8ee5cf0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.127323 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1144e46-2e7f-4825-8830-46a8ee5cf0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:30.127323 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1144e46-2e7f-4825-8830-46a8ee5cf0d8 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:30.207370 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1365/2705] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:08:30 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:08:30.211229 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10ce50-dd4d-4e14-9aaa-1054c4f1c8bc admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:30.220997 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10ce50-dd4d-4e14-9aaa-1054c4f1c8bc admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:30.226008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b70226-2f50-41d6-a812-388d37afa103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:30.226649 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b70226-2f50-41d6-a812-388d37afa103 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.227650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b70226-2f50-41d6-a812-388d37afa103 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.227650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b70226-2f50-41d6-a812-388d37afa103 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.227925 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b70226-2f50-41d6-a812-388d37afa103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:30.229515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b70226-2f50-41d6-a812-388d37afa103 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:30.231915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1341/2706] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:08:30 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:08:30.236432 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1144e46-2e7f-4825-8830-46a8ee5cf0d8 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:30.241265 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1366/2707] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:08:30.245094 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b70226-2f50-41d6-a812-388d37afa103 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:30.254606 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b70226-2f50-41d6-a812-388d37afa103 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:30.298719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1144e46-2e7f-4825-8830-46a8ee5cf0d8 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:30.303481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151caf92-0ce8-4cc0-b298-9e4c77c29524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:30.304187 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151caf92-0ce8-4cc0-b298-9e4c77c29524 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.304472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151caf92-0ce8-4cc0-b298-9e4c77c29524 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.304751 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151caf92-0ce8-4cc0-b298-9e4c77c29524 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.305444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151caf92-0ce8-4cc0-b298-9e4c77c29524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:30.307368 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151caf92-0ce8-4cc0-b298-9e4c77c29524 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:30.312726 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6419a2-def4-4052-9703-bb77a067722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:30.313284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6419a2-def4-4052-9703-bb77a067722b admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.313570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6419a2-def4-4052-9703-bb77a067722b admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.313844 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6419a2-def4-4052-9703-bb77a067722b admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.314598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6419a2-def4-4052-9703-bb77a067722b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:30.316223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6419a2-def4-4052-9703-bb77a067722b admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:30.326117 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1367/2708] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:08:30.330749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6419a2-def4-4052-9703-bb77a067722b admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:30.338166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:30.342244 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6419a2-def4-4052-9703-bb77a067722b admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:30.345077 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd2bce-fcdd-4d4d-8436-ab6108792caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:30.345933 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd2bce-fcdd-4d4d-8436-ab6108792caf admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.346222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd2bce-fcdd-4d4d-8436-ab6108792caf admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.346503 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd2bce-fcdd-4d4d-8436-ab6108792caf admin admin] PATH_INFO: `/v3/projects/8ddfefd2efdc44999df4209951164d42/users/a99e9d6afa0643248927e68544c765dc/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.361024 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd2bce-fcdd-4d4d-8436-ab6108792caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ddfefd2efdc44999df4209951164d42, user_id=a99e9d6afa0643248927e68544c765dc, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:30.363668 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd2bce-fcdd-4d4d-8436-ab6108792caf admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:30.399791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1342/2709] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:08:30 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:08:30.402595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151caf92-0ce8-4cc0-b298-9e4c77c29524 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:30.412056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151caf92-0ce8-4cc0-b298-9e4c77c29524 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:30.417193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa534c6-92e3-4441-9a62-d8ba0c4123d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:30.417828 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa534c6-92e3-4441-9a62-d8ba0c4123d5 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.418114 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa534c6-92e3-4441-9a62-d8ba0c4123d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.418398 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa534c6-92e3-4441-9a62-d8ba0c4123d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.419109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa534c6-92e3-4441-9a62-d8ba0c4123d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:30.420745 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa534c6-92e3-4441-9a62-d8ba0c4123d5 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:30.430574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1343/2710] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:08:30.434122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa534c6-92e3-4441-9a62-d8ba0c4123d5 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:30.443774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa534c6-92e3-4441-9a62-d8ba0c4123d5 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:30.448343 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23033cc5-64c6-44bf-a170-53e038cb93b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:30.448969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23033cc5-64c6-44bf-a170-53e038cb93b4 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.449255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23033cc5-64c6-44bf-a170-53e038cb93b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.449530 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23033cc5-64c6-44bf-a170-53e038cb93b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.450238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23033cc5-64c6-44bf-a170-53e038cb93b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:30.451791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23033cc5-64c6-44bf-a170-53e038cb93b4 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:30.462444 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1344/2711] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:08:30.466236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23033cc5-64c6-44bf-a170-53e038cb93b4 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:30.475340 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23033cc5-64c6-44bf-a170-53e038cb93b4 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:30.480449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066272ec-92fb-46cf-b218-60f95ff08fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:30.481045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066272ec-92fb-46cf-b218-60f95ff08fba admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.481360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066272ec-92fb-46cf-b218-60f95ff08fba admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.481887 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066272ec-92fb-46cf-b218-60f95ff08fba admin admin] PATH_INFO: `/v3/projects/ce5b2d8c86064b61a989a357c2a6655e/users/def730d1731b41dc82fd0592414624ca/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.496286 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066272ec-92fb-46cf-b218-60f95ff08fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5b2d8c86064b61a989a357c2a6655e, user_id=def730d1731b41dc82fd0592414624ca, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:30.498940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066272ec-92fb-46cf-b218-60f95ff08fba admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:30.512651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1368/2712] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:30 2022] PUT /identity/v3/projects/8ddfefd2efdc44999df4209951164d42/users/a99e9d6afa0643248927e68544c765dc/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:08:30.517771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e5e76-3f29-4415-9690-41a233306a53 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.518063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e5e76-3f29-4415-9690-41a233306a53 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.518342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e5e76-3f29-4415-9690-41a233306a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.535000 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-eb7e5e76-3f29-4415-9690-41a233306a53 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:30.536231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-eb7e5e76-3f29-4415-9690-41a233306a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:30.568817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:30.595569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1345/2713] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:30 2022] PUT /identity/v3/projects/ce5b2d8c86064b61a989a357c2a6655e/users/def730d1731b41dc82fd0592414624ca/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:08:30.596391 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1369/2714] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:08:30.598888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18c0c4-8ed1-4bd5-bb67-c48949242ea6 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.599188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18c0c4-8ed1-4bd5-bb67-c48949242ea6 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.599555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18c0c4-8ed1-4bd5-bb67-c48949242ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.605790 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e5e76-3f29-4415-9690-41a233306a53 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:30.607527 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-eb7e5e76-3f29-4415-9690-41a233306a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:30.617007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-fd18c0c4-8ed1-4bd5-bb67-c48949242ea6 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:30.618174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-fd18c0c4-8ed1-4bd5-bb67-c48949242ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:30.662785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e5e76-3f29-4415-9690-41a233306a53 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:30.676553 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1346/2715] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:08:30.685956 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18c0c4-8ed1-4bd5-bb67-c48949242ea6 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:30.712691 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9efdf-5eb9-4016-84e7-cdfa91a65c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:30.713427 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9efdf-5eb9-4016-84e7-cdfa91a65c15 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.713715 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9efdf-5eb9-4016-84e7-cdfa91a65c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.714012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9efdf-5eb9-4016-84e7-cdfa91a65c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.723847 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9efdf-5eb9-4016-84e7-cdfa91a65c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:30.725343 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9efdf-5eb9-4016-84e7-cdfa91a65c15 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:30.736882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1370/2716] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:08:30.744666 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18c0c4-8ed1-4bd5-bb67-c48949242ea6 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:30.748260 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef88924-fa8f-4d90-8eb7-89143c7a449e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:30.748936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef88924-fa8f-4d90-8eb7-89143c7a449e service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.749291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef88924-fa8f-4d90-8eb7-89143c7a449e service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.749479 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef88924-fa8f-4d90-8eb7-89143c7a449e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.759177 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef88924-fa8f-4d90-8eb7-89143c7a449e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:30.760655 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef88924-fa8f-4d90-8eb7-89143c7a449e service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:30.770850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1347/2717] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:08:32.750565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052eaf0-19d0-45a3-b6db-63f4e8a55e63 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:32.751098 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052eaf0-19d0-45a3-b6db-63f4e8a55e63 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:32.751267 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052eaf0-19d0-45a3-b6db-63f4e8a55e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:32.780112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-1052eaf0-19d0-45a3-b6db-63f4e8a55e63 None None] MFA Rules not processed for user `a99e9d6afa0643248927e68544c765dc`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:32.782027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-1052eaf0-19d0-45a3-b6db-63f4e8a55e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:32.851584 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1371/2718] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:32.862741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef88924-fa8f-4d90-8eb7-89143c7a449e service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:32.864201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9ef88924-fa8f-4d90-8eb7-89143c7a449e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:32.913118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:32.923891 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef88924-fa8f-4d90-8eb7-89143c7a449e service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:32.927491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bd68f-f026-4f48-880e-cc37d1183822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:32.930713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bd68f-f026-4f48-880e-cc37d1183822 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:32.930713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bd68f-f026-4f48-880e-cc37d1183822 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:32.930713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bd68f-f026-4f48-880e-cc37d1183822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:32.936795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bd68f-f026-4f48-880e-cc37d1183822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:32.938324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bd68f-f026-4f48-880e-cc37d1183822 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:32.946960 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1348/2719] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:35.855759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9708da2-175a-415a-ac4d-60d78592a88d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:35.856568 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9708da2-175a-415a-ac4d-60d78592a88d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:35.856568 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9708da2-175a-415a-ac4d-60d78592a88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:35.874509 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-b9708da2-175a-415a-ac4d-60d78592a88d None None] MFA Rules not processed for user `a99e9d6afa0643248927e68544c765dc`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:35.876288 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b9708da2-175a-415a-ac4d-60d78592a88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:35.922362 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1372/2720] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:08:36.068684 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bd68f-f026-4f48-880e-cc37d1183822 service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:36.073537 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-297bd68f-f026-4f48-880e-cc37d1183822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:36.182104 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bd68f-f026-4f48-880e-cc37d1183822 service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:36.188170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6091d-e539-45e2-87dd-1ff35240b740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:36.189353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6091d-e539-45e2-87dd-1ff35240b740 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:36.189353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6091d-e539-45e2-87dd-1ff35240b740 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:36.189680 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6091d-e539-45e2-87dd-1ff35240b740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:36.191652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-40e6091d-e539-45e2-87dd-1ff35240b740 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:36.204767 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6091d-e539-45e2-87dd-1ff35240b740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:36.206662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6091d-e539-45e2-87dd-1ff35240b740 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:36.237451 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1349/2721] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:37.193293 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97240c45-b10c-461a-8235-e24644090449 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:37.194008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97240c45-b10c-461a-8235-e24644090449 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:37.194008 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97240c45-b10c-461a-8235-e24644090449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:37.223070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-97240c45-b10c-461a-8235-e24644090449 None None] MFA Rules not processed for user `def730d1731b41dc82fd0592414624ca`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:37.225193 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-97240c45-b10c-461a-8235-e24644090449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:37.236387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:37.302602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1373/2722] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:37.307203 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6091d-e539-45e2-87dd-1ff35240b740 service nova] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:37.322173 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6091d-e539-45e2-87dd-1ff35240b740 service nova] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:37.330649 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821aefa-4058-4502-ad28-5a96dd08af94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:37.332199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821aefa-4058-4502-ad28-5a96dd08af94 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:37.332779 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821aefa-4058-4502-ad28-5a96dd08af94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:37.333317 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821aefa-4058-4502-ad28-5a96dd08af94 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:37.334707 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821aefa-4058-4502-ad28-5a96dd08af94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:37.337940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821aefa-4058-4502-ad28-5a96dd08af94 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:37.486018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1350/2723] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:08:37 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:08:37.489984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97240c45-b10c-461a-8235-e24644090449 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:37.502412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97240c45-b10c-461a-8235-e24644090449 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:37.579481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138341e5-6db2-4cc3-9e63-b63ceb553589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:37.580494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138341e5-6db2-4cc3-9e63-b63ceb553589 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:37.581041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138341e5-6db2-4cc3-9e63-b63ceb553589 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:37.581342 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138341e5-6db2-4cc3-9e63-b63ceb553589 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:37.582301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138341e5-6db2-4cc3-9e63-b63ceb553589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:37.584889 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138341e5-6db2-4cc3-9e63-b63ceb553589 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:37.787323 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1374/2724] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:08:37 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:08:37.791569 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821aefa-4058-4502-ad28-5a96dd08af94 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:37.802004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821aefa-4058-4502-ad28-5a96dd08af94 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:37.806695 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28bed7-cf76-46c9-90de-ae34a9c76edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:37.807363 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28bed7-cf76-46c9-90de-ae34a9c76edb admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:37.807690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28bed7-cf76-46c9-90de-ae34a9c76edb admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:37.807972 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28bed7-cf76-46c9-90de-ae34a9c76edb admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:37.814032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28bed7-cf76-46c9-90de-ae34a9c76edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:37.814032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28bed7-cf76-46c9-90de-ae34a9c76edb admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:37.821593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1351/2725] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:37.825896 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138341e5-6db2-4cc3-9e63-b63ceb553589 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:37.836816 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138341e5-6db2-4cc3-9e63-b63ceb553589 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:37.841897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41cd60-6baa-4162-831f-1b612a1934f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:37.842917 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41cd60-6baa-4162-831f-1b612a1934f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:37.843341 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41cd60-6baa-4162-831f-1b612a1934f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:37.843964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41cd60-6baa-4162-831f-1b612a1934f3 admin admin] PATH_INFO: `/v3/projects/063f421f683b42559b22d4cef30cb5b8/users/639fbc66f1694f4888f28f4d6acd433a/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:37.859310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41cd60-6baa-4162-831f-1b612a1934f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=063f421f683b42559b22d4cef30cb5b8, user_id=639fbc66f1694f4888f28f4d6acd433a, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:37.861985 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41cd60-6baa-4162-831f-1b612a1934f3 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:37.962127 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1375/2726] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:37 2022] PUT /identity/v3/projects/063f421f683b42559b22d4cef30cb5b8/users/639fbc66f1694f4888f28f4d6acd433a/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:37.966010 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28bed7-cf76-46c9-90de-ae34a9c76edb admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:37.976438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28bed7-cf76-46c9-90de-ae34a9c76edb admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:38.035291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657eb08-8237-42bf-ad6a-bb15d371a220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:38.035916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657eb08-8237-42bf-ad6a-bb15d371a220 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:38.036225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657eb08-8237-42bf-ad6a-bb15d371a220 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:38.036567 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657eb08-8237-42bf-ad6a-bb15d371a220 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:38.037297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657eb08-8237-42bf-ad6a-bb15d371a220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:38.038903 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657eb08-8237-42bf-ad6a-bb15d371a220 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:38.049421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1352/2727] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:38.053759 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41cd60-6baa-4162-831f-1b612a1934f3 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:38.064752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41cd60-6baa-4162-831f-1b612a1934f3 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:38.069525 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837aac5-4a8f-4e96-bc25-110a5977c9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:38.070416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837aac5-4a8f-4e96-bc25-110a5977c9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:38.070753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837aac5-4a8f-4e96-bc25-110a5977c9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:38.071036 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837aac5-4a8f-4e96-bc25-110a5977c9ae admin admin] PATH_INFO: `/v3/projects/063f421f683b42559b22d4cef30cb5b8/users/639fbc66f1694f4888f28f4d6acd433a/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:38.073099 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837aac5-4a8f-4e96-bc25-110a5977c9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=063f421f683b42559b22d4cef30cb5b8, user_id=639fbc66f1694f4888f28f4d6acd433a, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:38.075901 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837aac5-4a8f-4e96-bc25-110a5977c9ae admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:38.086988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1376/2728] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:38 2022] PUT /identity/v3/projects/063f421f683b42559b22d4cef30cb5b8/users/639fbc66f1694f4888f28f4d6acd433a/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:42.974289 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657eb08-8237-42bf-ad6a-bb15d371a220 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:42.977012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8657eb08-8237-42bf-ad6a-bb15d371a220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:43.051722 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:43.090090 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657eb08-8237-42bf-ad6a-bb15d371a220 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:43.202109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191ae42-0e85-4f85-95f5-82c40d9b9ace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:43.204965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191ae42-0e85-4f85-95f5-82c40d9b9ace service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:43.211741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191ae42-0e85-4f85-95f5-82c40d9b9ace service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:43.211741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191ae42-0e85-4f85-95f5-82c40d9b9ace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:43.211741 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8191ae42-0e85-4f85-95f5-82c40d9b9ace service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:43.224302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191ae42-0e85-4f85-95f5-82c40d9b9ace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:43.226164 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191ae42-0e85-4f85-95f5-82c40d9b9ace service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:43.239789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1353/2729] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:45.592156 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadcc34-76de-441b-8a4b-ea57df30d374 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:45.592637 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadcc34-76de-441b-8a4b-ea57df30d374 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:45.592722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadcc34-76de-441b-8a4b-ea57df30d374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:45.625444 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-2dadcc34-76de-441b-8a4b-ea57df30d374 None None] MFA Rules not processed for user `639fbc66f1694f4888f28f4d6acd433a`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:45.626881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2dadcc34-76de-441b-8a4b-ea57df30d374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:45.694632 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:45.722597 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1377/2730] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:45.734683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191ae42-0e85-4f85-95f5-82c40d9b9ace service nova] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:45.736067 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8191ae42-0e85-4f85-95f5-82c40d9b9ace service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:45.792610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191ae42-0e85-4f85-95f5-82c40d9b9ace service nova] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:45.796298 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f264a0-1e23-4cdd-b70e-d391c7d99fd9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be4de0fa80784de1acfcd47a2b77d9ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:45.796945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f264a0-1e23-4cdd-b70e-d391c7d99fd9 service glance] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:45.797234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f264a0-1e23-4cdd-b70e-d391c7d99fd9 service glance] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:45.797507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f264a0-1e23-4cdd-b70e-d391c7d99fd9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:45.853955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f264a0-1e23-4cdd-b70e-d391c7d99fd9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:45.855477 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f264a0-1e23-4cdd-b70e-d391c7d99fd9 service glance] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:45.864659 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1354/2731] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:46.137388 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d616d1-eea1-46b0-b3bc-8b1b0fcc4fa7 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:46.137683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d616d1-eea1-46b0-b3bc-8b1b0fcc4fa7 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:46.137969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d616d1-eea1-46b0-b3bc-8b1b0fcc4fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:46.157237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-e6d616d1-eea1-46b0-b3bc-8b1b0fcc4fa7 None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:46.158451 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-e6d616d1-eea1-46b0-b3bc-8b1b0fcc4fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:46.354922 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1378/2732] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 14:08:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:46.556303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f264a0-1e23-4cdd-b70e-d391c7d99fd9 service glance] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:46.557736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f3f264a0-1e23-4cdd-b70e-d391c7d99fd9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:46.572671 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:46.627021 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f264a0-1e23-4cdd-b70e-d391c7d99fd9 service glance] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:46.632353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70b87e-453c-44ed-9d02-3395a5b8ee1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:46.632991 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70b87e-453c-44ed-9d02-3395a5b8ee1a service swift] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:46.633273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70b87e-453c-44ed-9d02-3395a5b8ee1a service swift] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:46.633548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70b87e-453c-44ed-9d02-3395a5b8ee1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:46.641492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70b87e-453c-44ed-9d02-3395a5b8ee1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:46.643062 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70b87e-453c-44ed-9d02-3395a5b8ee1a service swift] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:46.650878 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1355/2733] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 14:08:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:08:56.567101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=30 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:56.665932 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=26 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:57.265330 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cb1f0-d0cc-47c1-bed9-62173dc2be3a None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:57.265624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cb1f0-d0cc-47c1-bed9-62173dc2be3a None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:57.265905 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cb1f0-d0cc-47c1-bed9-62173dc2be3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:57.283390 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-750cb1f0-d0cc-47c1-bed9-62173dc2be3a None None] MFA Rules not processed for user `def730d1731b41dc82fd0592414624ca`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:57.284613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-750cb1f0-d0cc-47c1-bed9-62173dc2be3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:57.291422 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1379/2734] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:57.917575 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324caf8a-d283-4f3e-b01d-dbfa2b54008d None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:57.918053 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324caf8a-d283-4f3e-b01d-dbfa2b54008d None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:57.922246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324caf8a-d283-4f3e-b01d-dbfa2b54008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:57.945121 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-324caf8a-d283-4f3e-b01d-dbfa2b54008d None None] MFA Rules not processed for user `a99e9d6afa0643248927e68544c765dc`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:57.946333 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-324caf8a-d283-4f3e-b01d-dbfa2b54008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:58.015490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1356/2735] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:08:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:01.033541 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f989fef-8272-4e9e-99a5-06748f9affd8 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:01.035923 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f989fef-8272-4e9e-99a5-06748f9affd8 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:01.035923 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f989fef-8272-4e9e-99a5-06748f9affd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:01.051961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-7f989fef-8272-4e9e-99a5-06748f9affd8 None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:01.053230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-7f989fef-8272-4e9e-99a5-06748f9affd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:01.060468 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1380/2736] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 14:09:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:09:01.073159 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324caf8a-d283-4f3e-b01d-dbfa2b54008d None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:01.085869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324caf8a-d283-4f3e-b01d-dbfa2b54008d None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:01.090743 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ed96b-3034-42a9-9387-8cabfebcec08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:01.093454 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ed96b-3034-42a9-9387-8cabfebcec08 service swift] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:01.093454 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ed96b-3034-42a9-9387-8cabfebcec08 service swift] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:01.093454 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ed96b-3034-42a9-9387-8cabfebcec08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:01.101323 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ed96b-3034-42a9-9387-8cabfebcec08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:01.102929 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ed96b-3034-42a9-9387-8cabfebcec08 service swift] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:01.112358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1357/2737] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 14:09:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:09:11.046730 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=6 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:11.110174 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=31 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:34.032396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f989fef-8272-4e9e-99a5-06748f9affd8 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:34.088408 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f989fef-8272-4e9e-99a5-06748f9affd8 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:34.092097 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241e696-27c5-40e2-8164-f090b1609163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:34.092875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241e696-27c5-40e2-8164-f090b1609163 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:34.093200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241e696-27c5-40e2-8164-f090b1609163 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:34.093492 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241e696-27c5-40e2-8164-f090b1609163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:34.103368 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241e696-27c5-40e2-8164-f090b1609163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:34.104826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241e696-27c5-40e2-8164-f090b1609163 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:34.115271 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1381/2738] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:09:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:09:35.639067 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f47cc-737c-4948-8d86-f3380a7c323f None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:35.639565 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f47cc-737c-4948-8d86-f3380a7c323f None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:35.639825 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f47cc-737c-4948-8d86-f3380a7c323f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:35.702003 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-4d8f47cc-737c-4948-8d86-f3380a7c323f None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:35.703770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4d8f47cc-737c-4948-8d86-f3380a7c323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:35.727775 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1358/2739] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 2 14:09:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:35.740034 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241e696-27c5-40e2-8164-f090b1609163 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:35.762310 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241e696-27c5-40e2-8164-f090b1609163 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:35.767962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52510fda-4112-429f-8807-2be5665a1944 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:35.768603 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52510fda-4112-429f-8807-2be5665a1944 service swift] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:35.768885 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52510fda-4112-429f-8807-2be5665a1944 service swift] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:35.769163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52510fda-4112-429f-8807-2be5665a1944 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:35.777373 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52510fda-4112-429f-8807-2be5665a1944 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:35.778938 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52510fda-4112-429f-8807-2be5665a1944 service swift] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:35.787598 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1382/2740] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 14:09:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:09:45.724770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=25 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:45.784352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=36 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:52.138868 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1adf-fd70-4008-bb90-dd45380372cb None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:52.139388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1adf-fd70-4008-bb90-dd45380372cb None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:52.139530 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1adf-fd70-4008-bb90-dd45380372cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:52.157275 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-388f1adf-fd70-4008-bb90-dd45380372cb None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:52.158446 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-388f1adf-fd70-4008-bb90-dd45380372cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:52.165464 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1359/2741] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 2 14:09:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:52.177846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52510fda-4112-429f-8807-2be5665a1944 service swift] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:52.188863 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52510fda-4112-429f-8807-2be5665a1944 service swift] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:52.193805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fce40-f1b0-4419-85af-d62551c3a4ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:52.194439 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fce40-f1b0-4419-85af-d62551c3a4ad service swift] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:52.194722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fce40-f1b0-4419-85af-d62551c3a4ad service swift] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:52.194999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fce40-f1b0-4419-85af-d62551c3a4ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:52.202883 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fce40-f1b0-4419-85af-d62551c3a4ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:52.204496 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fce40-f1b0-4419-85af-d62551c3a4ad service swift] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:52.212360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1383/2742] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 14:09:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 14:09:55.246363 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f1adf-fd70-4008-bb90-dd45380372cb None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:55.313886 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f1adf-fd70-4008-bb90-dd45380372cb None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:55.318427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d3026-110b-4639-aa19-a179c6d7f702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:55.319305 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d3026-110b-4639-aa19-a179c6d7f702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:55.319602 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d3026-110b-4639-aa19-a179c6d7f702 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:55.319881 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d3026-110b-4639-aa19-a179c6d7f702 admin admin] PATH_INFO: `/v3/users/a99e9d6afa0643248927e68544c765dc` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:55.321056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d3026-110b-4639-aa19-a179c6d7f702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99e9d6afa0643248927e68544c765dc)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:55.322975 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d3026-110b-4639-aa19-a179c6d7f702 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:55.558846 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-de2d3026-110b-4639-aa19-a179c6d7f702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99e9d6afa0643248927e68544c765dc'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:55.571337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-de2d3026-110b-4639-aa19-a179c6d7f702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99e9d6afa0643248927e68544c765dc'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:55.578178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-de2d3026-110b-4639-aa19-a179c6d7f702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99e9d6afa0643248927e68544c765dc'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:55.578839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-de2d3026-110b-4639-aa19-a179c6d7f702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99e9d6afa0643248927e68544c765dc'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:55.676359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-de2d3026-110b-4639-aa19-a179c6d7f702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99e9d6afa0643248927e68544c765dc'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:55.682548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1360/2743] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:09:55 2022] DELETE /identity/v3/users/a99e9d6afa0643248927e68544c765dc => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:09:55.917378 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fce40-f1b0-4419-85af-d62551c3a4ad service swift] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:55.929602 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fce40-f1b0-4419-85af-d62551c3a4ad service swift] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:55.985638 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f276c-e245-428f-936f-1d3b42d78084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:55.986475 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f276c-e245-428f-936f-1d3b42d78084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:55.986756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f276c-e245-428f-936f-1d3b42d78084 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:55.987027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f276c-e245-428f-936f-1d3b42d78084 admin admin] PATH_INFO: `/v3/projects/8ddfefd2efdc44999df4209951164d42` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:55.988202 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f276c-e245-428f-936f-1d3b42d78084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ddfefd2efdc44999df4209951164d42)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:55.990078 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f276c-e245-428f-936f-1d3b42d78084 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:56.093484 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b79f276c-e245-428f-936f-1d3b42d78084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ddfefd2efdc44999df4209951164d42', 'request_id': 'req-b79f276c-e245-428f-936f-1d3b42d78084'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:56.153053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b79f276c-e245-428f-936f-1d3b42d78084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ddfefd2efdc44999df4209951164d42', 'request_id': 'req-b79f276c-e245-428f-936f-1d3b42d78084'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:56.159694 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b79f276c-e245-428f-936f-1d3b42d78084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ddfefd2efdc44999df4209951164d42', 'request_id': 'req-b79f276c-e245-428f-936f-1d3b42d78084'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:56.170037 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b79f276c-e245-428f-936f-1d3b42d78084 admin admin] The token cache is being invalidate because project 8ddfefd2efdc44999df4209951164d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:09:56.170267 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b79f276c-e245-428f-936f-1d3b42d78084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:56.170930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b79f276c-e245-428f-936f-1d3b42d78084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:56.172536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1384/2744] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:09:55 2022] DELETE /identity/v3/projects/8ddfefd2efdc44999df4209951164d42 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:09:56.178280 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0103d3-c254-409c-bd45-bb4ff14e0207 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:56.178562 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0103d3-c254-409c-bd45-bb4ff14e0207 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:56.178837 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0103d3-c254-409c-bd45-bb4ff14e0207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:56.206078 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-5b0103d3-c254-409c-bd45-bb4ff14e0207 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:56.207250 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5b0103d3-c254-409c-bd45-bb4ff14e0207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:56.265055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1361/2745] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:56.274165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31994f8-7fd4-435d-99b1-094e14322c84 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:56.274459 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31994f8-7fd4-435d-99b1-094e14322c84 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:56.274740 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31994f8-7fd4-435d-99b1-094e14322c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:56.292951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-a31994f8-7fd4-435d-99b1-094e14322c84 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:56.294133 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a31994f8-7fd4-435d-99b1-094e14322c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:56.301984 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1385/2746] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:56.306840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0103d3-c254-409c-bd45-bb4ff14e0207 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:56.317798 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:56.321479 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0103d3-c254-409c-bd45-bb4ff14e0207 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:56.326269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cc6ef-d2a0-40ef-ad70-626abeeba8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:56.330573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cc6ef-d2a0-40ef-ad70-626abeeba8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:56.330573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cc6ef-d2a0-40ef-ad70-626abeeba8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:56.330573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cc6ef-d2a0-40ef-ad70-626abeeba8f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:56.330573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cc6ef-d2a0-40ef-ad70-626abeeba8f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:09:56.330573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cc6ef-d2a0-40ef-ad70-626abeeba8f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:56.331018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cc6ef-d2a0-40ef-ad70-626abeeba8f0 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:56.342557 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1362/2747] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:09:56.346942 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31994f8-7fd4-435d-99b1-094e14322c84 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:56.356334 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31994f8-7fd4-435d-99b1-094e14322c84 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:56.361195 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b5c75-0181-4cfa-bd81-8e058e3cc1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:56.361868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b5c75-0181-4cfa-bd81-8e058e3cc1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:56.362152 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b5c75-0181-4cfa-bd81-8e058e3cc1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:56.362430 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b5c75-0181-4cfa-bd81-8e058e3cc1c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:56.363144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b5c75-0181-4cfa-bd81-8e058e3cc1c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:56.365065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b5c75-0181-4cfa-bd81-8e058e3cc1c9 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:56.471981 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1386/2748] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:09:56 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:09:56.476254 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cc6ef-d2a0-40ef-ad70-626abeeba8f0 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:56.486608 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cc6ef-d2a0-40ef-ad70-626abeeba8f0 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:56.541233 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa425bbd-2a06-4a52-9ce7-47aced92efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:56.541885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa425bbd-2a06-4a52-9ce7-47aced92efe6 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:56.542165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa425bbd-2a06-4a52-9ce7-47aced92efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:56.542435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa425bbd-2a06-4a52-9ce7-47aced92efe6 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:56.543104 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa425bbd-2a06-4a52-9ce7-47aced92efe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:56.545079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa425bbd-2a06-4a52-9ce7-47aced92efe6 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:56.621751 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1363/2749] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:09:56 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:09:56.626413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b5c75-0181-4cfa-bd81-8e058e3cc1c9 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:56.636799 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b5c75-0181-4cfa-bd81-8e058e3cc1c9 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:56.642017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186be971-fc67-417a-ba76-e3a983885058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:56.642667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186be971-fc67-417a-ba76-e3a983885058 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:56.643015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186be971-fc67-417a-ba76-e3a983885058 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:56.643259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186be971-fc67-417a-ba76-e3a983885058 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:56.644017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186be971-fc67-417a-ba76-e3a983885058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:56.648058 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186be971-fc67-417a-ba76-e3a983885058 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:56.655970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1387/2750] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:09:56.660073 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa425bbd-2a06-4a52-9ce7-47aced92efe6 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:56.669926 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa425bbd-2a06-4a52-9ce7-47aced92efe6 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:56.675036 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8fa4d-e061-4664-bb67-e6bc50214caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:56.675719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8fa4d-e061-4664-bb67-e6bc50214caa admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:56.676030 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8fa4d-e061-4664-bb67-e6bc50214caa admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:56.676306 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8fa4d-e061-4664-bb67-e6bc50214caa admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:56.677027 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8fa4d-e061-4664-bb67-e6bc50214caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:56.678602 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8fa4d-e061-4664-bb67-e6bc50214caa admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:56.689023 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1364/2751] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:09:56.693018 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186be971-fc67-417a-ba76-e3a983885058 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:56.702676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186be971-fc67-417a-ba76-e3a983885058 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:56.707371 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0ff87-c9c6-44b1-8cf8-ab70ad287883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:56.708266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0ff87-c9c6-44b1-8cf8-ab70ad287883 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:56.708546 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0ff87-c9c6-44b1-8cf8-ab70ad287883 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:56.708820 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0ff87-c9c6-44b1-8cf8-ab70ad287883 admin admin] PATH_INFO: `/v3/projects/5cde3f9254f14ad4b0c685116a96b483/users/149aeefcca5e49c2a4aac8a7091de797/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:56.722966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0ff87-c9c6-44b1-8cf8-ab70ad287883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cde3f9254f14ad4b0c685116a96b483, user_id=149aeefcca5e49c2a4aac8a7091de797, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:56.725553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0ff87-c9c6-44b1-8cf8-ab70ad287883 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:56.793157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1388/2752] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:09:56 2022] PUT /identity/v3/projects/5cde3f9254f14ad4b0c685116a96b483/users/149aeefcca5e49c2a4aac8a7091de797/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:09:56.803431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e544f4-ecff-46f3-a5d4-e4527acfa751 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:56.803715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e544f4-ecff-46f3-a5d4-e4527acfa751 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:56.803993 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e544f4-ecff-46f3-a5d4-e4527acfa751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:56.830287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-d0e544f4-ecff-46f3-a5d4-e4527acfa751 None None] MFA Rules not processed for user `149aeefcca5e49c2a4aac8a7091de797`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:56.831492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d0e544f4-ecff-46f3-a5d4-e4527acfa751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:56.893412 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1365/2753] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:09:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:56.904545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0ff87-c9c6-44b1-8cf8-ab70ad287883 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:56.906213 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-82e0ff87-c9c6-44b1-8cf8-ab70ad287883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:56.920367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:56.963346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0ff87-c9c6-44b1-8cf8-ab70ad287883 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:56.967070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a68da4-64ac-40e0-899e-d1ba3ead586b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be4de0fa80784de1acfcd47a2b77d9ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:56.967739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a68da4-64ac-40e0-899e-d1ba3ead586b service glance] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:56.968026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a68da4-64ac-40e0-899e-d1ba3ead586b service glance] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:56.968306 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a68da4-64ac-40e0-899e-d1ba3ead586b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:56.976817 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a68da4-64ac-40e0-899e-d1ba3ead586b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:56.978270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a68da4-64ac-40e0-899e-d1ba3ead586b service glance] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:56.987742 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1389/2754] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:09:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:10:05.514816 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e544f4-ecff-46f3-a5d4-e4527acfa751 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:05.516337 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d0e544f4-ecff-46f3-a5d4-e4527acfa751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:05.578193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:05.611978 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e544f4-ecff-46f3-a5d4-e4527acfa751 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:05.617427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee6e8d-e9d5-4931-b66a-5df4bd053bbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:05.618066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee6e8d-e9d5-4931-b66a-5df4bd053bbe service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:05.618347 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee6e8d-e9d5-4931-b66a-5df4bd053bbe service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:05.618620 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee6e8d-e9d5-4931-b66a-5df4bd053bbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:05.620385 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-91ee6e8d-e9d5-4931-b66a-5df4bd053bbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:05.678552 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee6e8d-e9d5-4931-b66a-5df4bd053bbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:05.680201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee6e8d-e9d5-4931-b66a-5df4bd053bbe service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:05.690060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1366/2755] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:10:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:10:07.039287 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=20 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:15.816663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=38 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:22.594916 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16410677-4def-4563-9440-70d08227f083 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:22.595494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16410677-4def-4563-9440-70d08227f083 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:22.595607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16410677-4def-4563-9440-70d08227f083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:22.613227 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-16410677-4def-4563-9440-70d08227f083 None None] MFA Rules not processed for user `1f544b708f8f437dbc40def8b06de9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:10:22.614480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-16410677-4def-4563-9440-70d08227f083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:22.621312 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1390/2756] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:10:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:10:23.143250 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee6e8d-e9d5-4931-b66a-5df4bd053bbe service nova] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:23.158018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-91ee6e8d-e9d5-4931-b66a-5df4bd053bbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:23.200739 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee6e8d-e9d5-4931-b66a-5df4bd053bbe service nova] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:23.204373 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f7c38-0bbf-4896-b37d-4d0f69b9347d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:23.205017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7c38-0bbf-4896-b37d-4d0f69b9347d service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:23.205324 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7c38-0bbf-4896-b37d-4d0f69b9347d service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:23.205595 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7c38-0bbf-4896-b37d-4d0f69b9347d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:23.207947 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9e5f7c38-0bbf-4896-b37d-4d0f69b9347d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:23.217211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f7c38-0bbf-4896-b37d-4d0f69b9347d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:23.218624 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f7c38-0bbf-4896-b37d-4d0f69b9347d service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:23.227056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1367/2757] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:10:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:10:29.661066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16410677-4def-4563-9440-70d08227f083 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:29.724734 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16410677-4def-4563-9440-70d08227f083 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:29.729285 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f885b-c87b-485b-9e55-73890e3fa90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:29.730420 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f885b-c87b-485b-9e55-73890e3fa90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:29.730703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f885b-c87b-485b-9e55-73890e3fa90d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:29.730976 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f885b-c87b-485b-9e55-73890e3fa90d admin admin] PATH_INFO: `/v3/users/149aeefcca5e49c2a4aac8a7091de797` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:29.732187 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f885b-c87b-485b-9e55-73890e3fa90d admin admin] RBAC: Authorizing `identity:delete_user(user_id=149aeefcca5e49c2a4aac8a7091de797)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:29.734093 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f885b-c87b-485b-9e55-73890e3fa90d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:30.011174 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5d2f885b-c87b-485b-9e55-73890e3fa90d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149aeefcca5e49c2a4aac8a7091de797'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.095195 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5d2f885b-c87b-485b-9e55-73890e3fa90d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149aeefcca5e49c2a4aac8a7091de797'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.108228 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5d2f885b-c87b-485b-9e55-73890e3fa90d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149aeefcca5e49c2a4aac8a7091de797'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.108884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5d2f885b-c87b-485b-9e55-73890e3fa90d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149aeefcca5e49c2a4aac8a7091de797'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.116315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5d2f885b-c87b-485b-9e55-73890e3fa90d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149aeefcca5e49c2a4aac8a7091de797'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.122147 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1391/2758] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:10:29 2022] DELETE /identity/v3/users/149aeefcca5e49c2a4aac8a7091de797 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:30.126683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdd6d4-af52-43f1-b130-34cc731f9708 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:30.127178 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdd6d4-af52-43f1-b130-34cc731f9708 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:30.127290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdd6d4-af52-43f1-b130-34cc731f9708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:30.144281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-c6cdd6d4-af52-43f1-b130-34cc731f9708 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:10:30.145534 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c6cdd6d4-af52-43f1-b130-34cc731f9708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:30.204884 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1368/2759] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:10:30.214406 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f885b-c87b-485b-9e55-73890e3fa90d admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:30.215820 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-5d2f885b-c87b-485b-9e55-73890e3fa90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:30.273235 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f885b-c87b-485b-9e55-73890e3fa90d admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:30.276825 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889f8b0-8e7c-418d-b954-79030bcbf1b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:30.277466 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889f8b0-8e7c-418d-b954-79030bcbf1b8 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:30.277742 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889f8b0-8e7c-418d-b954-79030bcbf1b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:30.278012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889f8b0-8e7c-418d-b954-79030bcbf1b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:30.287015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889f8b0-8e7c-418d-b954-79030bcbf1b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:30.288460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889f8b0-8e7c-418d-b954-79030bcbf1b8 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:30.297631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1392/2760] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:10:30.799913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdd6d4-af52-43f1-b130-34cc731f9708 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:30.801326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c6cdd6d4-af52-43f1-b130-34cc731f9708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:30.816056 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdd6d4-af52-43f1-b130-34cc731f9708 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:30.821386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:30.822435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:30.822778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:30.822978 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] PATH_INFO: `/v3/projects/5cde3f9254f14ad4b0c685116a96b483` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:30.824322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cde3f9254f14ad4b0c685116a96b483)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:30.826415 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:31.027820 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cde3f9254f14ad4b0c685116a96b483', 'request_id': 'req-c550e570-d929-420a-bf9b-c49493b15de4'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:31.135652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cde3f9254f14ad4b0c685116a96b483', 'request_id': 'req-c550e570-d929-420a-bf9b-c49493b15de4'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:31.142302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cde3f9254f14ad4b0c685116a96b483', 'request_id': 'req-c550e570-d929-420a-bf9b-c49493b15de4'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:31.153472 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] The token cache is being invalidate because project 5cde3f9254f14ad4b0c685116a96b483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:10:31.153786 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:31.154423 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:31.155992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1369/2761] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:10:30 2022] DELETE /identity/v3/projects/5cde3f9254f14ad4b0c685116a96b483 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:40.293592 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=82,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:41.150387 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:47.748084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889f8b0-8e7c-418d-b954-79030bcbf1b8 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:47.749493 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-9889f8b0-8e7c-418d-b954-79030bcbf1b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:47.834633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889f8b0-8e7c-418d-b954-79030bcbf1b8 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:47.893131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897f410-cc1d-488c-b379-d84126408c54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:47.893777 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897f410-cc1d-488c-b379-d84126408c54 service placement] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:47.894065 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897f410-cc1d-488c-b379-d84126408c54 service placement] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:47.894352 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897f410-cc1d-488c-b379-d84126408c54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:47.896128 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2897f410-cc1d-488c-b379-d84126408c54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:47.908255 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897f410-cc1d-488c-b379-d84126408c54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:47.909850 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897f410-cc1d-488c-b379-d84126408c54 service placement] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:47.919804 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1393/2762] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:10:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:10:57.915545 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=67 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:57.661971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:57.663377 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:57.742208 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550e570-d929-420a-bf9b-c49493b15de4 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:57.745837 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223e17c-b33b-434f-84f4-e8f7d832c313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:57.751559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223e17c-b33b-434f-84f4-e8f7d832c313 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:57.751559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223e17c-b33b-434f-84f4-e8f7d832c313 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:57.751559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223e17c-b33b-434f-84f4-e8f7d832c313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:57.751559 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a223e17c-b33b-434f-84f4-e8f7d832c313 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:57.817774 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223e17c-b33b-434f-84f4-e8f7d832c313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:57.819261 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223e17c-b33b-434f-84f4-e8f7d832c313 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:57.830218 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1370/2763] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:11:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:02.011837 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897f410-cc1d-488c-b379-d84126408c54 service placement] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:02.013238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2897f410-cc1d-488c-b379-d84126408c54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:02.024688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897f410-cc1d-488c-b379-d84126408c54 service placement] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:02.028340 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d4cd4-59d8-443c-bdb0-d5b8c2bc79d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:02.028970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d4cd4-59d8-443c-bdb0-d5b8c2bc79d9 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:02.029254 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d4cd4-59d8-443c-bdb0-d5b8c2bc79d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:02.029528 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d4cd4-59d8-443c-bdb0-d5b8c2bc79d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:02.031261 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-520d4cd4-59d8-443c-bdb0-d5b8c2bc79d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:02.044115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d4cd4-59d8-443c-bdb0-d5b8c2bc79d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:02.046041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d4cd4-59d8-443c-bdb0-d5b8c2bc79d9 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:02.056808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1394/2764] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:07.825504 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=63 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:12.051977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=6 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:14.767335 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223e17c-b33b-434f-84f4-e8f7d832c313 service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:14.768788 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a223e17c-b33b-434f-84f4-e8f7d832c313 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:14.823412 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223e17c-b33b-434f-84f4-e8f7d832c313 service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:14.827697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a4578-c81b-4687-8ab2-6a1cb3734eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:14.828332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a4578-c81b-4687-8ab2-6a1cb3734eee service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:14.828614 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a4578-c81b-4687-8ab2-6a1cb3734eee service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:14.828889 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a4578-c81b-4687-8ab2-6a1cb3734eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:14.830615 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-088a4578-c81b-4687-8ab2-6a1cb3734eee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:14.893976 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a4578-c81b-4687-8ab2-6a1cb3734eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:14.895414 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a4578-c81b-4687-8ab2-6a1cb3734eee service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:14.905628 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1371/2765] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:18.632052 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d4cd4-59d8-443c-bdb0-d5b8c2bc79d9 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:18.633600 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-520d4cd4-59d8-443c-bdb0-d5b8c2bc79d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:18.648635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d4cd4-59d8-443c-bdb0-d5b8c2bc79d9 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:18.653678 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417140c-0afd-4278-a68b-2a7ef3e06ad9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:18.654330 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417140c-0afd-4278-a68b-2a7ef3e06ad9 service placement] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:18.654615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417140c-0afd-4278-a68b-2a7ef3e06ad9 service placement] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:18.654888 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417140c-0afd-4278-a68b-2a7ef3e06ad9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:18.656693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d417140c-0afd-4278-a68b-2a7ef3e06ad9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:18.668440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417140c-0afd-4278-a68b-2a7ef3e06ad9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:18.670597 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417140c-0afd-4278-a68b-2a7ef3e06ad9 service placement] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:18.680679 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1395/2766] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:18.749253 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a4578-c81b-4687-8ab2-6a1cb3734eee service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:18.750776 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-088a4578-c81b-4687-8ab2-6a1cb3734eee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:18.762971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a4578-c81b-4687-8ab2-6a1cb3734eee service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:18.767597 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcd4f2-f0d0-42a4-aa3a-daa522f41f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:18.768455 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcd4f2-f0d0-42a4-aa3a-daa522f41f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:18.768734 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcd4f2-f0d0-42a4-aa3a-daa522f41f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:18.769004 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcd4f2-f0d0-42a4-aa3a-daa522f41f3f admin admin] PATH_INFO: `/v3/users/1f544b708f8f437dbc40def8b06de9cc` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:18.770176 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bcd4f2-f0d0-42a4-aa3a-daa522f41f3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f544b708f8f437dbc40def8b06de9cc)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:18.772112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bcd4f2-f0d0-42a4-aa3a-daa522f41f3f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:19.084345 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b8bcd4f2-f0d0-42a4-aa3a-daa522f41f3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f544b708f8f437dbc40def8b06de9cc'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:19.103597 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b8bcd4f2-f0d0-42a4-aa3a-daa522f41f3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f544b708f8f437dbc40def8b06de9cc'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:19.104169 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b8bcd4f2-f0d0-42a4-aa3a-daa522f41f3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f544b708f8f437dbc40def8b06de9cc'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:19.104945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b8bcd4f2-f0d0-42a4-aa3a-daa522f41f3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f544b708f8f437dbc40def8b06de9cc'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:19.214191 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-b8bcd4f2-f0d0-42a4-aa3a-daa522f41f3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f544b708f8f437dbc40def8b06de9cc'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:19.222108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1372/2767] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:12:18 2022] DELETE /identity/v3/users/1f544b708f8f437dbc40def8b06de9cc => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:19.527905 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417140c-0afd-4278-a68b-2a7ef3e06ad9 service placement] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:19.541424 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417140c-0afd-4278-a68b-2a7ef3e06ad9 service placement] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:19.605381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a9e72-fd23-48a0-96c2-260dd77147d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:19.606639 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a9e72-fd23-48a0-96c2-260dd77147d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:19.607127 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a9e72-fd23-48a0-96c2-260dd77147d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:19.607549 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a9e72-fd23-48a0-96c2-260dd77147d9 admin admin] PATH_INFO: `/v3/projects/5d257724aef24f6dbc5ac428c151ce77` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:19.608966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a9e72-fd23-48a0-96c2-260dd77147d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d257724aef24f6dbc5ac428c151ce77)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:19.611000 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a9e72-fd23-48a0-96c2-260dd77147d9 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:19.761576 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5c3a9e72-fd23-48a0-96c2-260dd77147d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d257724aef24f6dbc5ac428c151ce77', 'request_id': 'req-5c3a9e72-fd23-48a0-96c2-260dd77147d9'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:19.897868 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5c3a9e72-fd23-48a0-96c2-260dd77147d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d257724aef24f6dbc5ac428c151ce77', 'request_id': 'req-5c3a9e72-fd23-48a0-96c2-260dd77147d9'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:19.912705 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5c3a9e72-fd23-48a0-96c2-260dd77147d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d257724aef24f6dbc5ac428c151ce77', 'request_id': 'req-5c3a9e72-fd23-48a0-96c2-260dd77147d9'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:19.929623 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5c3a9e72-fd23-48a0-96c2-260dd77147d9 admin admin] The token cache is being invalidate because project 5d257724aef24f6dbc5ac428c151ce77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:12:19.930026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5c3a9e72-fd23-48a0-96c2-260dd77147d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:19.930773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-5c3a9e72-fd23-48a0-96c2-260dd77147d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:19.932677 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1396/2768] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:12:19 2022] DELETE /identity/v3/projects/5d257724aef24f6dbc5ac428c151ce77 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:19.938110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3e8cd-bd22-4451-88fe-ad3b5f8a0924 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:19.938596 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3e8cd-bd22-4451-88fe-ad3b5f8a0924 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:19.938683 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3e8cd-bd22-4451-88fe-ad3b5f8a0924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:19.959163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-d7f3e8cd-bd22-4451-88fe-ad3b5f8a0924 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:19.960016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d7f3e8cd-bd22-4451-88fe-ad3b5f8a0924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:19.977497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:20.020205 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1373/2769] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:20.027818 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a232a-8b96-4aae-89b8-60fcf51c1c97 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:20.028108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a232a-8b96-4aae-89b8-60fcf51c1c97 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:20.028385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a232a-8b96-4aae-89b8-60fcf51c1c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:20.048278 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d78a232a-8b96-4aae-89b8-60fcf51c1c97 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:20.049578 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d78a232a-8b96-4aae-89b8-60fcf51c1c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:20.058131 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1397/2770] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:20.062865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3e8cd-bd22-4451-88fe-ad3b5f8a0924 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:20.072411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3e8cd-bd22-4451-88fe-ad3b5f8a0924 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:20.077105 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f1b3f-aa42-4b3f-88b0-927dbbcc8633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:20.077749 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f1b3f-aa42-4b3f-88b0-927dbbcc8633 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:20.078033 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f1b3f-aa42-4b3f-88b0-927dbbcc8633 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:20.078332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f1b3f-aa42-4b3f-88b0-927dbbcc8633 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:20.079052 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f1b3f-aa42-4b3f-88b0-927dbbcc8633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:12:20.079376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f1b3f-aa42-4b3f-88b0-927dbbcc8633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:20.080988 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f1b3f-aa42-4b3f-88b0-927dbbcc8633 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:20.092410 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1374/2771] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:12:20.096613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a232a-8b96-4aae-89b8-60fcf51c1c97 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:20.106028 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a232a-8b96-4aae-89b8-60fcf51c1c97 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:20.113017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b525771-af5c-49cf-af62-8882f71e914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:20.113017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b525771-af5c-49cf-af62-8882f71e914f admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:20.113017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b525771-af5c-49cf-af62-8882f71e914f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:20.113017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b525771-af5c-49cf-af62-8882f71e914f admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:20.113467 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b525771-af5c-49cf-af62-8882f71e914f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:20.115159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b525771-af5c-49cf-af62-8882f71e914f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:20.257330 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1398/2772] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:12:20 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:12:20.261518 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f1b3f-aa42-4b3f-88b0-927dbbcc8633 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:20.272386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f1b3f-aa42-4b3f-88b0-927dbbcc8633 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:20.333604 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100167d9-d7d5-4ec5-8cc4-dc8034c93c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:20.335952 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100167d9-d7d5-4ec5-8cc4-dc8034c93c0d admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:20.335952 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100167d9-d7d5-4ec5-8cc4-dc8034c93c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:20.335952 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100167d9-d7d5-4ec5-8cc4-dc8034c93c0d admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:20.335952 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100167d9-d7d5-4ec5-8cc4-dc8034c93c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:20.337611 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100167d9-d7d5-4ec5-8cc4-dc8034c93c0d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:20.474914 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1375/2773] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:12:20 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:12:20.479175 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b525771-af5c-49cf-af62-8882f71e914f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:20.489924 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b525771-af5c-49cf-af62-8882f71e914f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:20.494351 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44590550-46cc-4471-822c-bebb7481dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:20.495001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590550-46cc-4471-822c-bebb7481dba9 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:20.495290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590550-46cc-4471-822c-bebb7481dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:20.495610 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590550-46cc-4471-822c-bebb7481dba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:20.496336 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44590550-46cc-4471-822c-bebb7481dba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:20.497932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44590550-46cc-4471-822c-bebb7481dba9 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:20.508436 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1399/2774] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:20.512290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100167d9-d7d5-4ec5-8cc4-dc8034c93c0d admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:20.522234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100167d9-d7d5-4ec5-8cc4-dc8034c93c0d admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:20.526831 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77098a61-9141-4c98-bfe0-1374e1aa0e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:20.527512 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77098a61-9141-4c98-bfe0-1374e1aa0e25 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:20.527799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77098a61-9141-4c98-bfe0-1374e1aa0e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:20.528077 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77098a61-9141-4c98-bfe0-1374e1aa0e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:20.528826 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77098a61-9141-4c98-bfe0-1374e1aa0e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:20.530944 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77098a61-9141-4c98-bfe0-1374e1aa0e25 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:20.540765 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1376/2775] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:20.547374 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44590550-46cc-4471-822c-bebb7481dba9 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:20.558268 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44590550-46cc-4471-822c-bebb7481dba9 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:20.562773 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97382d5-5d36-441e-ad58-a645d72ff7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:20.563705 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97382d5-5d36-441e-ad58-a645d72ff7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:20.563992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97382d5-5d36-441e-ad58-a645d72ff7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:20.564269 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97382d5-5d36-441e-ad58-a645d72ff7a5 admin admin] PATH_INFO: `/v3/projects/41a67537298c432eb5df0b3f958ada0d/users/eb07b332ee3148d9908e6e0ef020e4bf/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:20.578600 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97382d5-5d36-441e-ad58-a645d72ff7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a67537298c432eb5df0b3f958ada0d, user_id=eb07b332ee3148d9908e6e0ef020e4bf, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:20.581305 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97382d5-5d36-441e-ad58-a645d72ff7a5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:20.665297 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1400/2776] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:12:20 2022] PUT /identity/v3/projects/41a67537298c432eb5df0b3f958ada0d/users/eb07b332ee3148d9908e6e0ef020e4bf/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:20.676118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa6551-a291-4008-81da-40f10c2ece59 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:20.676433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa6551-a291-4008-81da-40f10c2ece59 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:20.676715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa6551-a291-4008-81da-40f10c2ece59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:20.704019 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-84aa6551-a291-4008-81da-40f10c2ece59 None None] MFA Rules not processed for user `eb07b332ee3148d9908e6e0ef020e4bf`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:20.705222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-84aa6551-a291-4008-81da-40f10c2ece59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:20.781417 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1377/2777] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:20.793076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97382d5-5d36-441e-ad58-a645d72ff7a5 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:20.794800 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-b97382d5-5d36-441e-ad58-a645d72ff7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:20.809205 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:20.867828 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97382d5-5d36-441e-ad58-a645d72ff7a5 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:20.873966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334741f-484f-4921-bc34-6e75482bcd2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:20.874655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334741f-484f-4921-bc34-6e75482bcd2e service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:20.874946 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334741f-484f-4921-bc34-6e75482bcd2e service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:20.875224 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334741f-484f-4921-bc34-6e75482bcd2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:20.883021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334741f-484f-4921-bc34-6e75482bcd2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:20.884644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334741f-484f-4921-bc34-6e75482bcd2e service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:20.893334 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1401/2778] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:21.120130 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa6551-a291-4008-81da-40f10c2ece59 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:21.138023 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:21.182431 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa6551-a291-4008-81da-40f10c2ece59 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:21.186910 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79970d8c-f6bc-4cda-92cc-56eb4611bfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:21.187815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79970d8c-f6bc-4cda-92cc-56eb4611bfbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:21.188100 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79970d8c-f6bc-4cda-92cc-56eb4611bfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:21.188376 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79970d8c-f6bc-4cda-92cc-56eb4611bfbd admin admin] PATH_INFO: `/v3/users/eb07b332ee3148d9908e6e0ef020e4bf` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:21.189576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79970d8c-f6bc-4cda-92cc-56eb4611bfbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb07b332ee3148d9908e6e0ef020e4bf)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:21.191555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79970d8c-f6bc-4cda-92cc-56eb4611bfbd admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:21.424438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-79970d8c-f6bc-4cda-92cc-56eb4611bfbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb07b332ee3148d9908e6e0ef020e4bf'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:21.436304 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-79970d8c-f6bc-4cda-92cc-56eb4611bfbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb07b332ee3148d9908e6e0ef020e4bf'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:21.443014 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-79970d8c-f6bc-4cda-92cc-56eb4611bfbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb07b332ee3148d9908e6e0ef020e4bf'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:21.443715 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-79970d8c-f6bc-4cda-92cc-56eb4611bfbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb07b332ee3148d9908e6e0ef020e4bf'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:21.504904 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-79970d8c-f6bc-4cda-92cc-56eb4611bfbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb07b332ee3148d9908e6e0ef020e4bf'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:21.510969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1378/2779] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:12:21 2022] DELETE /identity/v3/users/eb07b332ee3148d9908e6e0ef020e4bf => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:21.525171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7b114-bb8b-4e0f-8c30-4fda586a1107 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:21.555519 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7b114-bb8b-4e0f-8c30-4fda586a1107 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:21.555519 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7b114-bb8b-4e0f-8c30-4fda586a1107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:21.555519 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-4bf7b114-bb8b-4e0f-8c30-4fda586a1107 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:21.555519 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4bf7b114-bb8b-4e0f-8c30-4fda586a1107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:21.614561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1402/2780] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:21.624629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79970d8c-f6bc-4cda-92cc-56eb4611bfbd admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:21.626149 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-79970d8c-f6bc-4cda-92cc-56eb4611bfbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:21.684029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79970d8c-f6bc-4cda-92cc-56eb4611bfbd admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:21.687753 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdbc5f-7c7a-477f-81fd-4531a8427f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:21.688341 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdbc5f-7c7a-477f-81fd-4531a8427f22 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:21.688625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdbc5f-7c7a-477f-81fd-4531a8427f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:21.688902 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdbc5f-7c7a-477f-81fd-4531a8427f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:21.698101 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdbc5f-7c7a-477f-81fd-4531a8427f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:21.699560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdbc5f-7c7a-477f-81fd-4531a8427f22 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:21.709590 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1379/2781] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:21.977102 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c380-fa35-4cf8-9116-cf270e776ba0 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:21.980346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c380-fa35-4cf8-9116-cf270e776ba0 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:21.980346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c380-fa35-4cf8-9116-cf270e776ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:21.996872 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-f380c380-fa35-4cf8-9116-cf270e776ba0 None None] MFA Rules not processed for user `70f0634c146244a1a0e91f89493cc076`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:21.998569 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f380c380-fa35-4cf8-9116-cf270e776ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:22.058890 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1403/2782] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 2 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:22.137641 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdbc5f-7c7a-477f-81fd-4531a8427f22 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:22.137641 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-afcdbc5f-7c7a-477f-81fd-4531a8427f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:22.145587 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdbc5f-7c7a-477f-81fd-4531a8427f22 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:22.150408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0022f-544a-49ef-bb0e-a312321e5e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:22.151285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0022f-544a-49ef-bb0e-a312321e5e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:22.151738 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0022f-544a-49ef-bb0e-a312321e5e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:22.152091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0022f-544a-49ef-bb0e-a312321e5e36 admin admin] PATH_INFO: `/v3/projects/41a67537298c432eb5df0b3f958ada0d` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:22.153543 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0022f-544a-49ef-bb0e-a312321e5e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a67537298c432eb5df0b3f958ada0d)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:22.156171 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0022f-544a-49ef-bb0e-a312321e5e36 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:22.220910 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380c380-fa35-4cf8-9116-cf270e776ba0 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:22.222325 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f380c380-fa35-4cf8-9116-cf270e776ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:22.269796 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=100 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:22.280207 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:22.289520 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f8d0022f-544a-49ef-bb0e-a312321e5e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a67537298c432eb5df0b3f958ada0d', 'request_id': 'req-f8d0022f-544a-49ef-bb0e-a312321e5e36'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:22.304495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380c380-fa35-4cf8-9116-cf270e776ba0 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:22.363457 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283987ec-57fb-4587-94a4-58f4f630ea6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00f3424dc2ee4f828638b3a8f5c9fc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:22.364125 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283987ec-57fb-4587-94a4-58f4f630ea6f service swift] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:22.364401 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283987ec-57fb-4587-94a4-58f4f630ea6f service swift] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:22.364673 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283987ec-57fb-4587-94a4-58f4f630ea6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:22.379145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f8d0022f-544a-49ef-bb0e-a312321e5e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a67537298c432eb5df0b3f958ada0d', 'request_id': 'req-f8d0022f-544a-49ef-bb0e-a312321e5e36'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:22.385845 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f8d0022f-544a-49ef-bb0e-a312321e5e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a67537298c432eb5df0b3f958ada0d', 'request_id': 'req-f8d0022f-544a-49ef-bb0e-a312321e5e36'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:22.396290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f8d0022f-544a-49ef-bb0e-a312321e5e36 admin admin] The token cache is being invalidate because project 41a67537298c432eb5df0b3f958ada0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:12:22.396567 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f8d0022f-544a-49ef-bb0e-a312321e5e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:22.397267 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f8d0022f-544a-49ef-bb0e-a312321e5e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:22.398791 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1380/2783] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:12:22 2022] DELETE /identity/v3/projects/41a67537298c432eb5df0b3f958ada0d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:22.403610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c48fd-ca15-47ab-9eea-9cb66c81cb28 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:22.403899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c48fd-ca15-47ab-9eea-9cb66c81cb28 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:22.404211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c48fd-ca15-47ab-9eea-9cb66c81cb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:22.423497 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-5f4c48fd-ca15-47ab-9eea-9cb66c81cb28 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:22.424703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5f4c48fd-ca15-47ab-9eea-9cb66c81cb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:22.425960 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283987ec-57fb-4587-94a4-58f4f630ea6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:22.427646 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283987ec-57fb-4587-94a4-58f4f630ea6f service swift] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:22.436275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1404/2784] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 2 14:12:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 14:12:22.486482 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1381/2785] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:12:22.494266 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16545001-d71b-49f2-aa51-dfbe9ae71a57 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:22.494561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16545001-d71b-49f2-aa51-dfbe9ae71a57 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:22.494843 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16545001-d71b-49f2-aa51-dfbe9ae71a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:22.512988 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-16545001-d71b-49f2-aa51-dfbe9ae71a57 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:22.514201 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-16545001-d71b-49f2-aa51-dfbe9ae71a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:22.522109 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1405/2786] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:22.526198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c48fd-ca15-47ab-9eea-9cb66c81cb28 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:22.536535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c48fd-ca15-47ab-9eea-9cb66c81cb28 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:22.541449 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4d1d4-ceb7-42d7-a97e-24fa33e76548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:22.542104 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4d1d4-ceb7-42d7-a97e-24fa33e76548 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:22.542394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4d1d4-ceb7-42d7-a97e-24fa33e76548 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:22.542685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4d1d4-ceb7-42d7-a97e-24fa33e76548 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:22.543389 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4d1d4-ceb7-42d7-a97e-24fa33e76548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:12:22.543732 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4d1d4-ceb7-42d7-a97e-24fa33e76548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:22.545990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4d1d4-ceb7-42d7-a97e-24fa33e76548 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:22.557546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1382/2787] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:12:22.561660 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16545001-d71b-49f2-aa51-dfbe9ae71a57 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:22.570833 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16545001-d71b-49f2-aa51-dfbe9ae71a57 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:22.576690 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7be7f-c93c-4630-84df-43985440d0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:22.577339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7be7f-c93c-4630-84df-43985440d0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:22.577625 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7be7f-c93c-4630-84df-43985440d0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:22.577948 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7be7f-c93c-4630-84df-43985440d0b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:22.578613 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7be7f-c93c-4630-84df-43985440d0b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:22.580561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7be7f-c93c-4630-84df-43985440d0b2 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:22.714927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1406/2788] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:12:22 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:12:22.720459 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4d1d4-ceb7-42d7-a97e-24fa33e76548 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:22.733593 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4d1d4-ceb7-42d7-a97e-24fa33e76548 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:22.788193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3c88b-5977-4df8-8e51-8a442a33a25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:22.788856 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3c88b-5977-4df8-8e51-8a442a33a25e admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:22.789142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3c88b-5977-4df8-8e51-8a442a33a25e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:22.789420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3c88b-5977-4df8-8e51-8a442a33a25e admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:22.790110 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3c88b-5977-4df8-8e51-8a442a33a25e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:22.792066 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3c88b-5977-4df8-8e51-8a442a33a25e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:22.972716 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1383/2789] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:12:22 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:12:22.972908 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7be7f-c93c-4630-84df-43985440d0b2 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:22.981302 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7be7f-c93c-4630-84df-43985440d0b2 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:22.986275 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a959b6-3421-44ba-b720-b25f23e4b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:22.986944 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a959b6-3421-44ba-b720-b25f23e4b4ca admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:22.987228 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a959b6-3421-44ba-b720-b25f23e4b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:22.987532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a959b6-3421-44ba-b720-b25f23e4b4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:22.988289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a959b6-3421-44ba-b720-b25f23e4b4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:22.989880 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a959b6-3421-44ba-b720-b25f23e4b4ca admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:23.000132 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1407/2790] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:23.022552 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3c88b-5977-4df8-8e51-8a442a33a25e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:23.033188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3c88b-5977-4df8-8e51-8a442a33a25e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:23.037754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99af7a8-dcc1-4309-b6ca-e03ecbce8fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:23.038423 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af7a8-dcc1-4309-b6ca-e03ecbce8fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:23.038689 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af7a8-dcc1-4309-b6ca-e03ecbce8fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:23.038982 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af7a8-dcc1-4309-b6ca-e03ecbce8fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:23.039721 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99af7a8-dcc1-4309-b6ca-e03ecbce8fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:23.041309 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99af7a8-dcc1-4309-b6ca-e03ecbce8fa5 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:23.051173 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1384/2791] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:23.055099 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a959b6-3421-44ba-b720-b25f23e4b4ca admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:23.065040 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a959b6-3421-44ba-b720-b25f23e4b4ca admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:23.069599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7057b-961a-4857-ad44-5ad2d1f886e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:23.070461 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7057b-961a-4857-ad44-5ad2d1f886e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:23.070739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7057b-961a-4857-ad44-5ad2d1f886e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:23.071010 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7057b-961a-4857-ad44-5ad2d1f886e0 admin admin] PATH_INFO: `/v3/projects/a6782705bfc64e8694fbffb62f28aa75/users/a7576b68db2b44d98f438bdb01762f0b/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:23.086440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7057b-961a-4857-ad44-5ad2d1f886e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6782705bfc64e8694fbffb62f28aa75, user_id=a7576b68db2b44d98f438bdb01762f0b, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:23.089112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7057b-961a-4857-ad44-5ad2d1f886e0 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:23.222664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1408/2792] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:12:23 2022] PUT /identity/v3/projects/a6782705bfc64e8694fbffb62f28aa75/users/a7576b68db2b44d98f438bdb01762f0b/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:23.233782 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd3484-692a-4827-a873-14b0a431dcd7 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:23.234274 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd3484-692a-4827-a873-14b0a431dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:23.234274 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd3484-692a-4827-a873-14b0a431dcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:23.262028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-f8dd3484-692a-4827-a873-14b0a431dcd7 None None] MFA Rules not processed for user `a7576b68db2b44d98f438bdb01762f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:23.263213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f8dd3484-692a-4827-a873-14b0a431dcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:23.280574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:23.329106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1385/2793] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:23.333693 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7057b-961a-4857-ad44-5ad2d1f886e0 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:23.348053 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:23.395191 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7057b-961a-4857-ad44-5ad2d1f886e0 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:23.399826 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673c337-8f95-434a-86b2-d9d83a8acd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:23.400477 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673c337-8f95-434a-86b2-d9d83a8acd3e admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:23.400755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673c337-8f95-434a-86b2-d9d83a8acd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:23.401029 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673c337-8f95-434a-86b2-d9d83a8acd3e admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:23.401710 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673c337-8f95-434a-86b2-d9d83a8acd3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:23.403617 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673c337-8f95-434a-86b2-d9d83a8acd3e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:23.543819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1409/2794] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:12:23 2022] POST /identity/v3/projects => generated 371 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:12:23.546196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd3484-692a-4827-a873-14b0a431dcd7 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:23.557462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd3484-692a-4827-a873-14b0a431dcd7 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:23.613286 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a64d3-f7ab-418c-b492-990bc720a946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:23.613956 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a64d3-f7ab-418c-b492-990bc720a946 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:23.614219 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a64d3-f7ab-418c-b492-990bc720a946 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:23.614487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a64d3-f7ab-418c-b492-990bc720a946 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:23.615156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a64d3-f7ab-418c-b492-990bc720a946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:23.617204 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a64d3-f7ab-418c-b492-990bc720a946 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:23.692342 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1386/2795] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:12:23 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:12:23.696409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673c337-8f95-434a-86b2-d9d83a8acd3e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:23.708366 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673c337-8f95-434a-86b2-d9d83a8acd3e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:23.713190 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2b1c4-5ca9-4edf-9ed6-9cfa6254e906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:23.714108 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2b1c4-5ca9-4edf-9ed6-9cfa6254e906 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:23.714389 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2b1c4-5ca9-4edf-9ed6-9cfa6254e906 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:23.714685 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2b1c4-5ca9-4edf-9ed6-9cfa6254e906 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:23.715413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2b1c4-5ca9-4edf-9ed6-9cfa6254e906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:23.717648 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2b1c4-5ca9-4edf-9ed6-9cfa6254e906 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:23.728544 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1410/2796] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:23.733059 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a64d3-f7ab-418c-b492-990bc720a946 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:23.743332 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a64d3-f7ab-418c-b492-990bc720a946 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:23.748131 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d81a9-d5f3-4aa3-a2d6-b46dc9034396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:23.749011 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d81a9-d5f3-4aa3-a2d6-b46dc9034396 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:23.749287 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d81a9-d5f3-4aa3-a2d6-b46dc9034396 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:23.749555 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d81a9-d5f3-4aa3-a2d6-b46dc9034396 admin admin] PATH_INFO: `/v3/projects/56d0ad97e1ab44b882b306bc079ec9a1/users/ccbc74edea1343a6aafaae7ea3ab713d/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:23.765622 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d81a9-d5f3-4aa3-a2d6-b46dc9034396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d0ad97e1ab44b882b306bc079ec9a1, user_id=ccbc74edea1343a6aafaae7ea3ab713d, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:23.770733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d81a9-d5f3-4aa3-a2d6-b46dc9034396 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:23.868955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1387/2797] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:12:23 2022] PUT /identity/v3/projects/56d0ad97e1ab44b882b306bc079ec9a1/users/ccbc74edea1343a6aafaae7ea3ab713d/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:12:23.873030 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2b1c4-5ca9-4edf-9ed6-9cfa6254e906 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:23.883025 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2b1c4-5ca9-4edf-9ed6-9cfa6254e906 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:23.941990 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce1616-a600-4cf7-bb20-676453ab9f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:23.942665 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce1616-a600-4cf7-bb20-676453ab9f4c admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:23.942951 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce1616-a600-4cf7-bb20-676453ab9f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:23.943226 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce1616-a600-4cf7-bb20-676453ab9f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:23.944027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce1616-a600-4cf7-bb20-676453ab9f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:23.945689 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce1616-a600-4cf7-bb20-676453ab9f4c admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:23.959698 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1411/2798] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:23.963690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d81a9-d5f3-4aa3-a2d6-b46dc9034396 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:23.971839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d81a9-d5f3-4aa3-a2d6-b46dc9034396 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:23.976421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c3946-73fb-44b4-ac9c-4d7f5a3743ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:23.977383 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c3946-73fb-44b4-ac9c-4d7f5a3743ed admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:23.977665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c3946-73fb-44b4-ac9c-4d7f5a3743ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:23.977936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c3946-73fb-44b4-ac9c-4d7f5a3743ed admin admin] PATH_INFO: `/v3/projects/56d0ad97e1ab44b882b306bc079ec9a1/users/ccbc74edea1343a6aafaae7ea3ab713d/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:23.980293 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c3946-73fb-44b4-ac9c-4d7f5a3743ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d0ad97e1ab44b882b306bc079ec9a1, user_id=ccbc74edea1343a6aafaae7ea3ab713d, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:23.982945 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c3946-73fb-44b4-ac9c-4d7f5a3743ed admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:23.993601 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1388/2799] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:12:23 2022] PUT /identity/v3/projects/56d0ad97e1ab44b882b306bc079ec9a1/users/ccbc74edea1343a6aafaae7ea3ab713d/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:24.005506 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ce70-ff40-4cee-a9d9-feec0d7f13e5 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:24.006017 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ce70-ff40-4cee-a9d9-feec0d7f13e5 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:24.006144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ce70-ff40-4cee-a9d9-feec0d7f13e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:24.033481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d4e8ce70-ff40-4cee-a9d9-feec0d7f13e5 None None] MFA Rules not processed for user `ccbc74edea1343a6aafaae7ea3ab713d`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:24.034670 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d4e8ce70-ff40-4cee-a9d9-feec0d7f13e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:24.103247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1412/2800] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:24.114573 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c3946-73fb-44b4-ac9c-4d7f5a3743ed admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:24.116277 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e06c3946-73fb-44b4-ac9c-4d7f5a3743ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:24.174800 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c3946-73fb-44b4-ac9c-4d7f5a3743ed admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:24.178446 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6d127-d30b-46bc-a4fc-9eb98c3a5a86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:24.179238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6d127-d30b-46bc-a4fc-9eb98c3a5a86 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:24.179562 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6d127-d30b-46bc-a4fc-9eb98c3a5a86 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:24.179841 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6d127-d30b-46bc-a4fc-9eb98c3a5a86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:24.189760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6d127-d30b-46bc-a4fc-9eb98c3a5a86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:24.191194 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6d127-d30b-46bc-a4fc-9eb98c3a5a86 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:24.200824 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1389/2801] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:25.374304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8ce70-ff40-4cee-a9d9-feec0d7f13e5 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:25.384044 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:25.438821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8ce70-ff40-4cee-a9d9-feec0d7f13e5 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:25.443468 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f6b00-eca4-40e6-9f03-ef7f56dc7e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:25.444339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f6b00-eca4-40e6-9f03-ef7f56dc7e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:25.444624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f6b00-eca4-40e6-9f03-ef7f56dc7e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:25.444898 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f6b00-eca4-40e6-9f03-ef7f56dc7e3f admin admin] PATH_INFO: `/v3/users/a7576b68db2b44d98f438bdb01762f0b` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:25.446084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f6b00-eca4-40e6-9f03-ef7f56dc7e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7576b68db2b44d98f438bdb01762f0b)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:25.448328 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f6b00-eca4-40e6-9f03-ef7f56dc7e3f admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:25.679163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8d6f6b00-eca4-40e6-9f03-ef7f56dc7e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7576b68db2b44d98f438bdb01762f0b'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:25.754243 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8d6f6b00-eca4-40e6-9f03-ef7f56dc7e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7576b68db2b44d98f438bdb01762f0b'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:25.768127 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8d6f6b00-eca4-40e6-9f03-ef7f56dc7e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7576b68db2b44d98f438bdb01762f0b'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:25.768798 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8d6f6b00-eca4-40e6-9f03-ef7f56dc7e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7576b68db2b44d98f438bdb01762f0b'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:25.775884 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-8d6f6b00-eca4-40e6-9f03-ef7f56dc7e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7576b68db2b44d98f438bdb01762f0b'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:25.782688 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1413/2802] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:12:25 2022] DELETE /identity/v3/users/a7576b68db2b44d98f438bdb01762f0b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:25.787169 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6b6c2-6b4b-46ef-8a1c-0a2b494ffeaf None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:25.787740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6b6c2-6b4b-46ef-8a1c-0a2b494ffeaf None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:25.787740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6b6c2-6b4b-46ef-8a1c-0a2b494ffeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:25.806295 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-0bd6b6c2-6b4b-46ef-8a1c-0a2b494ffeaf None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:25.807619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0bd6b6c2-6b4b-46ef-8a1c-0a2b494ffeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:25.816427 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:25.873447 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1390/2803] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:25.880739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f6b00-eca4-40e6-9f03-ef7f56dc7e3f admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:25.882230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-8d6f6b00-eca4-40e6-9f03-ef7f56dc7e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:25.947627 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f6b00-eca4-40e6-9f03-ef7f56dc7e3f admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:25.951764 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb00f-be00-472f-9bca-316d85359373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:25.952454 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb00f-be00-472f-9bca-316d85359373 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:25.952811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb00f-be00-472f-9bca-316d85359373 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:25.953083 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb00f-be00-472f-9bca-316d85359373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:25.962491 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdb00f-be00-472f-9bca-316d85359373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:25.963964 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdb00f-be00-472f-9bca-316d85359373 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:25.979933 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1414/2804] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:26.435620 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6b6c2-6b4b-46ef-8a1c-0a2b494ffeaf None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:26.437307 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-0bd6b6c2-6b4b-46ef-8a1c-0a2b494ffeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:26.449225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6b6c2-6b4b-46ef-8a1c-0a2b494ffeaf None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:26.453992 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:26.454855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:26.455142 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:26.455417 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] PATH_INFO: `/v3/projects/a6782705bfc64e8694fbffb62f28aa75` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:26.457002 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6782705bfc64e8694fbffb62f28aa75)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:26.458695 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:26.624679 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6782705bfc64e8694fbffb62f28aa75', 'request_id': 'req-1ae61922-44a9-4148-b51c-69bb5dc9461d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:26.699917 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6782705bfc64e8694fbffb62f28aa75', 'request_id': 'req-1ae61922-44a9-4148-b51c-69bb5dc9461d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:26.708386 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6782705bfc64e8694fbffb62f28aa75', 'request_id': 'req-1ae61922-44a9-4148-b51c-69bb5dc9461d'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:26.720677 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] The token cache is being invalidate because project a6782705bfc64e8694fbffb62f28aa75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:12:26.721012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:26.721685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:26.723232 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1391/2805] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:12:26 2022] DELETE /identity/v3/projects/a6782705bfc64e8694fbffb62f28aa75 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:26.727368 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb00f-be00-472f-9bca-316d85359373 service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:26.738701 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb00f-be00-472f-9bca-316d85359373 service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:26.768409 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:26.795651 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f58f69-7f40-4bcc-9ad0-55d9493dc478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:26.796555 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f58f69-7f40-4bcc-9ad0-55d9493dc478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:26.796835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f58f69-7f40-4bcc-9ad0-55d9493dc478 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:26.797113 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f58f69-7f40-4bcc-9ad0-55d9493dc478 admin admin] PATH_INFO: `/v3/users/ccbc74edea1343a6aafaae7ea3ab713d` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:26.798313 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f58f69-7f40-4bcc-9ad0-55d9493dc478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccbc74edea1343a6aafaae7ea3ab713d)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:26.800308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f58f69-7f40-4bcc-9ad0-55d9493dc478 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:26.987249 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-97f58f69-7f40-4bcc-9ad0-55d9493dc478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccbc74edea1343a6aafaae7ea3ab713d'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:27.061433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-97f58f69-7f40-4bcc-9ad0-55d9493dc478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccbc74edea1343a6aafaae7ea3ab713d'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:27.074279 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-97f58f69-7f40-4bcc-9ad0-55d9493dc478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccbc74edea1343a6aafaae7ea3ab713d'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:27.075553 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-97f58f69-7f40-4bcc-9ad0-55d9493dc478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccbc74edea1343a6aafaae7ea3ab713d'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:27.084493 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-97f58f69-7f40-4bcc-9ad0-55d9493dc478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccbc74edea1343a6aafaae7ea3ab713d'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:27.092282 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1415/2806] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:12:26 2022] DELETE /identity/v3/users/ccbc74edea1343a6aafaae7ea3ab713d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:27.507229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:27.508760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:27.524666 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae61922-44a9-4148-b51c-69bb5dc9461d admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:27.591799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714eb02-ba54-4a54-b49d-bd995d84db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:27.591799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714eb02-ba54-4a54-b49d-bd995d84db23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:27.591799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714eb02-ba54-4a54-b49d-bd995d84db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:27.591799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714eb02-ba54-4a54-b49d-bd995d84db23 admin admin] PATH_INFO: `/v3/projects/56d0ad97e1ab44b882b306bc079ec9a1` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:27.593165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714eb02-ba54-4a54-b49d-bd995d84db23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d0ad97e1ab44b882b306bc079ec9a1)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:27.595111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714eb02-ba54-4a54-b49d-bd995d84db23 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:27.734557 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:27.741271 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2714eb02-ba54-4a54-b49d-bd995d84db23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d0ad97e1ab44b882b306bc079ec9a1', 'request_id': 'req-2714eb02-ba54-4a54-b49d-bd995d84db23'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:27.808158 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2714eb02-ba54-4a54-b49d-bd995d84db23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d0ad97e1ab44b882b306bc079ec9a1', 'request_id': 'req-2714eb02-ba54-4a54-b49d-bd995d84db23'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:27.815009 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2714eb02-ba54-4a54-b49d-bd995d84db23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d0ad97e1ab44b882b306bc079ec9a1', 'request_id': 'req-2714eb02-ba54-4a54-b49d-bd995d84db23'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:27.825687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2714eb02-ba54-4a54-b49d-bd995d84db23 admin admin] The token cache is being invalidate because project 56d0ad97e1ab44b882b306bc079ec9a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:12:27.825972 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2714eb02-ba54-4a54-b49d-bd995d84db23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:27.826625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-2714eb02-ba54-4a54-b49d-bd995d84db23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:27.828568 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1392/2807] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:12:27 2022] DELETE /identity/v3/projects/56d0ad97e1ab44b882b306bc079ec9a1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:27.833242 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35d7b8-4c19-428c-b26a-e01abaae9eae None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:27.833735 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35d7b8-4c19-428c-b26a-e01abaae9eae None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:27.833840 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35d7b8-4c19-428c-b26a-e01abaae9eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:27.857039 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-2a35d7b8-4c19-428c-b26a-e01abaae9eae None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:27.857039 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2a35d7b8-4c19-428c-b26a-e01abaae9eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:27.922231 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1416/2808] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:27.923998 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4a4a4-d186-4ecb-af7e-b78228148a2a None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:27.924460 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4a4a4-d186-4ecb-af7e-b78228148a2a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:27.924969 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4a4a4-d186-4ecb-af7e-b78228148a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:27.944255 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-86a4a4a4-d186-4ecb-af7e-b78228148a2a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:27.945541 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-86a4a4a4-d186-4ecb-af7e-b78228148a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:27.955686 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1393/2809] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:12:27.960134 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35d7b8-4c19-428c-b26a-e01abaae9eae None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:27.970402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35d7b8-4c19-428c-b26a-e01abaae9eae None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:27.974962 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32220e-0577-47ea-ad75-6cd62854304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:27.975666 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32220e-0577-47ea-ad75-6cd62854304d admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:27.975952 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32220e-0577-47ea-ad75-6cd62854304d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:27.976230 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32220e-0577-47ea-ad75-6cd62854304d admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:27.976961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32220e-0577-47ea-ad75-6cd62854304d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:12:27.977267 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32220e-0577-47ea-ad75-6cd62854304d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:27.979130 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32220e-0577-47ea-ad75-6cd62854304d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:27.992117 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1417/2810] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:12:28.003859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4a4a4-d186-4ecb-af7e-b78228148a2a None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:28.013265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4a4a4-d186-4ecb-af7e-b78228148a2a None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:28.018026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e6f6-5fd0-4196-99f6-40da494ba5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:28.023548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e6f6-5fd0-4196-99f6-40da494ba5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:28.023548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e6f6-5fd0-4196-99f6-40da494ba5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:28.023548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e6f6-5fd0-4196-99f6-40da494ba5f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:28.023548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06e6f6-5fd0-4196-99f6-40da494ba5f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:28.023548 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06e6f6-5fd0-4196-99f6-40da494ba5f8 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:28.121550 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1394/2811] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:12:28 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:12:28.125731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32220e-0577-47ea-ad75-6cd62854304d admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:28.136830 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32220e-0577-47ea-ad75-6cd62854304d admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:28.171041 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:28.198740 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cf34a-5780-4ee3-b4a5-84e513a62ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:28.199440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cf34a-5780-4ee3-b4a5-84e513a62ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:28.204811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cf34a-5780-4ee3-b4a5-84e513a62ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:28.204811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cf34a-5780-4ee3-b4a5-84e513a62ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:28.204811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cf34a-5780-4ee3-b4a5-84e513a62ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:28.204811 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cf34a-5780-4ee3-b4a5-84e513a62ca9 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:28.294347 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1418/2812] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:12:28 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:12:28.298481 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e6f6-5fd0-4196-99f6-40da494ba5f8 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:28.309163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e6f6-5fd0-4196-99f6-40da494ba5f8 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:28.313882 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1370121-cb48-42e7-bfe3-e3c6c448f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:28.314549 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1370121-cb48-42e7-bfe3-e3c6c448f6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:28.314829 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1370121-cb48-42e7-bfe3-e3c6c448f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:28.315135 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1370121-cb48-42e7-bfe3-e3c6c448f6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:28.315892 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1370121-cb48-42e7-bfe3-e3c6c448f6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:28.317629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1370121-cb48-42e7-bfe3-e3c6c448f6d7 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:28.329111 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1395/2813] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:28.333445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cf34a-5780-4ee3-b4a5-84e513a62ca9 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:28.344536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cf34a-5780-4ee3-b4a5-84e513a62ca9 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:28.349228 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2b66b-21b7-4e1a-ae17-fb36edc1a8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:28.349935 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b66b-21b7-4e1a-ae17-fb36edc1a8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:28.350222 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b66b-21b7-4e1a-ae17-fb36edc1a8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:28.350502 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b66b-21b7-4e1a-ae17-fb36edc1a8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:28.351233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2b66b-21b7-4e1a-ae17-fb36edc1a8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:28.353236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2b66b-21b7-4e1a-ae17-fb36edc1a8f4 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:28.364480 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1419/2814] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:28.371885 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1370121-cb48-42e7-bfe3-e3c6c448f6d7 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:28.382054 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1370121-cb48-42e7-bfe3-e3c6c448f6d7 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:28.386736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c0b4d-afc0-4bb2-8d17-eb3c6d6c14f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:28.387639 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c0b4d-afc0-4bb2-8d17-eb3c6d6c14f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:28.387925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c0b4d-afc0-4bb2-8d17-eb3c6d6c14f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:28.388201 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c0b4d-afc0-4bb2-8d17-eb3c6d6c14f4 admin admin] PATH_INFO: `/v3/projects/bbcf17d3ef3a421bbc61376c6d742a93/users/32627be5928c45cfa1b8a33ccd02535a/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:28.403145 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c0b4d-afc0-4bb2-8d17-eb3c6d6c14f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcf17d3ef3a421bbc61376c6d742a93, user_id=32627be5928c45cfa1b8a33ccd02535a, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:28.412000 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c0b4d-afc0-4bb2-8d17-eb3c6d6c14f4 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:28.497580 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1396/2815] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:12:28 2022] PUT /identity/v3/projects/bbcf17d3ef3a421bbc61376c6d742a93/users/32627be5928c45cfa1b8a33ccd02535a/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:28.509060 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3c81b-d0bc-4d08-b986-a956ee32b4d5 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:28.510907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3c81b-d0bc-4d08-b986-a956ee32b4d5 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:28.510907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3c81b-d0bc-4d08-b986-a956ee32b4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:28.541766 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-81e3c81b-d0bc-4d08-b986-a956ee32b4d5 None None] MFA Rules not processed for user `32627be5928c45cfa1b8a33ccd02535a`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:28.544145 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-81e3c81b-d0bc-4d08-b986-a956ee32b4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:28.620521 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1420/2816] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:28.625453 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c0b4d-afc0-4bb2-8d17-eb3c6d6c14f4 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:28.704508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c0b4d-afc0-4bb2-8d17-eb3c6d6c14f4 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:28.709352 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e17b3-3f81-4e72-9cc6-17e5d5e18004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:28.710012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e17b3-3f81-4e72-9cc6-17e5d5e18004 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:28.710292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e17b3-3f81-4e72-9cc6-17e5d5e18004 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:28.710563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e17b3-3f81-4e72-9cc6-17e5d5e18004 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:28.711256 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e17b3-3f81-4e72-9cc6-17e5d5e18004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:28.713236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e17b3-3f81-4e72-9cc6-17e5d5e18004 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:28.810148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1397/2817] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:12:28 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:12:28.811832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3c81b-d0bc-4d08-b986-a956ee32b4d5 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:28.822871 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3c81b-d0bc-4d08-b986-a956ee32b4d5 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:28.882258 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70364d0-ebf7-46f9-b607-1f132b84620a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:28.883022 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70364d0-ebf7-46f9-b607-1f132b84620a admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:28.883314 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70364d0-ebf7-46f9-b607-1f132b84620a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:28.883626 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70364d0-ebf7-46f9-b607-1f132b84620a admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:28.884331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70364d0-ebf7-46f9-b607-1f132b84620a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:28.886284 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70364d0-ebf7-46f9-b607-1f132b84620a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:29.001189 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1421/2818] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:12:28 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:12:29.005147 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e17b3-3f81-4e72-9cc6-17e5d5e18004 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:29.015876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e17b3-3f81-4e72-9cc6-17e5d5e18004 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:29.020496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09094b97-4b7c-49d3-83da-bd325cd655bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:29.021260 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09094b97-4b7c-49d3-83da-bd325cd655bd admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:29.021541 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09094b97-4b7c-49d3-83da-bd325cd655bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:29.021815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09094b97-4b7c-49d3-83da-bd325cd655bd admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:29.022538 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09094b97-4b7c-49d3-83da-bd325cd655bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:29.024172 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09094b97-4b7c-49d3-83da-bd325cd655bd admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:29.035396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1398/2819] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:12:29.039775 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70364d0-ebf7-46f9-b607-1f132b84620a admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:29.050485 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70364d0-ebf7-46f9-b607-1f132b84620a admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:29.055150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108a047-4547-47e3-9af8-03c940e17303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:29.056115 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108a047-4547-47e3-9af8-03c940e17303 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:29.056393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108a047-4547-47e3-9af8-03c940e17303 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:29.056667 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108a047-4547-47e3-9af8-03c940e17303 admin admin] PATH_INFO: `/v3/projects/920a4657d6da447e8e58b1eec3caf016/users/8ae408ff105c4a41a91fd793fb2f4b53/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:29.072192 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108a047-4547-47e3-9af8-03c940e17303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920a4657d6da447e8e58b1eec3caf016, user_id=8ae408ff105c4a41a91fd793fb2f4b53, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:29.074818 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108a047-4547-47e3-9af8-03c940e17303 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:29.172686 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1422/2820] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:12:29 2022] PUT /identity/v3/projects/920a4657d6da447e8e58b1eec3caf016/users/8ae408ff105c4a41a91fd793fb2f4b53/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:29.176640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09094b97-4b7c-49d3-83da-bd325cd655bd admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:29.187183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09094b97-4b7c-49d3-83da-bd325cd655bd admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:29.231040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:29.256072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5babb-dfbf-4dcf-bebe-6ec7c2dfc815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:29.256748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5babb-dfbf-4dcf-bebe-6ec7c2dfc815 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:29.257034 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5babb-dfbf-4dcf-bebe-6ec7c2dfc815 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:29.257317 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5babb-dfbf-4dcf-bebe-6ec7c2dfc815 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:29.258199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5babb-dfbf-4dcf-bebe-6ec7c2dfc815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:29.259916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5babb-dfbf-4dcf-bebe-6ec7c2dfc815 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:29.273017 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1399/2821] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:29.277192 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108a047-4547-47e3-9af8-03c940e17303 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:29.290270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108a047-4547-47e3-9af8-03c940e17303 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:29.294676 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acf126-4c21-4b2f-a925-5c723bc5fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:29.296163 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acf126-4c21-4b2f-a925-5c723bc5fad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:29.296443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acf126-4c21-4b2f-a925-5c723bc5fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:29.296740 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acf126-4c21-4b2f-a925-5c723bc5fad5 admin admin] PATH_INFO: `/v3/projects/920a4657d6da447e8e58b1eec3caf016/users/8ae408ff105c4a41a91fd793fb2f4b53/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:29.299977 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acf126-4c21-4b2f-a925-5c723bc5fad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920a4657d6da447e8e58b1eec3caf016, user_id=8ae408ff105c4a41a91fd793fb2f4b53, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:29.301600 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acf126-4c21-4b2f-a925-5c723bc5fad5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:29.307854 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:29.313937 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1423/2822] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:12:29 2022] PUT /identity/v3/projects/920a4657d6da447e8e58b1eec3caf016/users/8ae408ff105c4a41a91fd793fb2f4b53/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:29.376566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00c30-cbc2-40ba-8121-25fcdebdad95 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:29.376888 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00c30-cbc2-40ba-8121-25fcdebdad95 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:29.377132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00c30-cbc2-40ba-8121-25fcdebdad95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:29.419905 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-11d00c30-cbc2-40ba-8121-25fcdebdad95 None None] MFA Rules not processed for user `8ae408ff105c4a41a91fd793fb2f4b53`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:29.422581 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-11d00c30-cbc2-40ba-8121-25fcdebdad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:29.498656 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1400/2823] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:29 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:29.508729 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acf126-4c21-4b2f-a925-5c723bc5fad5 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:29.511070 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-13acf126-4c21-4b2f-a925-5c723bc5fad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:29.578753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acf126-4c21-4b2f-a925-5c723bc5fad5 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:29.583252 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94515a-e545-4279-bcbd-b505e066d546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:29.584137 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94515a-e545-4279-bcbd-b505e066d546 service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:29.584624 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94515a-e545-4279-bcbd-b505e066d546 service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:29.585093 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94515a-e545-4279-bcbd-b505e066d546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:29.596359 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94515a-e545-4279-bcbd-b505e066d546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:29.598225 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94515a-e545-4279-bcbd-b505e066d546 service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:29.610739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1424/2824] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:29 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:31.134196 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00c30-cbc2-40ba-8121-25fcdebdad95 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:31.136911 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-11d00c30-cbc2-40ba-8121-25fcdebdad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:31.229181 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00c30-cbc2-40ba-8121-25fcdebdad95 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:31.235742 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b304520-c8ea-492d-8894-5aac5356af27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:31.236516 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b304520-c8ea-492d-8894-5aac5356af27 service placement] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:31.237521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b304520-c8ea-492d-8894-5aac5356af27 service placement] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:31.237521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b304520-c8ea-492d-8894-5aac5356af27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:31.239377 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6b304520-c8ea-492d-8894-5aac5356af27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:31.255672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94515a-e545-4279-bcbd-b505e066d546 service cinder] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:31.257640 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-cf94515a-e545-4279-bcbd-b505e066d546 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:31.258336 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b304520-c8ea-492d-8894-5aac5356af27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:31.260198 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b304520-c8ea-492d-8894-5aac5356af27 service placement] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:31.274348 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1401/2825] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:31.341221 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94515a-e545-4279-bcbd-b505e066d546 service cinder] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:31.346400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4ddb8-8dae-475f-bedb-96e691e20ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:31.347260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ddb8-8dae-475f-bedb-96e691e20ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:31.347575 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ddb8-8dae-475f-bedb-96e691e20ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:31.347849 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ddb8-8dae-475f-bedb-96e691e20ee8 admin admin] PATH_INFO: `/v3/users/def730d1731b41dc82fd0592414624ca` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:31.349066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4ddb8-8dae-475f-bedb-96e691e20ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=def730d1731b41dc82fd0592414624ca)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:31.350978 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4ddb8-8dae-475f-bedb-96e691e20ee8 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:31.570850 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-52e4ddb8-8dae-475f-bedb-96e691e20ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def730d1731b41dc82fd0592414624ca'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:31.645912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-52e4ddb8-8dae-475f-bedb-96e691e20ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def730d1731b41dc82fd0592414624ca'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:31.659793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-52e4ddb8-8dae-475f-bedb-96e691e20ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def730d1731b41dc82fd0592414624ca'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:31.660575 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-52e4ddb8-8dae-475f-bedb-96e691e20ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def730d1731b41dc82fd0592414624ca'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:31.668570 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-52e4ddb8-8dae-475f-bedb-96e691e20ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def730d1731b41dc82fd0592414624ca'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:31.674481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1425/2826] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:12:31 2022] DELETE /identity/v3/users/def730d1731b41dc82fd0592414624ca => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:12:31.986554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b304520-c8ea-492d-8894-5aac5356af27 service placement] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:31.998915 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b304520-c8ea-492d-8894-5aac5356af27 service placement] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:32.048540 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:32.059990 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:32.061487 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:32.061773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:32.062047 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] PATH_INFO: `/v3/projects/ce5b2d8c86064b61a989a357c2a6655e` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:32.063236 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5b2d8c86064b61a989a357c2a6655e)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:32.065214 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:32.184085 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5b2d8c86064b61a989a357c2a6655e', 'request_id': 'req-f8632006-1542-42ca-b2f9-acaed65b4e5e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:32.265071 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5b2d8c86064b61a989a357c2a6655e', 'request_id': 'req-f8632006-1542-42ca-b2f9-acaed65b4e5e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:32.272709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5b2d8c86064b61a989a357c2a6655e', 'request_id': 'req-f8632006-1542-42ca-b2f9-acaed65b4e5e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:32.284638 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] The token cache is being invalidate because project ce5b2d8c86064b61a989a357c2a6655e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:12:32.284950 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:32.285619 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:32.287421 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1402/2827] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:12:31 2022] DELETE /identity/v3/projects/ce5b2d8c86064b61a989a357c2a6655e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:32.291577 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4ddb8-8dae-475f-bedb-96e691e20ee8 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:32.293604 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-52e4ddb8-8dae-475f-bedb-96e691e20ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:32.306483 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4ddb8-8dae-475f-bedb-96e691e20ee8 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:32.322969 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:32.362076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e0847-ca0e-4ede-8e5f-928488a08da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:32.363548 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e0847-ca0e-4ede-8e5f-928488a08da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:32.363879 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e0847-ca0e-4ede-8e5f-928488a08da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:32.364165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e0847-ca0e-4ede-8e5f-928488a08da5 admin admin] PATH_INFO: `/v3/users/639fbc66f1694f4888f28f4d6acd433a` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:32.365460 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e0847-ca0e-4ede-8e5f-928488a08da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=639fbc66f1694f4888f28f4d6acd433a)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:32.367864 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e0847-ca0e-4ede-8e5f-928488a08da5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:32.667214 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c90e0847-ca0e-4ede-8e5f-928488a08da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639fbc66f1694f4888f28f4d6acd433a'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:32.779210 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c90e0847-ca0e-4ede-8e5f-928488a08da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639fbc66f1694f4888f28f4d6acd433a'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:32.793559 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c90e0847-ca0e-4ede-8e5f-928488a08da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639fbc66f1694f4888f28f4d6acd433a'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:32.794221 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c90e0847-ca0e-4ede-8e5f-928488a08da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639fbc66f1694f4888f28f4d6acd433a'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:32.801154 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-c90e0847-ca0e-4ede-8e5f-928488a08da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639fbc66f1694f4888f28f4d6acd433a'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:32.807171 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1426/2828] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:12:32 2022] DELETE /identity/v3/users/639fbc66f1694f4888f28f4d6acd433a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:32.902895 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:32.905006 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:32.917439 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8632006-1542-42ca-b2f9-acaed65b4e5e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:32.975462 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb54cf5-3fb4-4981-a4e2-0e923421498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:32.976389 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb54cf5-3fb4-4981-a4e2-0e923421498b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:32.976664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb54cf5-3fb4-4981-a4e2-0e923421498b admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:32.976938 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb54cf5-3fb4-4981-a4e2-0e923421498b admin admin] PATH_INFO: `/v3/users/32627be5928c45cfa1b8a33ccd02535a` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:32.978143 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb54cf5-3fb4-4981-a4e2-0e923421498b admin admin] RBAC: Authorizing `identity:delete_user(user_id=32627be5928c45cfa1b8a33ccd02535a)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:32.980351 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb54cf5-3fb4-4981-a4e2-0e923421498b admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:33.081886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e0847-ca0e-4ede-8e5f-928488a08da5 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:33.083494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c90e0847-ca0e-4ede-8e5f-928488a08da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:33.097240 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e0847-ca0e-4ede-8e5f-928488a08da5 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:33.102841 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659beb9-9997-464a-9592-b189af8bebd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:33.104049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659beb9-9997-464a-9592-b189af8bebd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:33.104338 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659beb9-9997-464a-9592-b189af8bebd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:33.104614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659beb9-9997-464a-9592-b189af8bebd5 admin admin] PATH_INFO: `/v3/projects/063f421f683b42559b22d4cef30cb5b8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:33.105809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659beb9-9997-464a-9592-b189af8bebd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=063f421f683b42559b22d4cef30cb5b8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:33.107753 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659beb9-9997-464a-9592-b189af8bebd5 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:33.161356 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bcb54cf5-3fb4-4981-a4e2-0e923421498b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32627be5928c45cfa1b8a33ccd02535a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:33.173361 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bcb54cf5-3fb4-4981-a4e2-0e923421498b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32627be5928c45cfa1b8a33ccd02535a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:33.180218 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bcb54cf5-3fb4-4981-a4e2-0e923421498b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32627be5928c45cfa1b8a33ccd02535a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:33.181003 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bcb54cf5-3fb4-4981-a4e2-0e923421498b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32627be5928c45cfa1b8a33ccd02535a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:33.217267 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-7659beb9-9997-464a-9592-b189af8bebd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '063f421f683b42559b22d4cef30cb5b8', 'request_id': 'req-7659beb9-9997-464a-9592-b189af8bebd5'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:33.251028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bcb54cf5-3fb4-4981-a4e2-0e923421498b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32627be5928c45cfa1b8a33ccd02535a'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:33.252760 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:33.258016 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1403/2829] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:12:32 2022] DELETE /identity/v3/users/32627be5928c45cfa1b8a33ccd02535a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:33.262331 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00e650-a43d-45f6-bf97-7c09cec40058 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:33.262621 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00e650-a43d-45f6-bf97-7c09cec40058 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:33.262952 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00e650-a43d-45f6-bf97-7c09cec40058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:33.281038 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-5d00e650-a43d-45f6-bf97-7c09cec40058 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:33.282216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5d00e650-a43d-45f6-bf97-7c09cec40058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:33.325494 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-7659beb9-9997-464a-9592-b189af8bebd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '063f421f683b42559b22d4cef30cb5b8', 'request_id': 'req-7659beb9-9997-464a-9592-b189af8bebd5'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:33.333050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-7659beb9-9997-464a-9592-b189af8bebd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '063f421f683b42559b22d4cef30cb5b8', 'request_id': 'req-7659beb9-9997-464a-9592-b189af8bebd5'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:33.340229 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1404/2830] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:12:33.347776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-7659beb9-9997-464a-9592-b189af8bebd5 admin admin] The token cache is being invalidate because project 063f421f683b42559b22d4cef30cb5b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:12:33.347776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-7659beb9-9997-464a-9592-b189af8bebd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:33.347776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-7659beb9-9997-464a-9592-b189af8bebd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:33.347776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1427/2831] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:12:33 2022] DELETE /identity/v3/projects/063f421f683b42559b22d4cef30cb5b8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:12:33.350135 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00e650-a43d-45f6-bf97-7c09cec40058 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:33.351348 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49700385-5c2e-4597-8b19-492262b01072 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:33.351515 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5d00e650-a43d-45f6-bf97-7c09cec40058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:33.351881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49700385-5c2e-4597-8b19-492262b01072 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:33.352308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49700385-5c2e-4597-8b19-492262b01072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:33.371378 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-49700385-5c2e-4597-8b19-492262b01072 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:33.372695 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-49700385-5c2e-4597-8b19-492262b01072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:33.381257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1428/2832] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:33.389463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da92f7-cd60-4519-a9f9-fbcb1e0909d6 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:33.389754 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da92f7-cd60-4519-a9f9-fbcb1e0909d6 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:33.393713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da92f7-cd60-4519-a9f9-fbcb1e0909d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:33.407996 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-19da92f7-cd60-4519-a9f9-fbcb1e0909d6 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:33.408660 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00e650-a43d-45f6-bf97-7c09cec40058 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:33.409166 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-19da92f7-cd60-4519-a9f9-fbcb1e0909d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:33.412778 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90005c-1d79-40cb-9266-d9f215eb1338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:33.413422 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90005c-1d79-40cb-9266-d9f215eb1338 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:33.413709 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90005c-1d79-40cb-9266-d9f215eb1338 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:33.413987 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90005c-1d79-40cb-9266-d9f215eb1338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:33.415754 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6c90005c-1d79-40cb-9266-d9f215eb1338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:33.417265 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1429/2833] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:12:33.421956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da92f7-cd60-4519-a9f9-fbcb1e0909d6 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:33.428800 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90005c-1d79-40cb-9266-d9f215eb1338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:33.430377 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90005c-1d79-40cb-9266-d9f215eb1338 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:33.430705 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da92f7-cd60-4519-a9f9-fbcb1e0909d6 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:33.435270 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db179d99-e021-453f-86f9-c77dd52f727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:33.436515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db179d99-e021-453f-86f9-c77dd52f727d admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:33.436796 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db179d99-e021-453f-86f9-c77dd52f727d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:33.437062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db179d99-e021-453f-86f9-c77dd52f727d admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:33.437771 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db179d99-e021-453f-86f9-c77dd52f727d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:12:33.438071 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db179d99-e021-453f-86f9-c77dd52f727d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:33.439736 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db179d99-e021-453f-86f9-c77dd52f727d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:33.442101 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:33.442315 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1405/2834] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:12:33.456761 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1430/2835] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:12:33.459610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90005c-1d79-40cb-9266-d9f215eb1338 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:33.469465 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90005c-1d79-40cb-9266-d9f215eb1338 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:33.474161 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07d3db-f2ad-428f-971b-47da13ce2c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:33.474810 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07d3db-f2ad-428f-971b-47da13ce2c07 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:33.475092 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07d3db-f2ad-428f-971b-47da13ce2c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:33.475365 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07d3db-f2ad-428f-971b-47da13ce2c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:33.476139 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07d3db-f2ad-428f-971b-47da13ce2c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:33.477982 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07d3db-f2ad-428f-971b-47da13ce2c07 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:33.575194 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1406/2836] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:12:33 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:12:33.579629 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db179d99-e021-453f-86f9-c77dd52f727d admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:33.589755 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db179d99-e021-453f-86f9-c77dd52f727d admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:33.648960 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd794c74-320d-41df-ad5c-90384447839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:33.649737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd794c74-320d-41df-ad5c-90384447839e admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:33.650096 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd794c74-320d-41df-ad5c-90384447839e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:33.650446 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd794c74-320d-41df-ad5c-90384447839e admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:33.651221 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd794c74-320d-41df-ad5c-90384447839e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:33.653369 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd794c74-320d-41df-ad5c-90384447839e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:33.728315 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1431/2837] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:12:33 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:12:33.733157 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07d3db-f2ad-428f-971b-47da13ce2c07 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:33.743618 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07d3db-f2ad-428f-971b-47da13ce2c07 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:33.749050 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b10314-736b-41ed-9891-0131d6a75b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:33.749746 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b10314-736b-41ed-9891-0131d6a75b0e admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:33.750269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b10314-736b-41ed-9891-0131d6a75b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:33.750433 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b10314-736b-41ed-9891-0131d6a75b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:33.751154 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b10314-736b-41ed-9891-0131d6a75b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:33.752829 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b10314-736b-41ed-9891-0131d6a75b0e admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:33.763858 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1407/2838] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:33.768021 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd794c74-320d-41df-ad5c-90384447839e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:33.778026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd794c74-320d-41df-ad5c-90384447839e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:33.783158 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16c119-26dc-42b6-9c66-bc65ad8346ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:33.783844 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16c119-26dc-42b6-9c66-bc65ad8346ed admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:33.784133 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16c119-26dc-42b6-9c66-bc65ad8346ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:33.784412 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16c119-26dc-42b6-9c66-bc65ad8346ed admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:33.785133 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16c119-26dc-42b6-9c66-bc65ad8346ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:33.786727 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16c119-26dc-42b6-9c66-bc65ad8346ed admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:33.797583 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1432/2839] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:33.801502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b10314-736b-41ed-9891-0131d6a75b0e admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:33.811213 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b10314-736b-41ed-9891-0131d6a75b0e admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:33.816166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d0190-a25f-4767-9c42-f6a418174508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:33.817374 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d0190-a25f-4767-9c42-f6a418174508 admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:33.817817 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d0190-a25f-4767-9c42-f6a418174508 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:33.818097 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d0190-a25f-4767-9c42-f6a418174508 admin admin] PATH_INFO: `/v3/projects/a51bd65d85a34d9eac017834c730869f/users/1233b3acb15c4756a088e90fd958fe2f/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:33.818318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16c119-26dc-42b6-9c66-bc65ad8346ed admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:33.820014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-db16c119-26dc-42b6-9c66-bc65ad8346ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:33.833498 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16c119-26dc-42b6-9c66-bc65ad8346ed admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:33.838423 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:33.839744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:33.840062 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:33.840349 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] PATH_INFO: `/v3/projects/bbcf17d3ef3a421bbc61376c6d742a93` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:33.842839 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbcf17d3ef3a421bbc61376c6d742a93)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:33.843445 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d0190-a25f-4767-9c42-f6a418174508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51bd65d85a34d9eac017834c730869f, user_id=1233b3acb15c4756a088e90fd958fe2f, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:33.845282 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:33.846122 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d0190-a25f-4767-9c42-f6a418174508 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:33.933783 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1408/2840] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:12:33 2022] PUT /identity/v3/projects/a51bd65d85a34d9eac017834c730869f/users/1233b3acb15c4756a088e90fd958fe2f/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:33.938616 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b93897-cc25-4cb7-854c-6c062c254e9a None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:33.938981 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b93897-cc25-4cb7-854c-6c062c254e9a None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:33.939270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b93897-cc25-4cb7-854c-6c062c254e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:33.955862 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-97b93897-cc25-4cb7-854c-6c062c254e9a None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:33.957051 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-97b93897-cc25-4cb7-854c-6c062c254e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:33.987160 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbcf17d3ef3a421bbc61376c6d742a93', 'request_id': 'req-77445c86-049c-46cb-96b5-52521004cf5e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:33.999097 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:34.017675 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1409/2841] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:12:34.027396 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b93897-cc25-4cb7-854c-6c062c254e9a None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:34.028765 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-97b93897-cc25-4cb7-854c-6c062c254e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:34.059360 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbcf17d3ef3a421bbc61376c6d742a93', 'request_id': 'req-77445c86-049c-46cb-96b5-52521004cf5e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:34.066681 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbcf17d3ef3a421bbc61376c6d742a93', 'request_id': 'req-77445c86-049c-46cb-96b5-52521004cf5e'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:34.077370 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] The token cache is being invalidate because project bbcf17d3ef3a421bbc61376c6d742a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:12:34.077655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:34.078312 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:34.079900 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1433/2842] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:12:33 2022] DELETE /identity/v3/projects/bbcf17d3ef3a421bbc61376c6d742a93 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:12:34.083712 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:34.084955 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:34.085703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b93897-cc25-4cb7-854c-6c062c254e9a None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:34.135104 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516e588-9f66-407c-b873-2ff43ad91b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:34.135789 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516e588-9f66-407c-b873-2ff43ad91b19 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:34.136077 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516e588-9f66-407c-b873-2ff43ad91b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:34.136356 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516e588-9f66-407c-b873-2ff43ad91b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:34.138166 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e516e588-9f66-407c-b873-2ff43ad91b19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:34.146144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:34.149876 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77445c86-049c-46cb-96b5-52521004cf5e admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:34.151296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516e588-9f66-407c-b873-2ff43ad91b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:34.152746 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516e588-9f66-407c-b873-2ff43ad91b19 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:34.155076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d42c7-57d1-4142-ac63-92b18d34c963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:34.155973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d42c7-57d1-4142-ac63-92b18d34c963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:34.156308 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d42c7-57d1-4142-ac63-92b18d34c963 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:34.156582 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d42c7-57d1-4142-ac63-92b18d34c963 admin admin] PATH_INFO: `/v3/users/8ae408ff105c4a41a91fd793fb2f4b53` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:34.157814 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d42c7-57d1-4142-ac63-92b18d34c963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae408ff105c4a41a91fd793fb2f4b53)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:34.159805 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d42c7-57d1-4142-ac63-92b18d34c963 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:34.163634 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1410/2843] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:34.351813 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-671d42c7-57d1-4142-ac63-92b18d34c963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae408ff105c4a41a91fd793fb2f4b53'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:34.442330 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-671d42c7-57d1-4142-ac63-92b18d34c963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae408ff105c4a41a91fd793fb2f4b53'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:34.455543 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-671d42c7-57d1-4142-ac63-92b18d34c963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae408ff105c4a41a91fd793fb2f4b53'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:34.456223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-671d42c7-57d1-4142-ac63-92b18d34c963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae408ff105c4a41a91fd793fb2f4b53'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:34.463061 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-671d42c7-57d1-4142-ac63-92b18d34c963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae408ff105c4a41a91fd793fb2f4b53'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:34.469732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1434/2844] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:12:34 2022] DELETE /identity/v3/users/8ae408ff105c4a41a91fd793fb2f4b53 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:12:35.054889 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516e588-9f66-407c-b873-2ff43ad91b19 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:35.066977 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516e588-9f66-407c-b873-2ff43ad91b19 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:35.134258 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a43885-1ce2-4388-8734-f66a1cc00ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:35.135046 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a43885-1ce2-4388-8734-f66a1cc00ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:35.135489 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a43885-1ce2-4388-8734-f66a1cc00ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:35.135779 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a43885-1ce2-4388-8734-f66a1cc00ad0 admin admin] PATH_INFO: `/v3/projects/920a4657d6da447e8e58b1eec3caf016` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:35.137043 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a43885-1ce2-4388-8734-f66a1cc00ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=920a4657d6da447e8e58b1eec3caf016)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:35.138967 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a43885-1ce2-4388-8734-f66a1cc00ad0 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:35.224269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:35.227326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f7a43885-1ce2-4388-8734-f66a1cc00ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920a4657d6da447e8e58b1eec3caf016', 'request_id': 'req-f7a43885-1ce2-4388-8734-f66a1cc00ad0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:35.287753 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f7a43885-1ce2-4388-8734-f66a1cc00ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920a4657d6da447e8e58b1eec3caf016', 'request_id': 'req-f7a43885-1ce2-4388-8734-f66a1cc00ad0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:35.294748 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f7a43885-1ce2-4388-8734-f66a1cc00ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920a4657d6da447e8e58b1eec3caf016', 'request_id': 'req-f7a43885-1ce2-4388-8734-f66a1cc00ad0'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:35.306218 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f7a43885-1ce2-4388-8734-f66a1cc00ad0 admin admin] The token cache is being invalidate because project 920a4657d6da447e8e58b1eec3caf016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:12:35.306502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f7a43885-1ce2-4388-8734-f66a1cc00ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:35.307150 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-f7a43885-1ce2-4388-8734-f66a1cc00ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:35.308717 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1411/2845] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:12:35 2022] DELETE /identity/v3/projects/920a4657d6da447e8e58b1eec3caf016 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:35.313621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93800b57-d2bd-4dfa-91ed-914980a405aa None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:35.313930 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93800b57-d2bd-4dfa-91ed-914980a405aa None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:35.314236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93800b57-d2bd-4dfa-91ed-914980a405aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:35.331433 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-93800b57-d2bd-4dfa-91ed-914980a405aa None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:35.332653 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-93800b57-d2bd-4dfa-91ed-914980a405aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:35.393277 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1435/2846] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:35.406823 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb388467-ebf5-487c-b7b8-249901690fc9 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:35.407172 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb388467-ebf5-487c-b7b8-249901690fc9 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:35.407473 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb388467-ebf5-487c-b7b8-249901690fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:35.426670 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-cb388467-ebf5-487c-b7b8-249901690fc9 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:35.427902 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-cb388467-ebf5-487c-b7b8-249901690fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:35.435956 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1412/2847] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:35.443049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93800b57-d2bd-4dfa-91ed-914980a405aa None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:35.452650 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93800b57-d2bd-4dfa-91ed-914980a405aa None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:35.457195 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0df54-490b-4850-9a6c-faca8d7fe0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:35.457840 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0df54-490b-4850-9a6c-faca8d7fe0ee admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:35.458120 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0df54-490b-4850-9a6c-faca8d7fe0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:35.458396 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0df54-490b-4850-9a6c-faca8d7fe0ee admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:35.459141 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0df54-490b-4850-9a6c-faca8d7fe0ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:12:35.459445 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0df54-490b-4850-9a6c-faca8d7fe0ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:35.461051 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0df54-490b-4850-9a6c-faca8d7fe0ee admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:35.474672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1436/2848] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:12:35.477713 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb388467-ebf5-487c-b7b8-249901690fc9 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:35.487832 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb388467-ebf5-487c-b7b8-249901690fc9 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:35.492479 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7651e4c-9524-4bee-8473-f84ce4d69eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:35.493117 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7651e4c-9524-4bee-8473-f84ce4d69eae admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:35.493394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7651e4c-9524-4bee-8473-f84ce4d69eae admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:35.493665 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7651e4c-9524-4bee-8473-f84ce4d69eae admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:35.494333 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7651e4c-9524-4bee-8473-f84ce4d69eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:35.496262 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7651e4c-9524-4bee-8473-f84ce4d69eae admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:35.617032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1413/2849] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:12:35 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:12:35.621809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0df54-490b-4850-9a6c-faca8d7fe0ee admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:35.633942 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0df54-490b-4850-9a6c-faca8d7fe0ee admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:35.692936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294e73b-b354-4f10-a13a-df6040c07eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:35.693608 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294e73b-b354-4f10-a13a-df6040c07eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:35.693893 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294e73b-b354-4f10-a13a-df6040c07eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:35.694172 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294e73b-b354-4f10-a13a-df6040c07eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:35.694900 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294e73b-b354-4f10-a13a-df6040c07eb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:35.696883 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294e73b-b354-4f10-a13a-df6040c07eb2 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:35.706218 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:35.812478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1437/2850] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:12:35 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:12:35.816535 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7651e4c-9524-4bee-8473-f84ce4d69eae admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:35.827718 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7651e4c-9524-4bee-8473-f84ce4d69eae admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:35.832336 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7ecbf-d746-4e3b-b483-704a97089f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:35.832999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7ecbf-d746-4e3b-b483-704a97089f49 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:35.833285 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7ecbf-d746-4e3b-b483-704a97089f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:35.833563 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7ecbf-d746-4e3b-b483-704a97089f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:35.834296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7ecbf-d746-4e3b-b483-704a97089f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:35.835933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7ecbf-d746-4e3b-b483-704a97089f49 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:35.847541 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1414/2851] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:35.851258 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294e73b-b354-4f10-a13a-df6040c07eb2 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:35.864606 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294e73b-b354-4f10-a13a-df6040c07eb2 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:35.866627 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b182a-e793-4dd4-8ed1-839131fd00c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:35.867393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b182a-e793-4dd4-8ed1-839131fd00c2 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:35.867731 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b182a-e793-4dd4-8ed1-839131fd00c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:35.867996 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b182a-e793-4dd4-8ed1-839131fd00c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:35.868719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b182a-e793-4dd4-8ed1-839131fd00c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:35.870318 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b182a-e793-4dd4-8ed1-839131fd00c2 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:35.881122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1438/2852] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:35.885148 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7ecbf-d746-4e3b-b483-704a97089f49 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:35.895669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7ecbf-d746-4e3b-b483-704a97089f49 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:35.900222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01af0ad-943d-4fd1-a037-b17a34faf52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:35.901109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01af0ad-943d-4fd1-a037-b17a34faf52d admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:35.901388 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01af0ad-943d-4fd1-a037-b17a34faf52d admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:35.901663 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01af0ad-943d-4fd1-a037-b17a34faf52d admin admin] PATH_INFO: `/v3/projects/6c5e34d0472b4a80b8ab07e432269742/users/bfa90bc53171407b8af84ff2f56a4aa7/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:35.918859 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01af0ad-943d-4fd1-a037-b17a34faf52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5e34d0472b4a80b8ab07e432269742, user_id=bfa90bc53171407b8af84ff2f56a4aa7, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:35.920865 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01af0ad-943d-4fd1-a037-b17a34faf52d admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:36.031696 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1415/2853] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:12:35 2022] PUT /identity/v3/projects/6c5e34d0472b4a80b8ab07e432269742/users/bfa90bc53171407b8af84ff2f56a4aa7/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:36.036829 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f37a46-c6fb-4f10-ab86-9c0316893454 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:36.037122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f37a46-c6fb-4f10-ab86-9c0316893454 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:36.037400 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f37a46-c6fb-4f10-ab86-9c0316893454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:36.054631 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-d5f37a46-c6fb-4f10-ab86-9c0316893454 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:36.055949 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d5f37a46-c6fb-4f10-ab86-9c0316893454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:36.120381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1439/2854] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:36.130946 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01af0ad-943d-4fd1-a037-b17a34faf52d admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:36.132877 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-e01af0ad-943d-4fd1-a037-b17a34faf52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:36.207138 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01af0ad-943d-4fd1-a037-b17a34faf52d admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:36.211705 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb4db6-e972-47e5-8028-d9b7b31a1e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:36.212724 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb4db6-e972-47e5-8028-d9b7b31a1e86 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:36.213014 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb4db6-e972-47e5-8028-d9b7b31a1e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:36.213291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb4db6-e972-47e5-8028-d9b7b31a1e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:36.224412 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb4db6-e972-47e5-8028-d9b7b31a1e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:36.227023 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb4db6-e972-47e5-8028-d9b7b31a1e86 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:36.236496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1416/2855] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:37.664846 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5a0ae-983c-492b-b132-8da6150f3201 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:37.665356 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5a0ae-983c-492b-b132-8da6150f3201 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:37.665473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5a0ae-983c-492b-b132-8da6150f3201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:37.694705 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-dce5a0ae-983c-492b-b132-8da6150f3201 None None] MFA Rules not processed for user `bfa90bc53171407b8af84ff2f56a4aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:37.695959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-dce5a0ae-983c-492b-b132-8da6150f3201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:37.772381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1440/2856] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:37.779821 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb4db6-e972-47e5-8028-d9b7b31a1e86 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:37.788818 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb4db6-e972-47e5-8028-d9b7b31a1e86 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:37.795637 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85527eb6-61c0-47de-8e9f-471cda4fd574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:37.796301 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85527eb6-61c0-47de-8e9f-471cda4fd574 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:37.796584 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85527eb6-61c0-47de-8e9f-471cda4fd574 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:37.796858 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85527eb6-61c0-47de-8e9f-471cda4fd574 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:37.797574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85527eb6-61c0-47de-8e9f-471cda4fd574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:37.799509 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85527eb6-61c0-47de-8e9f-471cda4fd574 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:37.904954 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1417/2857] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:12:37 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:12:37.909487 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5a0ae-983c-492b-b132-8da6150f3201 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:37.921593 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5a0ae-983c-492b-b132-8da6150f3201 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:38.039618 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43283440-124c-4089-b531-a54802648e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:38.040499 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43283440-124c-4089-b531-a54802648e79 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:38.040936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43283440-124c-4089-b531-a54802648e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:38.041604 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43283440-124c-4089-b531-a54802648e79 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:38.047161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43283440-124c-4089-b531-a54802648e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:38.047161 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43283440-124c-4089-b531-a54802648e79 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:38.162533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1441/2858] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:12:37 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:12:38.175082 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85527eb6-61c0-47de-8e9f-471cda4fd574 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:38.189338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85527eb6-61c0-47de-8e9f-471cda4fd574 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:38.195359 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceee694-df25-409e-b04b-6bc4cfa505fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:38.196338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceee694-df25-409e-b04b-6bc4cfa505fa admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:38.197076 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceee694-df25-409e-b04b-6bc4cfa505fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:38.197529 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceee694-df25-409e-b04b-6bc4cfa505fa admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:38.198625 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceee694-df25-409e-b04b-6bc4cfa505fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:38.200478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceee694-df25-409e-b04b-6bc4cfa505fa admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:38.214013 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1418/2859] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:38.219337 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43283440-124c-4089-b531-a54802648e79 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:38.227507 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:38.234715 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43283440-124c-4089-b531-a54802648e79 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:38.240096 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7f8b0-1f40-443f-ae19-ee583aae4a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:38.241526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7f8b0-1f40-443f-ae19-ee583aae4a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:38.242060 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7f8b0-1f40-443f-ae19-ee583aae4a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:38.242495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7f8b0-1f40-443f-ae19-ee583aae4a6c admin admin] PATH_INFO: `/v3/projects/9e8326d2d8354225bc0309fb22d2e7e0/users/db3603ab16794c9cb6d116d87afaa872/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:38.264999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7f8b0-1f40-443f-ae19-ee583aae4a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8326d2d8354225bc0309fb22d2e7e0, user_id=db3603ab16794c9cb6d116d87afaa872, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:38.268873 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7f8b0-1f40-443f-ae19-ee583aae4a6c admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:38.369994 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1442/2860] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:12:38 2022] PUT /identity/v3/projects/9e8326d2d8354225bc0309fb22d2e7e0/users/db3603ab16794c9cb6d116d87afaa872/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:12:38.375025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceee694-df25-409e-b04b-6bc4cfa505fa admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:38.388253 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceee694-df25-409e-b04b-6bc4cfa505fa admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:38.437245 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:38.457968 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8744da5-feaa-4a29-9916-bf38e8ee7b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:38.458640 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8744da5-feaa-4a29-9916-bf38e8ee7b9c admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:38.459060 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8744da5-feaa-4a29-9916-bf38e8ee7b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:38.459346 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8744da5-feaa-4a29-9916-bf38e8ee7b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:38.460118 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8744da5-feaa-4a29-9916-bf38e8ee7b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:38.462827 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8744da5-feaa-4a29-9916-bf38e8ee7b9c admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:38.475507 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1419/2861] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:38.479934 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7f8b0-1f40-443f-ae19-ee583aae4a6c admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:38.492138 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7f8b0-1f40-443f-ae19-ee583aae4a6c admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:38.497192 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd857f68-05c3-433c-8210-14f166d6c705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:38.498615 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857f68-05c3-433c-8210-14f166d6c705 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:38.499655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857f68-05c3-433c-8210-14f166d6c705 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:38.499655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857f68-05c3-433c-8210-14f166d6c705 admin admin] PATH_INFO: `/v3/projects/9e8326d2d8354225bc0309fb22d2e7e0/users/db3603ab16794c9cb6d116d87afaa872/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:38.501263 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd857f68-05c3-433c-8210-14f166d6c705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8326d2d8354225bc0309fb22d2e7e0, user_id=db3603ab16794c9cb6d116d87afaa872, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:38.504091 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd857f68-05c3-433c-8210-14f166d6c705 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:38.515635 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1443/2862] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:12:38 2022] PUT /identity/v3/projects/9e8326d2d8354225bc0309fb22d2e7e0/users/db3603ab16794c9cb6d116d87afaa872/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:12:39.905063 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b34689-d88f-4c5d-a60f-6f9a9bee7941 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:39.905063 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b34689-d88f-4c5d-a60f-6f9a9bee7941 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:39.905063 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b34689-d88f-4c5d-a60f-6f9a9bee7941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:39.981551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-62b34689-d88f-4c5d-a60f-6f9a9bee7941 None None] MFA Rules not processed for user `db3603ab16794c9cb6d116d87afaa872`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:39.983733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-62b34689-d88f-4c5d-a60f-6f9a9bee7941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:40.107790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1420/2863] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:40.116264 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e91728-9a01-4582-8c44-f55d09b98639 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:40.117792 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e91728-9a01-4582-8c44-f55d09b98639 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:40.118301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e91728-9a01-4582-8c44-f55d09b98639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:40.137907 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-a0e91728-9a01-4582-8c44-f55d09b98639 None None] MFA Rules not processed for user `bfa90bc53171407b8af84ff2f56a4aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:40.139983 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a0e91728-9a01-4582-8c44-f55d09b98639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:40.232763 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1444/2864] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:40.244283 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b34689-d88f-4c5d-a60f-6f9a9bee7941 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:40.245719 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-62b34689-d88f-4c5d-a60f-6f9a9bee7941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:40.246181 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5efc0c-c6d7-49c5-8860-68a4906f9491 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:40.246532 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5efc0c-c6d7-49c5-8860-68a4906f9491 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:40.251084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5efc0c-c6d7-49c5-8860-68a4906f9491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:40.286886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-7f5efc0c-c6d7-49c5-8860-68a4906f9491 None None] MFA Rules not processed for user `1233b3acb15c4756a088e90fd958fe2f`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:40.288260 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-7f5efc0c-c6d7-49c5-8860-68a4906f9491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:40.343288 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b34689-d88f-4c5d-a60f-6f9a9bee7941 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:40.349662 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74d92b-2476-460c-8188-2b70648734a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:40.350339 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74d92b-2476-460c-8188-2b70648734a5 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:40.350626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74d92b-2476-460c-8188-2b70648734a5 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:40.350906 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74d92b-2476-460c-8188-2b70648734a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:40.360602 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74d92b-2476-460c-8188-2b70648734a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:40.361994 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74d92b-2476-460c-8188-2b70648734a5 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:40.373466 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1421/2865] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:40.383083 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1445/2866] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:40.389085 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74d92b-2476-460c-8188-2b70648734a5 service nova] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:40.390687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-6a74d92b-2476-460c-8188-2b70648734a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:40.444768 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=100 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:40.462608 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74d92b-2476-460c-8188-2b70648734a5 service nova] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:40.468239 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e69140-c06f-4060-8ae4-a3ab26b6c715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:40.468985 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69140-c06f-4060-8ae4-a3ab26b6c715 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:40.469269 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69140-c06f-4060-8ae4-a3ab26b6c715 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:40.469546 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69140-c06f-4060-8ae4-a3ab26b6c715 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:40.470238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e69140-c06f-4060-8ae4-a3ab26b6c715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:40.472212 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e69140-c06f-4060-8ae4-a3ab26b6c715 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:40.559501 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1422/2867] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:12:40 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:12:40.563347 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5efc0c-c6d7-49c5-8860-68a4906f9491 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:40.574671 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5efc0c-c6d7-49c5-8860-68a4906f9491 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:40.636550 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c27908-9db0-43af-8c10-ffe3f242bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:40.637234 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27908-9db0-43af-8c10-ffe3f242bc19 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:40.637519 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27908-9db0-43af-8c10-ffe3f242bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:40.637793 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27908-9db0-43af-8c10-ffe3f242bc19 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:40.639064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c27908-9db0-43af-8c10-ffe3f242bc19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:40.641068 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c27908-9db0-43af-8c10-ffe3f242bc19 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:40.649150 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:40.731852 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1446/2868] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:12:40 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:12:40.735948 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e69140-c06f-4060-8ae4-a3ab26b6c715 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:40.746611 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e69140-c06f-4060-8ae4-a3ab26b6c715 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:40.752188 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741c0d1-76a3-4d9a-b6ef-38ea2feedb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:40.752979 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741c0d1-76a3-4d9a-b6ef-38ea2feedb57 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:40.753175 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741c0d1-76a3-4d9a-b6ef-38ea2feedb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:40.753438 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741c0d1-76a3-4d9a-b6ef-38ea2feedb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:40.754165 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741c0d1-76a3-4d9a-b6ef-38ea2feedb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:40.755815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741c0d1-76a3-4d9a-b6ef-38ea2feedb57 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:40.767320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1423/2869] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:40.771539 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c27908-9db0-43af-8c10-ffe3f242bc19 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:40.782063 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c27908-9db0-43af-8c10-ffe3f242bc19 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:40.786601 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69eeac-e60d-464e-91d0-21f48807a35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:40.787533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69eeac-e60d-464e-91d0-21f48807a35a admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:40.787821 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69eeac-e60d-464e-91d0-21f48807a35a admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:40.788121 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69eeac-e60d-464e-91d0-21f48807a35a admin admin] PATH_INFO: `/v3/projects/71aa7167d9ee45b2b00cab01c947164b/users/5dfcd583d98049608e2ebe4705f70d2e/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:40.803809 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69eeac-e60d-464e-91d0-21f48807a35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=71aa7167d9ee45b2b00cab01c947164b, user_id=5dfcd583d98049608e2ebe4705f70d2e, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:40.806440 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69eeac-e60d-464e-91d0-21f48807a35a admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:40.871066 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1447/2870] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:12:40 2022] PUT /identity/v3/projects/71aa7167d9ee45b2b00cab01c947164b/users/5dfcd583d98049608e2ebe4705f70d2e/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:12:40.876057 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741c0d1-76a3-4d9a-b6ef-38ea2feedb57 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:40.886214 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741c0d1-76a3-4d9a-b6ef-38ea2feedb57 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:40.947247 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e05c7-e727-41ef-85b6-259c1031ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:40.947943 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e05c7-e727-41ef-85b6-259c1031ac4c admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:40.948205 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e05c7-e727-41ef-85b6-259c1031ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:40.948474 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e05c7-e727-41ef-85b6-259c1031ac4c admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:40.949182 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e05c7-e727-41ef-85b6-259c1031ac4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:40.950759 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e05c7-e727-41ef-85b6-259c1031ac4c admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:40.960350 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1424/2871] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:12:40.964618 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69eeac-e60d-464e-91d0-21f48807a35a admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:40.975413 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69eeac-e60d-464e-91d0-21f48807a35a admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:40.980495 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c8ccc-39a7-4824-a98a-685bd900e6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:40.981381 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c8ccc-39a7-4824-a98a-685bd900e6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:40.981661 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c8ccc-39a7-4824-a98a-685bd900e6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:40.981961 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c8ccc-39a7-4824-a98a-685bd900e6e6 admin admin] PATH_INFO: `/v3/projects/71aa7167d9ee45b2b00cab01c947164b/users/5dfcd583d98049608e2ebe4705f70d2e/roles/c5632345c9274d348669482f1f7414c8` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:40.984510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c8ccc-39a7-4824-a98a-685bd900e6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71aa7167d9ee45b2b00cab01c947164b, user_id=5dfcd583d98049608e2ebe4705f70d2e, role_id=c5632345c9274d348669482f1f7414c8)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:40.987165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c8ccc-39a7-4824-a98a-685bd900e6e6 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:40.998533 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1448/2872] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:12:40 2022] PUT /identity/v3/projects/71aa7167d9ee45b2b00cab01c947164b/users/5dfcd583d98049608e2ebe4705f70d2e/roles/c5632345c9274d348669482f1f7414c8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:46.150913 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e05c7-e727-41ef-85b6-259c1031ac4c admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:46.235108 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e05c7-e727-41ef-85b6-259c1031ac4c admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:46.306857 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:46.319238 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92737a3-b081-4c60-acc3-98ed375983bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:46.320292 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92737a3-b081-4c60-acc3-98ed375983bd service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:46.320908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92737a3-b081-4c60-acc3-98ed375983bd service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:46.321187 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92737a3-b081-4c60-acc3-98ed375983bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:46.323579 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c92737a3-b081-4c60-acc3-98ed375983bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:46.339641 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92737a3-b081-4c60-acc3-98ed375983bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:46.341320 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92737a3-b081-4c60-acc3-98ed375983bd service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:46.360160 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1425/2873] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:47.862478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991101d3-5979-46c4-8a0c-b76803a9b619 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:47.862932 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991101d3-5979-46c4-8a0c-b76803a9b619 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:47.863176 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991101d3-5979-46c4-8a0c-b76803a9b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:47.891832 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-991101d3-5979-46c4-8a0c-b76803a9b619 None None] MFA Rules not processed for user `5dfcd583d98049608e2ebe4705f70d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:47.893050 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-991101d3-5979-46c4-8a0c-b76803a9b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:47.960080 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1449/2874] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:47.974521 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92737a3-b081-4c60-acc3-98ed375983bd service nova] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:47.986079 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92737a3-b081-4c60-acc3-98ed375983bd service nova] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:47.991770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aed001-ddb6-4d5e-8012-c8d2dc744952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:47.992405 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aed001-ddb6-4d5e-8012-c8d2dc744952 service nova] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:47.992688 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aed001-ddb6-4d5e-8012-c8d2dc744952 service nova] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:47.992965 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aed001-ddb6-4d5e-8012-c8d2dc744952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:48.050395 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aed001-ddb6-4d5e-8012-c8d2dc744952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:48.052037 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aed001-ddb6-4d5e-8012-c8d2dc744952 service nova] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:48.061592 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1426/2875] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:12:51.886614 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9fa31-b608-449c-8640-b4222962a200 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:51.887138 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9fa31-b608-449c-8640-b4222962a200 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:51.887138 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9fa31-b608-449c-8640-b4222962a200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:51.905241 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-c9b9fa31-b608-449c-8640-b4222962a200 None None] MFA Rules not processed for user `1233b3acb15c4756a088e90fd958fe2f`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:51.906443 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-c9b9fa31-b608-449c-8640-b4222962a200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:51.914014 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1450/2876] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:12:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:12:58.057018 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=37 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:58.897264 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aed001-ddb6-4d5e-8012-c8d2dc744952 service nova] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:58.898664 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c6aed001-ddb6-4d5e-8012-c8d2dc744952 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:58.957369 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aed001-ddb6-4d5e-8012-c8d2dc744952 service nova] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:58.960956 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389d913-f963-4697-a9df-ffa2cb5ef4d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:58.961599 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389d913-f963-4697-a9df-ffa2cb5ef4d4 service cinder] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:58.961882 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389d913-f963-4697-a9df-ffa2cb5ef4d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:58.962157 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389d913-f963-4697-a9df-ffa2cb5ef4d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:59.022411 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389d913-f963-4697-a9df-ffa2cb5ef4d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:59.024357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389d913-f963-4697-a9df-ffa2cb5ef4d4 service cinder] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:59.035106 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1427/2877] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:01.899831 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:INSERT=5,keystone:SELECT=54 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:09.029780 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=50 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:26.264770 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9fa31-b608-449c-8640-b4222962a200 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:26.326912 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9fa31-b608-449c-8640-b4222962a200 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:26.331554 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38565f1a-d4e0-4d94-88ef-e73bb49857ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:26.332415 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38565f1a-d4e0-4d94-88ef-e73bb49857ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:26.332699 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38565f1a-d4e0-4d94-88ef-e73bb49857ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:26.332974 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38565f1a-d4e0-4d94-88ef-e73bb49857ea admin admin] PATH_INFO: `/v3/users/bfa90bc53171407b8af84ff2f56a4aa7` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:26.334159 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38565f1a-d4e0-4d94-88ef-e73bb49857ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa90bc53171407b8af84ff2f56a4aa7)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:26.336170 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38565f1a-d4e0-4d94-88ef-e73bb49857ea admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:26.577797 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-38565f1a-d4e0-4d94-88ef-e73bb49857ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa90bc53171407b8af84ff2f56a4aa7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:26.661626 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-38565f1a-d4e0-4d94-88ef-e73bb49857ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa90bc53171407b8af84ff2f56a4aa7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:26.673664 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-38565f1a-d4e0-4d94-88ef-e73bb49857ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa90bc53171407b8af84ff2f56a4aa7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:26.680719 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-38565f1a-d4e0-4d94-88ef-e73bb49857ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa90bc53171407b8af84ff2f56a4aa7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:26.681557 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-38565f1a-d4e0-4d94-88ef-e73bb49857ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa90bc53171407b8af84ff2f56a4aa7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:26.687621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1451/2878] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:13:26 2022] DELETE /identity/v3/users/bfa90bc53171407b8af84ff2f56a4aa7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:27.015812 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389d913-f963-4697-a9df-ffa2cb5ef4d4 service cinder] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:27.027635 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389d913-f963-4697-a9df-ffa2cb5ef4d4 service cinder] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:27.085399 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:27.086252 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:27.086533 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:27.086803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] PATH_INFO: `/v3/projects/6c5e34d0472b4a80b8ab07e432269742` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:27.087989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5e34d0472b4a80b8ab07e432269742)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:27.089900 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:27.224297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5e34d0472b4a80b8ab07e432269742', 'request_id': 'req-3aca5460-4b00-4d1d-a617-393dbce7166f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:27.313281 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5e34d0472b4a80b8ab07e432269742', 'request_id': 'req-3aca5460-4b00-4d1d-a617-393dbce7166f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:27.320636 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5e34d0472b4a80b8ab07e432269742', 'request_id': 'req-3aca5460-4b00-4d1d-a617-393dbce7166f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:27.331358 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] The token cache is being invalidate because project 6c5e34d0472b4a80b8ab07e432269742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:13:27.331703 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:27.332341 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:27.333873 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1428/2879] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:13:27 2022] DELETE /identity/v3/projects/6c5e34d0472b4a80b8ab07e432269742 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:27.337894 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38565f1a-d4e0-4d94-88ef-e73bb49857ea admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:27.339312 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-38565f1a-d4e0-4d94-88ef-e73bb49857ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:27.352301 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38565f1a-d4e0-4d94-88ef-e73bb49857ea admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:27.407881 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54655223-7e88-4c89-bd5b-274f546e809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:27.408744 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54655223-7e88-4c89-bd5b-274f546e809e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:27.409027 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54655223-7e88-4c89-bd5b-274f546e809e admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:27.409316 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54655223-7e88-4c89-bd5b-274f546e809e admin admin] PATH_INFO: `/v3/users/db3603ab16794c9cb6d116d87afaa872` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:27.410478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54655223-7e88-4c89-bd5b-274f546e809e admin admin] RBAC: Authorizing `identity:delete_user(user_id=db3603ab16794c9cb6d116d87afaa872)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:27.412434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54655223-7e88-4c89-bd5b-274f546e809e admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:27.433705 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:27.621144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-54655223-7e88-4c89-bd5b-274f546e809e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db3603ab16794c9cb6d116d87afaa872'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:27.715691 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-54655223-7e88-4c89-bd5b-274f546e809e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db3603ab16794c9cb6d116d87afaa872'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:27.729272 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-54655223-7e88-4c89-bd5b-274f546e809e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db3603ab16794c9cb6d116d87afaa872'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:27.729947 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-54655223-7e88-4c89-bd5b-274f546e809e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db3603ab16794c9cb6d116d87afaa872'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:27.737668 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-54655223-7e88-4c89-bd5b-274f546e809e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db3603ab16794c9cb6d116d87afaa872'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:27.743784 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1452/2880] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:13:27 2022] DELETE /identity/v3/users/db3603ab16794c9cb6d116d87afaa872 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:28.008435 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:28.009955 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:28.023280 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca5460-4b00-4d1d-a617-393dbce7166f admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:28.081551 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce37379-9537-4a65-8d76-e49b6037da50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:28.082393 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce37379-9537-4a65-8d76-e49b6037da50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:28.082669 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce37379-9537-4a65-8d76-e49b6037da50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:28.082937 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce37379-9537-4a65-8d76-e49b6037da50 admin admin] PATH_INFO: `/v3/projects/9e8326d2d8354225bc0309fb22d2e7e0` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:28.084115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce37379-9537-4a65-8d76-e49b6037da50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e8326d2d8354225bc0309fb22d2e7e0)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:28.086012 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce37379-9537-4a65-8d76-e49b6037da50 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:28.172296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:28.183799 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-7ce37379-9537-4a65-8d76-e49b6037da50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8326d2d8354225bc0309fb22d2e7e0', 'request_id': 'req-7ce37379-9537-4a65-8d76-e49b6037da50'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:28.275773 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-7ce37379-9537-4a65-8d76-e49b6037da50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8326d2d8354225bc0309fb22d2e7e0', 'request_id': 'req-7ce37379-9537-4a65-8d76-e49b6037da50'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:28.283103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-7ce37379-9537-4a65-8d76-e49b6037da50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8326d2d8354225bc0309fb22d2e7e0', 'request_id': 'req-7ce37379-9537-4a65-8d76-e49b6037da50'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:28.293429 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-7ce37379-9537-4a65-8d76-e49b6037da50 admin admin] The token cache is being invalidate because project 9e8326d2d8354225bc0309fb22d2e7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:13:28.293708 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-7ce37379-9537-4a65-8d76-e49b6037da50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:28.294370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-7ce37379-9537-4a65-8d76-e49b6037da50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:28.295935 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1429/2881] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:13:28 2022] DELETE /identity/v3/projects/9e8326d2d8354225bc0309fb22d2e7e0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:28.300775 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a4c10-9510-4538-9dd7-3355aeda8ef7 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:28.301072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a4c10-9510-4538-9dd7-3355aeda8ef7 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:28.301354 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a4c10-9510-4538-9dd7-3355aeda8ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:28.320551 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-495a4c10-9510-4538-9dd7-3355aeda8ef7 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:28.321751 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-495a4c10-9510-4538-9dd7-3355aeda8ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:28.383571 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1453/2882] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:28.391273 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5b2f7-eb46-4f79-8525-8cee1ec241dc None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:28.391597 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5b2f7-eb46-4f79-8525-8cee1ec241dc None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:28.392390 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5b2f7-eb46-4f79-8525-8cee1ec241dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:28.411163 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-fbe5b2f7-eb46-4f79-8525-8cee1ec241dc None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:28.412417 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-fbe5b2f7-eb46-4f79-8525-8cee1ec241dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:28.420698 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1430/2883] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:28.428247 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a4c10-9510-4538-9dd7-3355aeda8ef7 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:28.437776 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a4c10-9510-4538-9dd7-3355aeda8ef7 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:28.442936 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53879d1-5347-4d25-a691-db42a9991752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:28.443621 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53879d1-5347-4d25-a691-db42a9991752 admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:28.443904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53879d1-5347-4d25-a691-db42a9991752 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:28.444181 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53879d1-5347-4d25-a691-db42a9991752 admin admin] PATH_INFO: `/v3/domains` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:28.444922 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53879d1-5347-4d25-a691-db42a9991752 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:13:28.445216 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53879d1-5347-4d25-a691-db42a9991752 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:28.446824 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53879d1-5347-4d25-a691-db42a9991752 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:28.462294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1454/2884] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:13:28.463624 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5b2f7-eb46-4f79-8525-8cee1ec241dc None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:28.472822 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5b2f7-eb46-4f79-8525-8cee1ec241dc None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:28.477574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e1959-89e6-486b-99ee-0245f88daf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:28.481890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e1959-89e6-486b-99ee-0245f88daf61 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:28.481890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e1959-89e6-486b-99ee-0245f88daf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:28.481890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e1959-89e6-486b-99ee-0245f88daf61 admin admin] PATH_INFO: `/v3/projects` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:28.481890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e1959-89e6-486b-99ee-0245f88daf61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:28.481890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e1959-89e6-486b-99ee-0245f88daf61 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:28.597123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1431/2885] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:13:28 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:28.601346 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53879d1-5347-4d25-a691-db42a9991752 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:28.612074 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53879d1-5347-4d25-a691-db42a9991752 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:28.657117 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e1959-89e6-486b-99ee-0245f88daf61 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:28.658852 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-ce2e1959-89e6-486b-99ee-0245f88daf61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:28.669304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba10e9-6ff7-4e26-b646-f0bf20085400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:28.669976 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba10e9-6ff7-4e26-b646-f0bf20085400 admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:28.670259 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba10e9-6ff7-4e26-b646-f0bf20085400 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:28.670536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba10e9-6ff7-4e26-b646-f0bf20085400 admin admin] PATH_INFO: `/v3/users` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:28.671217 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba10e9-6ff7-4e26-b646-f0bf20085400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:28.673174 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba10e9-6ff7-4e26-b646-f0bf20085400 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:28.715747 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e1959-89e6-486b-99ee-0245f88daf61 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:28.719626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857203e7-e4ca-4b96-9a2e-4190e4c141af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:28.720280 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857203e7-e4ca-4b96-9a2e-4190e4c141af service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:28.720560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857203e7-e4ca-4b96-9a2e-4190e4c141af service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:28.720833 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857203e7-e4ca-4b96-9a2e-4190e4c141af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:28.722586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-857203e7-e4ca-4b96-9a2e-4190e4c141af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:28.784252 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857203e7-e4ca-4b96-9a2e-4190e4c141af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:28.785697 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857203e7-e4ca-4b96-9a2e-4190e4c141af service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:28.795344 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1432/2886] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:13:28.808468 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1455/2887] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:13:28 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:28.809989 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857203e7-e4ca-4b96-9a2e-4190e4c141af service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:28.820946 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857203e7-e4ca-4b96-9a2e-4190e4c141af service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:28.825700 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c24c2e-5315-41cf-acc6-b89f14b2160f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:28.826326 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c24c2e-5315-41cf-acc6-b89f14b2160f admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:28.826610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c24c2e-5315-41cf-acc6-b89f14b2160f admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:28.826878 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c24c2e-5315-41cf-acc6-b89f14b2160f admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:28.827629 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c24c2e-5315-41cf-acc6-b89f14b2160f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:28.829270 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c24c2e-5315-41cf-acc6-b89f14b2160f admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:28.839772 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1433/2888] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:28.843886 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba10e9-6ff7-4e26-b646-f0bf20085400 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:28.854419 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba10e9-6ff7-4e26-b646-f0bf20085400 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:28.859200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989aab9-4b50-440d-8c52-b25669676bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:28.866144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989aab9-4b50-440d-8c52-b25669676bbc admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:28.866144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989aab9-4b50-440d-8c52-b25669676bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:28.866144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989aab9-4b50-440d-8c52-b25669676bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:28.866144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989aab9-4b50-440d-8c52-b25669676bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:28.866144 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989aab9-4b50-440d-8c52-b25669676bbc admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:28.873561 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1456/2889] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:13:28.878234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c24c2e-5315-41cf-acc6-b89f14b2160f admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:28.888313 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c24c2e-5315-41cf-acc6-b89f14b2160f admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:28.893044 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffb56b-882c-4cdd-892f-de709a6c5f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:28.893944 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffb56b-882c-4cdd-892f-de709a6c5f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:28.894225 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffb56b-882c-4cdd-892f-de709a6c5f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:28.894502 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffb56b-882c-4cdd-892f-de709a6c5f0c admin admin] PATH_INFO: `/v3/projects/63e5a114f5554ebeb954758e8da21fbd/users/e163dec8d6444939afe39c386297f6ea/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:28.909026 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffb56b-882c-4cdd-892f-de709a6c5f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e5a114f5554ebeb954758e8da21fbd, user_id=e163dec8d6444939afe39c386297f6ea, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:28.911701 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffb56b-882c-4cdd-892f-de709a6c5f0c admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:29.036241 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1434/2890] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:13:28 2022] PUT /identity/v3/projects/63e5a114f5554ebeb954758e8da21fbd/users/e163dec8d6444939afe39c386297f6ea/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:29.046644 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34daa74-32c0-40ea-9467-f7560c3038d7 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:29.047072 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34daa74-32c0-40ea-9467-f7560c3038d7 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:29.047434 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34daa74-32c0-40ea-9467-f7560c3038d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:29.056035 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:29.081257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-a34daa74-32c0-40ea-9467-f7560c3038d7 None None] MFA Rules not processed for user `e163dec8d6444939afe39c386297f6ea`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:29.081257 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-a34daa74-32c0-40ea-9467-f7560c3038d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:29.145304 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1457/2891] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:29.156611 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffb56b-882c-4cdd-892f-de709a6c5f0c admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:29.161813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-beffb56b-882c-4cdd-892f-de709a6c5f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:29.168530 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:29.238964 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffb56b-882c-4cdd-892f-de709a6c5f0c admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:29.242610 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfe88e-706b-43ec-86a4-291357b3d314 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be4de0fa80784de1acfcd47a2b77d9ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:29.243299 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfe88e-706b-43ec-86a4-291357b3d314 service glance] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:29.243642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfe88e-706b-43ec-86a4-291357b3d314 service glance] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:29.243916 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfe88e-706b-43ec-86a4-291357b3d314 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:29.252566 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfe88e-706b-43ec-86a4-291357b3d314 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:29.254353 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfe88e-706b-43ec-86a4-291357b3d314 service glance] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:29.264115 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1435/2892] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:30.813148 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34daa74-32c0-40ea-9467-f7560c3038d7 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:30.873526 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34daa74-32c0-40ea-9467-f7560c3038d7 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:30.877600 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41e3d2-d3cb-4f00-9223-48451b64ee62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:30.878245 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41e3d2-d3cb-4f00-9223-48451b64ee62 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:30.878522 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41e3d2-d3cb-4f00-9223-48451b64ee62 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:30.878794 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41e3d2-d3cb-4f00-9223-48451b64ee62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:30.880866 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-bf41e3d2-d3cb-4f00-9223-48451b64ee62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:30.890968 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41e3d2-d3cb-4f00-9223-48451b64ee62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:30.893049 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41e3d2-d3cb-4f00-9223-48451b64ee62 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:30.911607 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1458/2893] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:39.750156 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=32 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:40.905064 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=56 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:02.387716 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfe88e-706b-43ec-86a4-291357b3d314 service glance] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:02.449512 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfe88e-706b-43ec-86a4-291357b3d314 service glance] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:02.454020 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde6dc-4d0b-463e-b188-36a81990c164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:02.463246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde6dc-4d0b-463e-b188-36a81990c164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:02.463246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde6dc-4d0b-463e-b188-36a81990c164 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:02.463246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde6dc-4d0b-463e-b188-36a81990c164 admin admin] PATH_INFO: `/v3/users/e163dec8d6444939afe39c386297f6ea` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:02.463246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cde6dc-4d0b-463e-b188-36a81990c164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e163dec8d6444939afe39c386297f6ea)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:02.463246 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cde6dc-4d0b-463e-b188-36a81990c164 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:02.636227 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-93cde6dc-4d0b-463e-b188-36a81990c164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e163dec8d6444939afe39c386297f6ea'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:02.648123 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-93cde6dc-4d0b-463e-b188-36a81990c164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e163dec8d6444939afe39c386297f6ea'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:02.655010 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-93cde6dc-4d0b-463e-b188-36a81990c164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e163dec8d6444939afe39c386297f6ea'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:02.658055 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-93cde6dc-4d0b-463e-b188-36a81990c164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e163dec8d6444939afe39c386297f6ea'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:02.740850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-93cde6dc-4d0b-463e-b188-36a81990c164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e163dec8d6444939afe39c386297f6ea'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:02.746925 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1436/2894] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:14:02 2022] DELETE /identity/v3/users/e163dec8d6444939afe39c386297f6ea => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:14:02.751339 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8bf9d-1ce8-4ea5-affa-d0918a490160 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:02.751875 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8bf9d-1ce8-4ea5-affa-d0918a490160 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:02.752084 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8bf9d-1ce8-4ea5-affa-d0918a490160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:02.769970 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-23a8bf9d-1ce8-4ea5-affa-d0918a490160 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:02.771160 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-23a8bf9d-1ce8-4ea5-affa-d0918a490160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:02.828203 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1459/2895] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:14:02.838120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde6dc-4d0b-463e-b188-36a81990c164 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:02.839549 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-93cde6dc-4d0b-463e-b188-36a81990c164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:02.896884 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde6dc-4d0b-463e-b188-36a81990c164 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:02.900407 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a2fc-0ec9-4020-b23c-1759acd7127b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:02.901039 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a2fc-0ec9-4020-b23c-1759acd7127b service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:02.901321 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a2fc-0ec9-4020-b23c-1759acd7127b service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:02.901598 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a2fc-0ec9-4020-b23c-1759acd7127b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:02.910586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686a2fc-0ec9-4020-b23c-1759acd7127b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:02.912046 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686a2fc-0ec9-4020-b23c-1759acd7127b service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:02.921291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1437/2896] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:14:03.311223 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8bf9d-1ce8-4ea5-affa-d0918a490160 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:03.312714 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-23a8bf9d-1ce8-4ea5-affa-d0918a490160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:03.327082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8bf9d-1ce8-4ea5-affa-d0918a490160 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:03.332029 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f92279-324c-4f70-bf3b-59b0f583e505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:03.332896 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92279-324c-4f70-bf3b-59b0f583e505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:03.333181 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92279-324c-4f70-bf3b-59b0f583e505 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:03.333458 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92279-324c-4f70-bf3b-59b0f583e505 admin admin] PATH_INFO: `/v3/projects/63e5a114f5554ebeb954758e8da21fbd` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:03.334653 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f92279-324c-4f70-bf3b-59b0f583e505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e5a114f5554ebeb954758e8da21fbd)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:03.336692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f92279-324c-4f70-bf3b-59b0f583e505 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:03.466894 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b2f92279-324c-4f70-bf3b-59b0f583e505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e5a114f5554ebeb954758e8da21fbd', 'request_id': 'req-b2f92279-324c-4f70-bf3b-59b0f583e505'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:03.580722 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b2f92279-324c-4f70-bf3b-59b0f583e505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e5a114f5554ebeb954758e8da21fbd', 'request_id': 'req-b2f92279-324c-4f70-bf3b-59b0f583e505'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:03.587283 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b2f92279-324c-4f70-bf3b-59b0f583e505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e5a114f5554ebeb954758e8da21fbd', 'request_id': 'req-b2f92279-324c-4f70-bf3b-59b0f583e505'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:03.598233 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b2f92279-324c-4f70-bf3b-59b0f583e505 admin admin] The token cache is being invalidate because project 63e5a114f5554ebeb954758e8da21fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:14:03.598517 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b2f92279-324c-4f70-bf3b-59b0f583e505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:03.599165 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-b2f92279-324c-4f70-bf3b-59b0f583e505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:03.600785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1460/2897] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:14:03 2022] DELETE /identity/v3/projects/63e5a114f5554ebeb954758e8da21fbd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:14:03.606503 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9a336-647f-42fc-98fd-45de29357604 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:03.606958 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9a336-647f-42fc-98fd-45de29357604 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:03.607075 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9a336-647f-42fc-98fd-45de29357604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:03.625170 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-5dc9a336-647f-42fc-98fd-45de29357604 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:03.626357 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-5dc9a336-647f-42fc-98fd-45de29357604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:03.642953 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:03.684127 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1438/2898] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:14:03.691900 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0dd6f-d41a-41f4-b0b9-cebfb43b1e82 None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:03.692238 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0dd6f-d41a-41f4-b0b9-cebfb43b1e82 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:03.692596 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0dd6f-d41a-41f4-b0b9-cebfb43b1e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:03.712184 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-6ca0dd6f-d41a-41f4-b0b9-cebfb43b1e82 None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:03.713387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-6ca0dd6f-d41a-41f4-b0b9-cebfb43b1e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:03.721756 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1461/2899] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:14:03.726630 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9a336-647f-42fc-98fd-45de29357604 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:03.736687 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9a336-647f-42fc-98fd-45de29357604 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:03.741999 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60a308-a6f5-428d-a8e1-75729fda3954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:03.742642 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60a308-a6f5-428d-a8e1-75729fda3954 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:03.742921 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60a308-a6f5-428d-a8e1-75729fda3954 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:03.743193 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60a308-a6f5-428d-a8e1-75729fda3954 admin admin] PATH_INFO: `/v3/domains` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:03.743961 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60a308-a6f5-428d-a8e1-75729fda3954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:14:03.744265 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60a308-a6f5-428d-a8e1-75729fda3954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:03.745956 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60a308-a6f5-428d-a8e1-75729fda3954 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:03.757647 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1439/2900] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 2 14:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:14:03.761691 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0dd6f-d41a-41f4-b0b9-cebfb43b1e82 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:03.770882 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0dd6f-d41a-41f4-b0b9-cebfb43b1e82 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:03.775536 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51975546-82ef-4307-8a91-b6805e33b8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:03.776180 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51975546-82ef-4307-8a91-b6805e33b8be admin admin] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:03.776463 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51975546-82ef-4307-8a91-b6805e33b8be admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:03.776737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51975546-82ef-4307-8a91-b6805e33b8be admin admin] PATH_INFO: `/v3/projects` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:03.777415 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51975546-82ef-4307-8a91-b6805e33b8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:03.779299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51975546-82ef-4307-8a91-b6805e33b8be admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:03.914442 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1462/2901] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 2 14:14:03 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:14:03.918560 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60a308-a6f5-428d-a8e1-75729fda3954 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:03.929162 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60a308-a6f5-428d-a8e1-75729fda3954 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:03.985620 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de510fd1-6888-4a9b-82a3-f0b2e85292d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:03.986266 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de510fd1-6888-4a9b-82a3-f0b2e85292d5 admin admin] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:03.986545 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de510fd1-6888-4a9b-82a3-f0b2e85292d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:03.986819 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de510fd1-6888-4a9b-82a3-f0b2e85292d5 admin admin] PATH_INFO: `/v3/users` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:03.987552 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de510fd1-6888-4a9b-82a3-f0b2e85292d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:03.990117 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de510fd1-6888-4a9b-82a3-f0b2e85292d5 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:04.135384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1440/2902] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 2 14:14:03 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:14:04.139473 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51975546-82ef-4307-8a91-b6805e33b8be admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:04.150098 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51975546-82ef-4307-8a91-b6805e33b8be admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:04.154728 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81dd43-f279-4ec7-9ba0-ccb7b904ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:04.156966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81dd43-f279-4ec7-9ba0-ccb7b904ecac admin admin] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:04.156966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81dd43-f279-4ec7-9ba0-ccb7b904ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:04.156966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81dd43-f279-4ec7-9ba0-ccb7b904ecac admin admin] PATH_INFO: `/v3/roles` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:04.156966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81dd43-f279-4ec7-9ba0-ccb7b904ecac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:04.158321 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81dd43-f279-4ec7-9ba0-ccb7b904ecac admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:04.168808 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1463/2903] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:14:04.172532 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de510fd1-6888-4a9b-82a3-f0b2e85292d5 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:04.182667 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de510fd1-6888-4a9b-82a3-f0b2e85292d5 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:04.187257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd359149-d154-4437-ab7b-561bf73db506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:04.187940 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd359149-d154-4437-ab7b-561bf73db506 admin admin] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:04.188217 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd359149-d154-4437-ab7b-561bf73db506 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:04.188491 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd359149-d154-4437-ab7b-561bf73db506 admin admin] PATH_INFO: `/v3/roles` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:04.189199 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd359149-d154-4437-ab7b-561bf73db506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:04.190803 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd359149-d154-4437-ab7b-561bf73db506 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:04.200492 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1441/2904] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 2 14:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:14:04.204478 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81dd43-f279-4ec7-9ba0-ccb7b904ecac admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:04.214703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81dd43-f279-4ec7-9ba0-ccb7b904ecac admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:04.219216 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935de52-853a-4a15-bb2d-a6b98a9ddbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:04.220112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935de52-853a-4a15-bb2d-a6b98a9ddbed admin admin] REQUEST_METHOD: `PUT` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:04.220401 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935de52-853a-4a15-bb2d-a6b98a9ddbed admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:04.220738 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935de52-853a-4a15-bb2d-a6b98a9ddbed admin admin] PATH_INFO: `/v3/projects/3ab62538765d464fa912090e5e7796c4/users/d0477cc1484e49f694268ba37e77e0b7/roles/9507ef97f4954ddc90305c9d0f1d3608` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:04.236290 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935de52-853a-4a15-bb2d-a6b98a9ddbed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ab62538765d464fa912090e5e7796c4, user_id=d0477cc1484e49f694268ba37e77e0b7, role_id=9507ef97f4954ddc90305c9d0f1d3608)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:04.238923 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935de52-853a-4a15-bb2d-a6b98a9ddbed admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:04.321294 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1464/2905] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 2 14:14:04 2022] PUT /identity/v3/projects/3ab62538765d464fa912090e5e7796c4/users/d0477cc1484e49f694268ba37e77e0b7/roles/9507ef97f4954ddc90305c9d0f1d3608 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:14:04.331440 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e45311-aa71-4d9b-8bf0-c40493ba7112 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:04.332362 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e45311-aa71-4d9b-8bf0-c40493ba7112 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:04.332650 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e45311-aa71-4d9b-8bf0-c40493ba7112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:04.359897 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-32e45311-aa71-4d9b-8bf0-c40493ba7112 None None] MFA Rules not processed for user `d0477cc1484e49f694268ba37e77e0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:04.363325 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-32e45311-aa71-4d9b-8bf0-c40493ba7112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:04.423933 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1442/2906] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:14:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:14:04.434892 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935de52-853a-4a15-bb2d-a6b98a9ddbed admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:04.436599 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-d935de52-853a-4a15-bb2d-a6b98a9ddbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:04.450387 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:04.492515 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935de52-853a-4a15-bb2d-a6b98a9ddbed admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:04.496086 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3b8ec-bb54-4664-8efd-aabfd3302dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e91db8d261d4d458b695abc4e0ab28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:04.496713 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3b8ec-bb54-4664-8efd-aabfd3302dcc service cinder] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:04.496992 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3b8ec-bb54-4664-8efd-aabfd3302dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:04.497289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3b8ec-bb54-4664-8efd-aabfd3302dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:04.506356 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3b8ec-bb54-4664-8efd-aabfd3302dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:04.507819 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3b8ec-bb54-4664-8efd-aabfd3302dcc service cinder] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:04.516289 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1465/2907] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:14:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:14:04.541761 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e45311-aa71-4d9b-8bf0-c40493ba7112 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:04.560508 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:04.602890 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e45311-aa71-4d9b-8bf0-c40493ba7112 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:04.607968 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f48f25-0a5e-4e00-b7fa-2c34184c01bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:04.614490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f48f25-0a5e-4e00-b7fa-2c34184c01bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:04.614490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f48f25-0a5e-4e00-b7fa-2c34184c01bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:04.614490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f48f25-0a5e-4e00-b7fa-2c34184c01bd admin admin] PATH_INFO: `/v3/users/d0477cc1484e49f694268ba37e77e0b7` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:04.614490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f48f25-0a5e-4e00-b7fa-2c34184c01bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0477cc1484e49f694268ba37e77e0b7)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:04.614490 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f48f25-0a5e-4e00-b7fa-2c34184c01bd admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:04.806080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-23f48f25-0a5e-4e00-b7fa-2c34184c01bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0477cc1484e49f694268ba37e77e0b7'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:04.818338 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-23f48f25-0a5e-4e00-b7fa-2c34184c01bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0477cc1484e49f694268ba37e77e0b7'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:04.825080 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-23f48f25-0a5e-4e00-b7fa-2c34184c01bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0477cc1484e49f694268ba37e77e0b7'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:04.825762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-23f48f25-0a5e-4e00-b7fa-2c34184c01bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0477cc1484e49f694268ba37e77e0b7'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:04.889626 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-23f48f25-0a5e-4e00-b7fa-2c34184c01bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0477cc1484e49f694268ba37e77e0b7'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:04.895850 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1443/2908] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:14:04 2022] DELETE /identity/v3/users/d0477cc1484e49f694268ba37e77e0b7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:14:04.900385 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac329bd-3d43-4c7f-a0c2-667c86a3f0fb None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:04.900897 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac329bd-3d43-4c7f-a0c2-667c86a3f0fb None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:04.901010 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac329bd-3d43-4c7f-a0c2-667c86a3f0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:04.917507 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-4ac329bd-3d43-4c7f-a0c2-667c86a3f0fb None None] MFA Rules not processed for user `c62a7303ac7c4c3a91bb0f96d54dfd52`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:04.918747 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4ac329bd-3d43-4c7f-a0c2-667c86a3f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:04.976402 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1466/2909] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 2 14:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:14:04.986045 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f48f25-0a5e-4e00-b7fa-2c34184c01bd admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:04.987420 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-23f48f25-0a5e-4e00-b7fa-2c34184c01bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:05.043542 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f48f25-0a5e-4e00-b7fa-2c34184c01bd admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:05.047029 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d52691-f1b0-4d0f-9d9e-870b5f5dbefd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:05.047690 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d52691-f1b0-4d0f-9d9e-870b5f5dbefd service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:05.047971 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d52691-f1b0-4d0f-9d9e-870b5f5dbefd service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:05.048243 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d52691-f1b0-4d0f-9d9e-870b5f5dbefd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:05.057554 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d52691-f1b0-4d0f-9d9e-870b5f5dbefd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:05.058962 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d52691-f1b0-4d0f-9d9e-870b5f5dbefd service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:05.068855 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1444/2910] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:14:05.462999 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac329bd-3d43-4c7f-a0c2-667c86a3f0fb None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:05.467780 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4ac329bd-3d43-4c7f-a0c2-667c86a3f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:05.477393 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac329bd-3d43-4c7f-a0c2-667c86a3f0fb None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:05.482299 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:05.483155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:05.483435 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:05.483843 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] PATH_INFO: `/v3/projects/3ab62538765d464fa912090e5e7796c4` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:05.485015 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ab62538765d464fa912090e5e7796c4)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:05.487009 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:05.598703 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ab62538765d464fa912090e5e7796c4', 'request_id': 'req-2705cb8e-0b41-44a2-969e-c907f6f7eea7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:05.672505 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ab62538765d464fa912090e5e7796c4', 'request_id': 'req-2705cb8e-0b41-44a2-969e-c907f6f7eea7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:05.678959 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ab62538765d464fa912090e5e7796c4', 'request_id': 'req-2705cb8e-0b41-44a2-969e-c907f6f7eea7'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:05.689335 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] The token cache is being invalidate because project 3ab62538765d464fa912090e5e7796c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:14:05.689616 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:05.690256 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:05.691822 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1467/2911] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:14:05 2022] DELETE /identity/v3/projects/3ab62538765d464fa912090e5e7796c4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:14:15.064119 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:15.686239 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:53.691408 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d52691-f1b0-4d0f-9d9e-870b5f5dbefd service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:53.692851 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-b8d52691-f1b0-4d0f-9d9e-870b5f5dbefd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:53.760899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d52691-f1b0-4d0f-9d9e-870b5f5dbefd service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:53.819112 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829ab1e-5ed1-4817-8bd8-21e2ceda6c7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:53.819795 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829ab1e-5ed1-4817-8bd8-21e2ceda6c7e service placement] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:53.820085 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829ab1e-5ed1-4817-8bd8-21e2ceda6c7e service placement] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:53.820364 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829ab1e-5ed1-4817-8bd8-21e2ceda6c7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:53.822153 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-9829ab1e-5ed1-4817-8bd8-21e2ceda6c7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:53.833813 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829ab1e-5ed1-4817-8bd8-21e2ceda6c7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:53.835384 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829ab1e-5ed1-4817-8bd8-21e2ceda6c7e service placement] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:53.846083 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1445/2912] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:15:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:16:03.841013 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=58 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:11.374732 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:11.376195 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:11.433169 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705cb8e-0b41-44a2-969e-c907f6f7eea7 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:11.436739 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd493e2-8f01-49f8-966c-32281911e845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:11.437375 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd493e2-8f01-49f8-966c-32281911e845 service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:11.437655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd493e2-8f01-49f8-966c-32281911e845 service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:11.437927 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd493e2-8f01-49f8-966c-32281911e845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:11.439702 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-4dd493e2-8f01-49f8-966c-32281911e845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:11.449705 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd493e2-8f01-49f8-966c-32281911e845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:11.451143 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd493e2-8f01-49f8-966c-32281911e845 service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:11.459265 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1468/2913] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:16:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:16:11.766296 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24edde0-6499-4175-a145-868abb428edd None None] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:11.766848 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24edde0-6499-4175-a145-868abb428edd None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:11.766995 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24edde0-6499-4175-a145-868abb428edd None None] PATH_INFO: `/` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:11.768291 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1446/2914] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 2 14:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:11.774122 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d4371-9413-459e-9f80-160a3c1b377d None None] REQUEST_METHOD: `POST` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:11.774465 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d4371-9413-459e-9f80-160a3c1b377d None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:11.774749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d4371-9413-459e-9f80-160a3c1b377d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:11.815371 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.auth.core [None req-544d4371-9413-459e-9f80-160a3c1b377d None None] MFA Rules not processed for user `d95c75980e114aa488424fb115add647`. Rule list: `[]` (Enabled: `True`). {{(pid=92272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:11.817333 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-544d4371-9413-459e-9f80-160a3c1b377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:11.824878 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1469/2915] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 2 14:16:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:16:11.837222 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24edde0-6499-4175-a145-868abb428edd None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:11.839183 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a24edde0-6499-4175-a145-868abb428edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:11.853257 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24edde0-6499-4175-a145-868abb428edd None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:11.856834 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c8a22-6b8a-4fe9-b56a-2c480c0026fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:11.857445 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c8a22-6b8a-4fe9-b56a-2c480c0026fa service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:11.857733 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c8a22-6b8a-4fe9-b56a-2c480c0026fa service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:11.858007 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c8a22-6b8a-4fe9-b56a-2c480c0026fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:11.865660 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c8a22-6b8a-4fe9-b56a-2c480c0026fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:11.895090 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c8a22-6b8a-4fe9-b56a-2c480c0026fa service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:11.895090 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1447/2916] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:16:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:16:11.956633 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07339c1e-ee48-41ec-bd5c-2b97a3715cf2 None None] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:11.956926 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07339c1e-ee48-41ec-bd5c-2b97a3715cf2 None None] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:11.957276 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07339c1e-ee48-41ec-bd5c-2b97a3715cf2 None None] PATH_INFO: `/` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:11.958646 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1470/2917] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 2 14:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:16:11.964025 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bd02c-4a39-4c7c-a7d6-195e458e1e42 None None] REQUEST_METHOD: `POST` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:11.964322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bd02c-4a39-4c7c-a7d6-195e458e1e42 None None] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:11.964605 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bd02c-4a39-4c7c-a7d6-195e458e1e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:12.001941 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.auth.core [None req-327bd02c-4a39-4c7c-a7d6-195e458e1e42 None None] MFA Rules not processed for user `b9971f2bf0f2400b90168f6032a0e226`. Rule list: `[]` (Enabled: `True`). {{(pid=92271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:12.003136 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-327bd02c-4a39-4c7c-a7d6-195e458e1e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:12.071297 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1448/2918] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 2 14:16:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:16:12.081510 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07339c1e-ee48-41ec-bd5c-2b97a3715cf2 None None] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:12.092344 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07339c1e-ee48-41ec-bd5c-2b97a3715cf2 None None] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:12.095921 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9bdfd-a6b5-4049-a1e6-e3ebae7a075a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:12.096560 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9bdfd-a6b5-4049-a1e6-e3ebae7a075a service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:12.096827 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9bdfd-a6b5-4049-a1e6-e3ebae7a075a service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:12.097105 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9bdfd-a6b5-4049-a1e6-e3ebae7a075a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:12.108262 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9bdfd-a6b5-4049-a1e6-e3ebae7a075a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:12.109696 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9bdfd-a6b5-4049-a1e6-e3ebae7a075a service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:12.121076 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1471/2919] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:16:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:16:12.181574 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bd02c-4a39-4c7c-a7d6-195e458e1e42 None None] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:12.183103 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-327bd02c-4a39-4c7c-a7d6-195e458e1e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:12.196958 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bd02c-4a39-4c7c-a7d6-195e458e1e42 None None] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:12.201936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a60d7-b8c5-4a0d-a65f-b3adb9d0d891 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:12.202585 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a60d7-b8c5-4a0d-a65f-b3adb9d0d891 service placement] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:12.203010 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a60d7-b8c5-4a0d-a65f-b3adb9d0d891 service placement] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:12.203290 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a60d7-b8c5-4a0d-a65f-b3adb9d0d891 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:12.205102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-c07a60d7-b8c5-4a0d-a65f-b3adb9d0d891 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:12.206241 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9bdfd-a6b5-4049-a1e6-e3ebae7a075a service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:12.208193 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-f5a9bdfd-a6b5-4049-a1e6-e3ebae7a075a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:12.217586 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a60d7-b8c5-4a0d-a65f-b3adb9d0d891 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:12.222839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a60d7-b8c5-4a0d-a65f-b3adb9d0d891 service placement] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:12.224367 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9bdfd-a6b5-4049-a1e6-e3ebae7a075a service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:12.230028 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1449/2920] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:16:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:16:12.230506 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e72b94-46cd-4a55-992e-8c3e24a9da38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:12.231149 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e72b94-46cd-4a55-992e-8c3e24a9da38 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:12.231437 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e72b94-46cd-4a55-992e-8c3e24a9da38 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:12.231749 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e72b94-46cd-4a55-992e-8c3e24a9da38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:12.233605 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-06e72b94-46cd-4a55-992e-8c3e24a9da38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:12.245967 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e72b94-46cd-4a55-992e-8c3e24a9da38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:12.247565 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e72b94-46cd-4a55-992e-8c3e24a9da38 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:12.263088 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1472/2921] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:16:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:16:22.225654 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=49 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:22.257874 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=47 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:05.781216 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a60d7-b8c5-4a0d-a65f-b3adb9d0d891 service placement] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:05.791511 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a60d7-b8c5-4a0d-a65f-b3adb9d0d891 service placement] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:05.795091 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51e0bb-4220-4503-bf57-688ccdbbe732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:05.795751 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51e0bb-4220-4503-bf57-688ccdbbe732 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:05.796032 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51e0bb-4220-4503-bf57-688ccdbbe732 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:05.796303 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51e0bb-4220-4503-bf57-688ccdbbe732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:05.798052 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-8a51e0bb-4220-4503-bf57-688ccdbbe732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:05.856167 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51e0bb-4220-4503-bf57-688ccdbbe732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:05.857589 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51e0bb-4220-4503-bf57-688ccdbbe732 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:05.866300 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1450/2922] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:18:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:18:06.736157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e72b94-46cd-4a55-992e-8c3e24a9da38 service nova] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:06.748082 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e72b94-46cd-4a55-992e-8c3e24a9da38 service nova] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:06.753966 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4250da-c98e-4c0d-b88c-b05efb692f11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9971f2bf0f2400b90168f6032a0e226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:06.754738 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4250da-c98e-4c0d-b88c-b05efb692f11 service nova] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:06.755092 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4250da-c98e-4c0d-b88c-b05efb692f11 service nova] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:06.755438 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4250da-c98e-4c0d-b88c-b05efb692f11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:06.757331 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-ab4250da-c98e-4c0d-b88c-b05efb692f11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:06.774736 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4250da-c98e-4c0d-b88c-b05efb692f11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:06.774736 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4250da-c98e-4c0d-b88c-b05efb692f11 service nova] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:06.784026 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1473/2923] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:18:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:18:07.148478 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51e0bb-4220-4503-bf57-688ccdbbe732 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:07.158928 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51e0bb-4220-4503-bf57-688ccdbbe732 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:07.161887 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214819a-e26b-495f-9bb8-b28ca6d853e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:07.162558 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214819a-e26b-495f-9bb8-b28ca6d853e0 service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:07.162852 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214819a-e26b-495f-9bb8-b28ca6d853e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:07.163132 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214819a-e26b-495f-9bb8-b28ca6d853e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:07.165000 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-7214819a-e26b-495f-9bb8-b28ca6d853e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:07.180140 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214819a-e26b-495f-9bb8-b28ca6d853e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:07.181899 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214819a-e26b-495f-9bb8-b28ca6d853e0 service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:07.192770 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1451/2924] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:18:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:18:08.389384 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4250da-c98e-4c0d-b88c-b05efb692f11 service nova] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:08.398785 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4250da-c98e-4c0d-b88c-b05efb692f11 service nova] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:08.402672 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dd253-c782-43e6-a3eb-6b22394c62aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:08.403427 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dd253-c782-43e6-a3eb-6b22394c62aa service neutron] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:08.403810 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dd253-c782-43e6-a3eb-6b22394c62aa service neutron] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:08.404209 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dd253-c782-43e6-a3eb-6b22394c62aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:08.406103 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-910dd253-c782-43e6-a3eb-6b22394c62aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:08.420361 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dd253-c782-43e6-a3eb-6b22394c62aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:08.421786 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dd253-c782-43e6-a3eb-6b22394c62aa service neutron] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:08.433371 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1474/2925] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:18:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:18:13.251146 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214819a-e26b-495f-9bb8-b28ca6d853e0 service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:13.260109 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214819a-e26b-495f-9bb8-b28ca6d853e0 service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:13.263740 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1363acf-fe47-4f78-b7aa-25b039a404cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd95c75980e114aa488424fb115add647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:13.264370 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363acf-fe47-4f78-b7aa-25b039a404cd service neutron] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:13.264654 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363acf-fe47-4f78-b7aa-25b039a404cd service neutron] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:13.264932 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363acf-fe47-4f78-b7aa-25b039a404cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:13.267200 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d1363acf-fe47-4f78-b7aa-25b039a404cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:13.329876 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1363acf-fe47-4f78-b7aa-25b039a404cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:13.331302 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1363acf-fe47-4f78-b7aa-25b039a404cd service neutron] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:13.340840 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1452/2926] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:18:16.804507 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dd253-c782-43e6-a3eb-6b22394c62aa service neutron] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:16.806481 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-910dd253-c782-43e6-a3eb-6b22394c62aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:16.821236 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dd253-c782-43e6-a3eb-6b22394c62aa service neutron] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:16.827012 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4eae5-d102-43e6-94f0-2a5705840eed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:16.827770 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4eae5-d102-43e6-94f0-2a5705840eed service placement] REQUEST_METHOD: `GET` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:16.828636 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4eae5-d102-43e6-94f0-2a5705840eed service placement] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:16.829001 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4eae5-d102-43e6-94f0-2a5705840eed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:16.830883 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-55b4eae5-d102-43e6-94f0-2a5705840eed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:16.846737 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4eae5-d102-43e6-94f0-2a5705840eed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:16.848467 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4eae5-d102-43e6-94f0-2a5705840eed service placement] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:16.859004 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1475/2927] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:18:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:18:20.404674 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1363acf-fe47-4f78-b7aa-25b039a404cd service neutron] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:20.406214 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-d1363acf-fe47-4f78-b7aa-25b039a404cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:20.419363 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1363acf-fe47-4f78-b7aa-25b039a404cd service neutron] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:20.423936 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e9798-e0ae-4039-8010-46016799b630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:20.424809 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9798-e0ae-4039-8010-46016799b630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:20.425094 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9798-e0ae-4039-8010-46016799b630 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:20.425394 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9798-e0ae-4039-8010-46016799b630 admin admin] PATH_INFO: `/v3/users/1233b3acb15c4756a088e90fd958fe2f` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:20.426618 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e9798-e0ae-4039-8010-46016799b630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1233b3acb15c4756a088e90fd958fe2f)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:20.428815 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e9798-e0ae-4039-8010-46016799b630 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:20.621685 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a50e9798-e0ae-4039-8010-46016799b630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1233b3acb15c4756a088e90fd958fe2f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:20.634211 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a50e9798-e0ae-4039-8010-46016799b630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1233b3acb15c4756a088e90fd958fe2f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:20.641120 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a50e9798-e0ae-4039-8010-46016799b630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1233b3acb15c4756a088e90fd958fe2f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:20.641790 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a50e9798-e0ae-4039-8010-46016799b630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1233b3acb15c4756a088e90fd958fe2f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:20.643526 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:20.738678 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-a50e9798-e0ae-4039-8010-46016799b630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1233b3acb15c4756a088e90fd958fe2f'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:20.744869 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1453/2928] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:18:20 2022] DELETE /identity/v3/users/1233b3acb15c4756a088e90fd958fe2f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:18:21.028200 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4eae5-d102-43e6-94f0-2a5705840eed service placement] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:21.069835 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4eae5-d102-43e6-94f0-2a5705840eed service placement] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:21.127834 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:21.128683 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:21.128965 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:21.129237 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] PATH_INFO: `/v3/projects/a51bd65d85a34d9eac017834c730869f` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:21.130416 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a51bd65d85a34d9eac017834c730869f)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:21.132348 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:21.242993 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a51bd65d85a34d9eac017834c730869f', 'request_id': 'req-387aeefe-5b71-4acf-9ea7-771778c40ca9'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:21.335973 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a51bd65d85a34d9eac017834c730869f', 'request_id': 'req-387aeefe-5b71-4acf-9ea7-771778c40ca9'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:21.343096 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a51bd65d85a34d9eac017834c730869f', 'request_id': 'req-387aeefe-5b71-4acf-9ea7-771778c40ca9'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:21.366668 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] The token cache is being invalidate because project a51bd65d85a34d9eac017834c730869f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:18:21.366956 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:21.367622 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:21.369153 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1476/2929] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:18:21 2022] DELETE /identity/v3/projects/a51bd65d85a34d9eac017834c730869f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:18:21.373200 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e9798-e0ae-4039-8010-46016799b630 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:21.378040 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-a50e9798-e0ae-4039-8010-46016799b630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:21.424322 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e9798-e0ae-4039-8010-46016799b630 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:21.478231 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb41f0a-2439-46ab-ac4e-9972a604ee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:21.479084 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb41f0a-2439-46ab-ac4e-9972a604ee36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:21.479360 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb41f0a-2439-46ab-ac4e-9972a604ee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:21.479660 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb41f0a-2439-46ab-ac4e-9972a604ee36 admin admin] PATH_INFO: `/v3/users/5dfcd583d98049608e2ebe4705f70d2e` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:21.480839 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb41f0a-2439-46ab-ac4e-9972a604ee36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dfcd583d98049608e2ebe4705f70d2e)` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:21.482736 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb41f0a-2439-46ab-ac4e-9972a604ee36 admin admin] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:21.760234 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bcb41f0a-2439-46ab-ac4e-9972a604ee36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dfcd583d98049608e2ebe4705f70d2e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:21.772206 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bcb41f0a-2439-46ab-ac4e-9972a604ee36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dfcd583d98049608e2ebe4705f70d2e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:21.779072 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bcb41f0a-2439-46ab-ac4e-9972a604ee36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dfcd583d98049608e2ebe4705f70d2e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:21.779762 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bcb41f0a-2439-46ab-ac4e-9972a604ee36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dfcd583d98049608e2ebe4705f70d2e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:21.849905 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.notifications [None req-bcb41f0a-2439-46ab-ac4e-9972a604ee36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dfcd583d98049608e2ebe4705f70d2e'} {{(pid=92271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:21.856434 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1454/2930] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 2 14:18:21 2022] DELETE /identity/v3/users/5dfcd583d98049608e2ebe4705f70d2e => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:18:22.081155 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] Authenticating user token {{(pid=92272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:22.082752 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.fernet_utils [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:22.096655 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aeefe-5b71-4acf-9ea7-771778c40ca9 admin admin] Validating token access rules against request {{(pid=92272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:22.108801 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:22.152904 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0399de6-9451-471c-967f-0ba832314c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62a7303ac7c4c3a91bb0f96d54dfd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbf6a4ee0a34470ea6e2b9b95f130787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:22.153768 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0399de6-9451-471c-967f-0ba832314c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:22.154054 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0399de6-9451-471c-967f-0ba832314c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:22.154332 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0399de6-9451-471c-967f-0ba832314c1d admin admin] PATH_INFO: `/v3/projects/71aa7167d9ee45b2b00cab01c947164b` {{(pid=92272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:22.155535 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0399de6-9451-471c-967f-0ba832314c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=71aa7167d9ee45b2b00cab01c947164b)` {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:22.158112 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0399de6-9451-471c-967f-0ba832314c1d admin admin] RBAC: Authorization granted {{(pid=92272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:22.254883 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f0399de6-9451-471c-967f-0ba832314c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71aa7167d9ee45b2b00cab01c947164b', 'request_id': 'req-f0399de6-9451-471c-967f-0ba832314c1d'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:22.312692 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f0399de6-9451-471c-967f-0ba832314c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71aa7167d9ee45b2b00cab01c947164b', 'request_id': 'req-f0399de6-9451-471c-967f-0ba832314c1d'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:22.319075 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f0399de6-9451-471c-967f-0ba832314c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71aa7167d9ee45b2b00cab01c947164b', 'request_id': 'req-f0399de6-9451-471c-967f-0ba832314c1d'} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:22.330919 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f0399de6-9451-471c-967f-0ba832314c1d admin admin] The token cache is being invalidate because project 71aa7167d9ee45b2b00cab01c947164b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:18:22.331157 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f0399de6-9451-471c-967f-0ba832314c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:22.331813 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG keystone.notifications [None req-f0399de6-9451-471c-967f-0ba832314c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:18:22.333377 dv-cinder-826510-6-smb devstack@keystone.service[92272]: [pid: 92272|app: 0|req: 1477/2931] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 2 14:18:22 2022] DELETE /identity/v3/projects/71aa7167d9ee45b2b00cab01c947164b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:18:31.852412 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=70 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:32.327179 dv-cinder-826510-6-smb devstack@keystone.service[92272]: DEBUG dbcounter [-] [92272] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:20:55.998977 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb41f0a-2439-46ab-ac4e-9972a604ee36 admin admin] Authenticating user token {{(pid=92271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:20:56.000392 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-bcb41f0a-2439-46ab-ac4e-9972a604ee36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:20:56.105652 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb41f0a-2439-46ab-ac4e-9972a604ee36 admin admin] Validating token access rules against request {{(pid=92271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:20:56.163576 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8278b7-bb6a-4744-992b-e31ed98d9861 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b387ad13a6c843d0b9a43bc8f5f7fa13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8deff8fec8614da6997a32993c033fd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:20:56.164214 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8278b7-bb6a-4744-992b-e31ed98d9861 service placement] REQUEST_METHOD: `GET` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:20:56.164496 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8278b7-bb6a-4744-992b-e31ed98d9861 service placement] SCRIPT_NAME: `/identity` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:20:56.164771 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8278b7-bb6a-4744-992b-e31ed98d9861 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:20:56.166527 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.fernet_utils [None req-4b8278b7-bb6a-4744-992b-e31ed98d9861 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:20:56.177908 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8278b7-bb6a-4744-992b-e31ed98d9861 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:20:56.179498 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8278b7-bb6a-4744-992b-e31ed98d9861 service placement] RBAC: Authorization granted {{(pid=92271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:20:56.189102 dv-cinder-826510-6-smb devstack@keystone.service[92271]: [pid: 92271|app: 0|req: 1455/2932] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 2 14:20:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:21:06.184924 dv-cinder-826510-6-smb devstack@keystone.service[92271]: DEBUG dbcounter [-] [92271] Writing DB stats keystone:SELECT=74 {{(pid=92271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}